Platform Docs
Try DatumoEval

Manage seeds

View the Seed Sets used for Red Teaming, generate them with an LLM or upload them from a file, and edit them or add Seeds on the details screen.

1. View the Seed Set list

①Seed Set

A Seed Set is a collection of Seeds used in attack simulations. Each Seed has a Taxonomy, and each Seed Set belongs to one Domain. The Taxonomy setup differs by Domain.

  • The list shows every Seed Set in the current Workspace.
  • Click a row to open the Seed Set details screen.
  • You choose a Seed Set in the Seeds step of New Run. Run and view results explains how.
ColumnDescription
Created atCreation date
Seed Set NameName
DescriptionDescription
DomainThe Domain it belongs to
Seed CountNumber of Seeds. During generation, shows the number generated so far.
Creation Type / StatusHow it was created and its current status

②Creation types and statuses

Type / statusMeaning
Built inA built-in Seed Set. You can't delete, add to, or edit it.
UploadedA Seed Set created by uploading a file
GeneratedA Seed Set whose generation has finished
GeneratingGeneration in progress. A loading indicator appears.
ErrorOne or more errors occurred. Retry everything from the list, or retry individual Seeds on the details screen.
UploadingUpload in progress. The row is dimmed and can't be opened.

③What you need

To generate Seeds with an LLM, you need at least one Gen & Judge Model. Without one, a warning banner appears and the Generate button is disabled. Register Gen & Judge models explains how.

  1. 1-1Open the list

    1. In the left menu, under Red Teaming, click Seed Management.
    2. Review the column names. See Seed Set for what they mean.
  2. 1-2Check the status

    1. Check generation progress in Generating rows.
    2. For Error rows, retry everything with Retry.
    3. For Uploading rows, wait until the upload finishes.

    See Creation types and statuses for what each status means.

  3. 1-3Open a Seed Set

    1. Click the row of the Seed Set you want to open.

    The details screen is covered in 4. View and edit Seed Set details.


2. Generate a Seed Set

①Fields

Click Generate Seed Set to open the generation screen. Enter settings on the left, check samples in Preview on the right, then generate the full data.

SectionFieldDescription
1 Basic InfoSeed Set Name *Seed Set name
DescriptionFor your reference. Doesn't affect generation results.
Number of Seeds *Number of Seeds to generate. The default is 100.
2 Domain & TaxonomyDomain *Only Open Domain is available for now. Finance, Legal, and Commerce are Coming soon.
Taxonomy *Select at least one Taxonomy. The Taxonomy list differs by Domain (19 for Open Domain).
3 Generation MethodGeneration method *Select Datumo Seed Generator Lv.1 or Lv.2.
Lv.2 document and captionWith Lv.2, upload one PDF and describe in the caption field how to use the document to build seeds. The caption is required for Lv.2. For now you can upload only one PDF.
Generation RequirementsOptional, but recommended. Write one persona, goal, or constraint per line.
4 Generation OptionsLanguage *KR or ENG
Generation Model *Defaults to the default seed generation model in Model settings.

②Taxonomy distribution

When you select Taxonomies, the message Equal split — about N seeds per taxonomy appears. Seeds are split evenly across Taxonomies.

  • To set the distribution yourself, click Customize.
  • The percentages across Taxonomies must add up to 100%.

③Samples and full generation

When all required fields are filled in, the Generate 15 Sample Data button is enabled.

  • When sample generation finishes, you see a summary (Generated {N} seeds across {N} taxonomies using {Model}…) along with the time taken and cost.
  • The preview shows up to 15 rows. Samples aren't saved yet.
  • Rows that failed to generate show ⚠ and an error message. Regenerate them with the row's retry (↺) button.
  • Even with errors, you can proceed to full generation with Generate Full Data.
  • When full generation starts, the Seed Set is added to the list with Generating status.

④Draft

A Draft is a working copy that bundles generation settings with their results.

  • When you open the generation screen, Draft #1 starts.
  • In Draft History, review the settings and generated Seeds of earlier Drafts.
  • Click Create New Draft to create a new Draft that carries over the current settings.
  1. 2-1Open the generation screen

    1. Click Generate Seed Set at the top right.
    2. In Basic Info, enter the Seed Set Name and Number of Seeds.

    See Fields for what each field means.

  2. 2-2Domain and Taxonomy

    1. Select a Domain.
    2. Select at least one Taxonomy. The Taxonomy list differs by Domain (19 for Open Domain).
    3. To change the distribution, click Customize and set it so the total is 100%.

    By default, Seeds are split evenly across Taxonomies.

  3. 2-3Generation method and options

    1. Select a Generation Method.
    2. Enter Generation Requirements. To add more fields, click Add Requirements.
    3. Select a Language and Generation Model.
  4. 2-4Review samples

    1. Click Generate 15 Sample Data.
    2. Review the summary, time taken, and cost.
    3. If any rows show ⚠, click retry (↺).

    Samples aren't saved yet.

  5. 2-5Generate full data

    1. Click Generate Full Data.
    2. In the confirmation dialog, click Generate.

    The Seed Set is added to the list with Generating status.

  6. 2-6Manage Drafts

    1. To view earlier settings, click Draft History.
    2. To change settings and generate again, click Create New Draft.

    A new Draft carries over the current settings.


3. Upload from a file

①Upload fields

Click Upload File to go through two steps. You can upload only one file.

StepFieldDescription
1Seed Set Name *Seed Set name
Domain *Fixed to Open Domain for now.
DescriptionDescription
2Column MappingMap columns in the file to seed and taxonomy (required). Choose whether to treat the remaining columns as Metadata.
Taxonomy MappingMap each unique value in the Taxonomy column to one of the Domain's Taxonomies.
  • ✦ Automatically map (AI) fills in only the values you haven't mapped yourself.
  • You must map every Taxonomy value to finish the upload.
  1. 3-1File and basic information

    1. Click Upload File at the top right of the list.
    2. Drag and drop a file, or select one to upload.
    3. Enter a Seed Set Name and check the Domain.
    4. Click Next.

    Next is enabled only when all required fields are filled in.

  2. 3-2Map columns and Taxonomies

    1. Map columns in the file to seed and taxonomy.
    2. For each Taxonomy value, select the Taxonomy to map it to, or click ✦ Automatically map (AI).
    3. Make sure no fields are empty, then click Upload.

    You can't finish the upload while any values are unmapped.


4. View and edit Seed Set details

①Features by type

On the details screen, review the ID, Seed, Taxonomy, Metadata, and total number of items. You can filter by Domain and Taxonomy.

FeatureBuilt inUploaded / Generated
ExportAvailableAvailable
DeleteNo buttonAvailable
Generate SeedNo buttonAvailable
Upload FileNo buttonAvailable
EditNo buttonAvailable

②Edit and add Seeds

  • Click Edit to enter edit mode. Click a row to edit its Seed and Metadata directly, and change its Taxonomy from the list.
  • Add Seeds to an existing Seed Set with Generate Seed or Upload File. The steps are the same as when creating a new one.
  • Because the existing settings are reused, some fields are hidden.
MethodHidden fields
Generate SeedSeed Set Name, Domain selection
Upload FileSeed Set Name, Description, Domain selection
  1. 4-1View details

    1. Click a Seed Set row in the list.
    2. Review the Seed, Taxonomy, and Metadata.
    3. Check the total number of items at the bottom.

    Built in Seed Sets support only Export.

  2. 4-2Edit

    1. Click Edit.
    2. Click a row to edit its Seed or change its Taxonomy.
  3. 4-3Add and export Seeds

    1. To generate more Seeds, click Generate Seed.
    2. To add Seeds from a file, click Upload File.
    3. To download as CSV, click Export.

    See Edit and add Seeds for the fields hidden when adding.


Frequently asked questions

Why can't I click Generate Seed Set, and why do I see a warning banner?Because no Gen & Judge Models are registered.
Cause
Generating Seeds with an LLM requires a generation model. Upload, Edit, Export, and Delete still work.
Solution
Click Go to Gen & Judge Model Setting → in the banner and register a model.
Why can't I click Generate 15 Sample Data?Because not all required fields are filled in.
Cause
You need a Seed Set Name, Domain and Taxonomy, and a generation method to generate samples.
Solution
Fill in the missing fields.
Why can't I select Finance, Legal, or Commerce?Because those Domains aren't available yet.
Cause
Only Open Domain is available for now (Coming soon).
Solution
Select Open Domain.
Why do I see ⚠ on a preview row?Because the sample for that row couldn't be generated.
Cause
If the generation model responds slowly or fails, only that row becomes an Error.
Solution
Click the row's retry (↺) button. You can still run full generation even with errors.
Why can't I open a Seed Set with Uploading status?Because the upload hasn't finished yet.
Cause
Seed Sets that are uploading are dimmed and can't be opened.
Solution
Open it again after the upload finishes.
Why can't I finish the upload?Because some Taxonomy values aren't mapped.
Cause
Every Taxonomy value in the file must be mapped to one of the Domain's Taxonomies.
Solution
Fill in the empty fields or click ✦ Automatically map (AI).
Why are there no Edit or Delete buttons on a Built-in Seed Set?Because Built-in Seed Sets can't be changed. You can only use Export.
Cause
Built in Seed Sets can't be deleted, added to, or edited; only Export is available.
Solution
To change the contents, edit the exported file and upload it as a new Seed Set.

Last updated