Platform Docs
Try DatumoEval

Overview

Track progress with Run Activity and Seed Activity, and jump to Runs, Dashboard, or Seed Management from Where to go.

1. Check Run progress

①Run Activity

Run Activity shows the status of recent Runs as banners. Each Run gets one banner.

  • Banners are sorted in the order Error > Pending > Running > Completed > Stopped.
  • Click a banner to go to the Runs screen filtered to that Run.
  • See Red Teaming Core Concept for how Runs and Batches relate.

②Run banner statuses

The banner text and available actions depend on the Run status.

StatusWhen it appearsWhat you can do
ErrorThe Run has at least one Error, or the Run can't be executed.Retry (↺)
PendingThe Run is waiting to start.—
RunningThe Run is in progress. Progress and ETA are shown.—
CompletedThe Run finished without Errors. ASR is shown.Close the banner with the ✕ button
StoppedA user stopped the Run.Close the banner with the ✕ button

③Retry

Click retry (↺) on an Error banner to rerun the parts that failed.

  • You can retry a Run up to 3 times.
  1. 1-1Open Overview

    1. In the left menu, click Overview.
    2. In Run Activity, check the banner status of each Run.

    Banners are sorted in the order Error > Pending > Running > Completed > Stopped.

  2. 1-2Retry an Error

    1. Check the number of Errors on the Error banner.
    2. Click retry (↺) on the right side of the banner.

    You can retry each Run up to 3 times. See Retry.

  3. 1-3Go to the Run list

    1. Click the banner of the Run you want to check.

    The Runs screen opens, filtered to that Run. The Runs screen is covered in the Run and view results document.

  4. 1-4Close a banner

    1. Click ✕ on the right side of a Completed or Stopped banner.

    Even if you don't close it, a Completed banner disappears automatically after 36 hours.


2. Check Seed generation progress

①Seed Activity

Seed Activity shows the status of Seed Set generation (Generate Seed Set) as banners. Each Seed Set gets one banner.

  • Banners are sorted in the order Error > Generating > Generated.
  • Click a banner to go to that Seed Set's details screen in Seed Management.

②Seed banner statuses

StatusWhen it appearsWhat you can do
ErrorAn Error occurred during Seed generation.Retry (↺)
GeneratingThe Seed Set is being created. Progress and the number of generated Seeds are shown.—
GeneratedSeed Set generation finished successfully.Close the banner with the ✕ button
  1. 2-1Check generation status

    1. In Seed Activity, check the banner status of each Seed Set.
    2. On a Generating banner, check the progress and the number of generated Seeds.
  2. 2-2Open a Seed Set

    1. Click a Generated banner.

    That Seed Set's details screen opens in Seed Management.


3. Go to other screens

①Where to go

Click a card in the Where to go section to jump straight to a frequently used screen.

CardGoes toWhat you do there
Browse all runsRun and view results (Runs)Filter by status and open Run details.
Analyze deeplyDashboardCompare multiple Runs side by side.
Manage seedsSeed ManagementUpload or generate Seed Sets to use in Runs.
  1. 3-1Shortcuts

    1. To see all Runs, click Browse all runs.
    2. To compare Run results, click Analyze deeply.
    3. To manage Seed Sets, click Manage seeds.

Frequently asked questions

Why is there no retry icon on the Error banner?Because this Run has already been retried 3 times.
Cause
You can retry a Run up to 3 times. If Errors remain after 3 retries, the icon disappears.
Solution
Click the banner and check the Run details on the Runs screen. To run it again, create a new New Run.
Why did a banner disappear?Because its display period ended and it was removed automatically.
Cause
A Run's Error banner disappears after 72 hours, and Completed and Generated banners disappear after 36 hours.
Solution
Check your Runs and Seed Sets from Browse all runs or Manage seeds.
Why does Seed Activity show Error?Because some of the Seed generation failed.
Cause
If some Seeds can't be created for reasons such as a generation model response error, Error is shown.
Solution
Click retry (↺) on the banner, or retry individual Seeds on the Seed Management details screen.

Last updated