Platform Docs
Try DatumoEval

Model setting

In Settings > Application > Red Teaming Model Setting, set the default Judge model, default Seed generation model, and per-algorithm default settings used in Red Teaming.

Red Teaming model settings are in Settings > Application > Red Teaming Model Setting. Open Settings from Application Setting in the left menu, then pick it in the Application area.

1. Select default models

①Values you set on this screen

The values you set here become the initial values on the New Run and Seed generation screens, so you don't have to enter the same settings every time.

ItemWhat it doesUsed as the initial value for
Default judge modelJudges each attempt as Safe/UnsafeJudge Model in New Run
Default seed-generation modelGenerates new Seeds from a TaxonomyGeneration Model in Generate Seed Set
Default configuration per algorithmAttacker, Scorer, and parameters for each algorithmConfiguration in Advanced Setup
  • The list shows the Gen & Judge Models registered in the workspace.
  • At first, the model registered first on the Gen & Judge Model page is selected.
  • You can change each value separately.

②What you need

At least one Gen & Judge Model must be registered. See Register Gen & Judge models.

  • If no models are registered, a warning banner appears and all values are grayed out and can't be selected.
  • Click Go to Gen & Judge Model Setting → to go to the Gen & Judge Model section of Settings.

The model list is managed per Workspace. Click Workspace Gen & Judge Model → to go to Settings > Workspace > Workspace Gen & Judge Model.

  1. 1-1Open Model Setting

    1. In the Application area of the Settings left menu, click Red Teaming Model Setting.
    2. Check the note on where models are managed. To add a model, click Workspace Gen & Judge Model →.

    If you see a warning banner, check What you need first.

  2. 1-2Choose default models

    1. Select a Default judge model.
    2. Select a Default seed-generation model.

    See Values you set on this screen for where each value is used.


2. Set per-algorithm defaults

①Algorithm cards

Default configuration per algorithm has a card for each algorithm. These values become the initial Configuration values in the Algorithm step of Advanced Setup.

ItemDescription
AttackerThe model that creates attack queries
ScorerThe model that scores attack results
ParametersVary by algorithm (e.g., max_iterations, threshold, max_depth, max_turn).
  • The maximum allowed value (e.g., Max: 150) appears to the right of the input field.
  • Hover over ⓘ next to a parameter name to see its description.
  • Hover over ⓘ next to Attacker or Scorer to see its role and the Recommended Model.
  1. 2-1Set card values

    1. Find the card for the algorithm you want to configure.
    2. Select the Attacker and Scorer models.
    3. Enter parameter values. Don't exceed the maximum shown on the right.
    4. Hover over ⓘ to see the description and Recommended Model.

3. Save changes

①Save

When you change a value, Save in the top right becomes active.

  • Click Save to apply your changes to the New Run and Seed generation screens.
  • If you move to another tab or page without saving, a confirmation dialog opens.
  1. 3-1Save

    1. Click Save in the top right.

    If you leave without saving, a confirmation dialog opens.


Frequently asked questions

Why are the settings grayed out so I can't change them?Because no Gen & Judge Model is registered.
Cause
You can't set defaults when there are no models to choose from.
Solution
Click Go to Gen & Judge Model Setting → in the banner and register a model.
Why does a confirmation dialog appear when I try to go to another screen?Because you haven't saved your changes.
Cause
It asks again so your unsaved changes aren't lost.
Solution
Click Cancel to go back, click Save, and then move on.
Why don't the values I changed in Model Setting show up in New Run?Because you didn't save, or you changed the values directly in New Run.
Cause
Model Setting values are only filled in as initial values when you start a new New Run.
Solution
Make sure you clicked Save, then start a new New Run.

Last updated