> For the complete documentation index, see [llms.txt](https://docs.datumo.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.datumo.com/documentation/documentation-en/get-start/how-to-use/4.-create-application.md). # 4. Create Application ## Create Application **Required permissions:** WS Admin or Company Owner An Application is the basic unit of evaluation and monitoring, corresponding to one AI service running in actual operation. On the Datumo platform, you can register the Application to be evaluated within a Workspace. *** ### 4-1. Create Application At the top of the left navigation `+ New Application`Click it. If there is no Application, you can also create one with the `+ Create First Application` button in the center of the screen.
After entering all items, you can add a module by clicking `+ Add Module` . You can select multiple Module Types at once, and clicking `Add`adds a Module of the selected type. When creating an Application, you can modify the Input Key and Output Key. The Application Key is set as a `string` type, and the default Input Key is `query`, and the Output Key is `response`included in the dataset.
#### Key Type options You can set the type of an Application Key according to the data format of the input and output values.\ Supported types are `string`, `list`, `boolean`, `number`, `json`included in the dataset.
typeDescription
stringThis type is used when entering or outputting plain text values.
listThis type is used when entering or outputting multiple values in an array format.
booleanThis type is used when entering or outputting true/false values.
numberThis type is used when entering or outputting numeric values.
jsonThis type is used when entering or outputting structured object-form data.
Added Modules are displayed in the list on the right. The Module Name is set the same as the type name by default, and can be modified. The Input Key and Output Key are automatically set to the default values for each type, and can be added or edited as needed.
### 4-2. Create an Agent within an Application `+Add Agent` to create one.
`+ Add Module` Click the button to select a Module Type on the right. Multiple Module Types can be selected.
Click the edit button on the right of each Module to expand that Module's Key settings area. In that area, you can modify the `Input Key`and `Output Key`used for Module evaluation.
* `+ Add Input Key`: You can add an input Key to be passed to the Module. * `+ Add Output Key`: You can add an output Key to extract from the Module's response. Added Keys can have their type and name set, and can be modified or deleted as needed. After entering all information, `Complete`click it to create the Application. Once creation is complete, you can proceed by choosing one of the following two options.
ActionDescription
Explore CriteriaMoves to the screen where you can review the evaluation criteria applied to the created Application.
Go to Application SettingMoves to the API Key and Application settings screen required to run evaluations.
### 4-3. Application Settings and Activation Complete the settings required to run evaluations on the Application Setting page. #### Application Setting Screen Layout On the Application Setting screen, you can view and manage the basic information, Version, and Module information of the created Application. * **Version List:** \ A list of created versions is displayed. To run evaluations, you must complete API Integration and Output Mapping for each version. * **Module List:** \ The Modules added during creation are displayed. To run Module-level evaluations, you must complete API Integration and Output Mapping for each Module.
In the left Application area, `+` you can add a new Application by clicking the button. When an Application is created, it is set by default to `Available in Workspace` status. If you turn off the `Available in Workspace` toggle in the upper right, that Application will not be shown in the Workspace. Turn off the toggle and `Hide Application`click it to hide the Application from the Workspace list. The Application is not deleted and can still be accessed from Settings. If you turn the toggle back on, `Make Available`can be clicked to show it again in the Workspace list. #### Create Version An Application Version is the API configuration unit that is evaluated. * `+ New Version from Scratch`: You can create a new Version from scratch without loading existing settings. * `+ New Version from Latest`: You can create a new Version based on the settings of the most recent Version. ### 4-4. Criteria Setting
* **View and Add Criteria**\ You can review the provided `Default Criteria`.\ Click the button at the top to add a new Criteria. `+` button to add a new Criteria. * **View Task and Metric Information**\ Each Criteria consists of Task Group, Subgroup, Task, Metric, and Benchmark Data information.\ On the screen, you can check the list of Tasks included in the Criteria and the number of Metrics and Benchmark Data linked to each Task. * **Add Subgroup**\ `+ New Subgroup` By clicking the button, you can add a new Subgroup within the Criteria.\ Subgroups are used to manage related Tasks as a group. * **Run Evaluation**\ `Run Evaluation` button to run an evaluation based on the current Criteria. ### 4-5. Edit and Delete Application You can edit the basic information of the Application by clicking the edit button in the upper right.
If there are any changes, `Save` the button becomes enabled. However, you must enter at least one Input/Output Key each.
`Delete` Click the button to open the Application deletion confirmation popup. If you enter "Delete application", `Delete` the button becomes enabled and it will be permanently deleted.
### 4-6. Edit and Delete Module In the Module List, you can view and manage the Modules connected to the Application.
`+ New Module` You can create a new Module by clicking the button. By clicking the edit button on the right of each Module card, you can modify that Module's settings information. If there are any changes, `Save` the button becomes enabled. However, you must enter at least one Input/Output Key each.
`Delete` Click the button to open the Application deletion confirmation popup. If you enter "Delete application", `Delete` the button becomes enabled and it will be permanently deleted.
*** ### 🔗 Related documents * G-1. Create Workspace — Create a Workspace to perform evaluation work * G-2. User Management — Invite users to the Workspace and grant permissions * G-3. Register Gen & Judge models — Configure the Gen/Judge models used for evaluation * G-5. Create Application — Register the Application to be Evaluated