Project archetypes identify the type of flow contributors will experience when tasking. These archetypes allow standardization of the instructions, task parameters and response formats while allowing a customizable task flow.

It is possible for projects to have multiple archetypes. For example, it is possible to construct a project that does RLHF on Process Supervision data.

​
Supported Archetypes

The following archetypes are currently supported in the v2 API.

  • Evals - Contributors can rate model responses on a pre-defined numeric scale.

  • RLHF - Contributors can indicate preferred model responses.

  • Rubrics - Contributors can create annotations on a pre-defined set of criteria determined during project creation.

  • SFT - Contributors can write and rewrite model responses.

​
Future Archetypes

The following archetypes are planned for the v2 API.

  • Multi-modal - Contributors can interact with multimodal data (e.g. images, videos, audio).

  • Process Supervision - Contributors can annotate the chain of thought of a model.

  • Browser Trajectories - Contributors can annotate browser usage of a model.

The following sections provide more detail on the response structure for each of the supported archetypes.

Idempotent RequestsEvals