The ingestion object type that should trigger evaluation runs.
Choose the target first, because it changes both the valid filter columns and the valid variable-mapping sources:
observation evaluates live-ingested observations such as generations, spans, and events.
It supports mapping from input, output, and metadata.
experiment evaluates live experiment executions and can additionally map expected_output and experiment_item_metadata.
It currently supports filtering by datasetId.
Discover valid dataset IDs with GET /api/public/v2/datasets, then use the returned dataset id values in your filter.
The ingestion object type that should trigger evaluation runs.
Choose the target first, because it changes both the valid filter columns and the valid variable-mapping sources:
observationevaluates live-ingested observations such as generations, spans, and events. It supports mapping frominput,output, andmetadata.experimentevaluates live experiment executions and can additionally mapexpected_outputandexperiment_item_metadata. It currently supports filtering bydatasetId. Discover valid dataset IDs withGET /api/public/v2/datasets, then use the returned datasetidvalues in your filter.