Create a new metric
Add a new metric
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
Name of the metric
Criteria for human or composite metrics
Associated code block for the metric
Evaluator prompt for the metric
Name of the project associated with metric
Type of the metric - "custom", "model", "human" or "composite"
custom
, model
, human
, composite
Short description of what the metric does
Whether to compute on all production events automatically
Whether a ground truth (on metadata) is required to compute it
The data type of the metric value - "boolean", "float", "string"
boolean
, float
, string
Threshold for numeric metrics to decide passing or failing in tests
Threshold for boolean metrics to decide passing or failing in tests
Unique idenitifier
Name of event that the metric is set to be computed on
Type of event that the metric is set to be computed on
Child metrics added under composite events