curl --request POST \
  --url https://api.honeyhive.ai/metrics \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "_id": "<string>",
  "code_snippet": "<string>",
  "description": "<string>",
  "enabled_in_prod": true,
  "event_name": "<string>",
  "event_type": "<string>",
  "name": "<string>",
  "needs_ground_truth": true,
  "pass_when": true,
  "prompt": "<string>",
  "return_type": "boolean",
  "task": "<string>",
  "threshold": {
    "max": 123,
    "min": 123
  },
  "type": "custom"
}'

Authorizations

Authorization
string
headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
_id
string

Unique idenitifier

code_snippet
string

Associated code block for the metric

description
string
required

Short description of what the metric does

enabled_in_prod
boolean

Whether to compute on all production events automatically

event_name
string

Name of event that the metric is set to be computed on

event_type
string

Type of event that the metric is set to be computed on

name
string
required

Name of the metric

needs_ground_truth
boolean

Whether a ground truth (on metadata) is required to compute it

pass_when
boolean

Threshold for boolean metrics to decide passing or failing in tests

prompt
string

Evaluator prompt for the metric

return_type
enum<string>
required

The data type of the metric value - "boolean", "float", "string"

Available options:
boolean,
float,
string
task
string
required

Name of the project associated with metric

threshold
object

Threshold for numeric metrics to decide passing or failing in tests

type
enum<string>
required

Type of the metric - "custom" or "model"

Available options:
custom,
model