Looking for latest HoneyHive v2? See v2 docs here.
import honeyhive
s = honeyhive.HoneyHive(
bearer_auth="<YOUR_BEARER_TOKEN_HERE>",
)
res = s.metrics.get_metrics(project_name='<value>')
if res.metrics is not None:
# handle response
pass[
{
"name": "<string>",
"task": "<string>",
"type": "custom",
"description": "<string>",
"return_type": "boolean",
"criteria": "<string>",
"code_snippet": "<string>",
"prompt": "<string>",
"enabled_in_prod": true,
"needs_ground_truth": true,
"threshold": {
"min": 123,
"max": 123
},
"pass_when": true,
"_id": "<string>",
"event_name": "<string>",
"event_type": "<string>"
}
]Retrieve a list of all metrics
import honeyhive
s = honeyhive.HoneyHive(
bearer_auth="<YOUR_BEARER_TOKEN_HERE>",
)
res = s.metrics.get_metrics(project_name='<value>')
if res.metrics is not None:
# handle response
pass[
{
"name": "<string>",
"task": "<string>",
"type": "custom",
"description": "<string>",
"return_type": "boolean",
"criteria": "<string>",
"code_snippet": "<string>",
"prompt": "<string>",
"enabled_in_prod": true,
"needs_ground_truth": true,
"threshold": {
"min": 123,
"max": 123
},
"pass_when": true,
"_id": "<string>",
"event_name": "<string>",
"event_type": "<string>"
}
]Documentation Index
Fetch the complete documentation index at: https://docs.honeyhive.ai/llms.txt
Use this file to discover all available pages before exploring further.
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Project name associated with metrics
A list of metrics
Name of the metric
Name of the project associated with metric
Type of the metric - "custom", "model" or "human"
custom, model, human Short description of what the metric does
The data type of the metric value - "boolean", "float", "string"
boolean, float, string Criteria for human metrics
Associated code block for the metric
Evaluator prompt for the metric
Whether to compute on all production events automatically
Whether a ground truth (on metadata) is required to compute it
Threshold for numeric metrics to decide passing or failing in tests
Show child attributes
Threshold for boolean metrics to decide passing or failing in tests
Unique idenitifier
Name of event that the metric is set to be computed on
Type of event that the metric is set to be computed on
Was this page helpful?