Get started with running experiments with HoneyHive
Sample eval script
Setup input data
inputs
and ground_truths
fields will be accessible in both the function we want to evaluate and the evaluator function, as we will see below. Define the function you want to evaluate
inputs
(first parameter): dictionary of parameters from your datasetground_truths
(second parameter): optional ground truth dictionaryoutputs
field of each trace in the experiment and will be accessible to your evaluator function, as we will see below.(Optional) Setup Evaluators
outputs
(first parameter): the output returned by the evaluated functioninputs
(second parameter): the original input dictionaryground_truths
(third parameter): the ground truth dictionaryRun experiment
evaluate
:server_url
: The private HoneyHive endpoint found in the Settings page in the HoneyHive app.