All the prompts, datasets, fine tuned models and metrics in HoneyHive are organized by project.

Creating a new project

To create a new project, click on the “New Project” button on the top right corner of the home page.

You will be prompted to enter the name of the project, type and the description. With that, a new project is created.

Project overview

You can go to the Playground to add prompts for the task

Prompt management is done via the Prompts page or the APIs.

To add datasets for validation or fine-tuning, you can upload them via the webapp.

Alternatively, you can add them via the datasets POST API while specifying the purpose of the dataset.

Dataset management is done via the Datasets page or the APIs.

Currently, metrics can only be ingested via the metrics POST API. We are working on adding the metrics ingestion functionality via the webapp.