All the prompts, datasets, fine tuned models and metrics in HoneyHive are organized by project.

Creating a new project

To create a new project, click on the “New Project” button on the top right corner of the home page.

You will be prompted to enter the name of the project, type and the description. With that, a new project is created.

Project overview

Prompts

You can go to the Playground to add prompts for the task or add them via the prompts POST API.

Prompt management is done via the Prompts page or the APIs.

Datasets

To add datasets for validation or fine-tuning, you can upload them via the webapp.

Alternatively, you can add them via the datasets POST API while specifying the purpose of the dataset.

Dataset management is done via the Datasets page or the APIs.

Fine-tuned models

You can trigger fine-tuning jobs via the Fine-Tuning page. Currently, we don’t have model import functionality. We are working on adding it.

Metrics

Currently, metrics can only be ingested via the metrics POST API. We are working on adding the metrics ingestion functionality via the webapp.