HoneyHive provides git-based version control for custom evaluators, allowing you to track changes, roll back to previous versions, and manage evaluator evolution.

​
Creating a new version

When you create an evaluator and save it for the first time, we initialize version tracking on that evaluator.
If you have existing evaluators in your tenant, the latest evaluator version will be committed automatically the first time you open it.

​
Updating your evaluator

​
Rolling back to a previous version

When rolling back to a previous version, a commit message is not required.

​
Best practices

  1. Descriptive commit messages: Always provide clear and concise commit messages that explain the changes made in each version.
  2. Regular updates: Keep your evaluators up-to-date by making small, incremental changes rather than large, sweeping updates.
  3. Testing: Before deploying a new version to production, test it thoroughly to ensure it functions as expected.
By following these best practices and utilizing the Evaluator Version Management feature, you can effectively manage and control the evolution of your custom evaluators in HoneyHive.