Skip to main content
HoneyHive tracks version history for server-side evaluators, letting you review changes, compare versions, and roll back when needed.

​
How It Works

Each evaluator maintains a version history. When you make changes and save, you create a new version with a description of what changed. One version is deployed at a time. This is the version that runs on your traces.

​
Saving a New Version

  1. Open an evaluator and make your changes
  2. Click Save Version in the header
  3. Review the diff showing your changes compared to the current deployed version
  4. Enter a version description explaining what you changed
  5. Click Save to save without deploying, or Save & Deploy to make it active immediately
Write clear version descriptions like “Added JSON validation” or “Fixed threshold for edge cases”. You’ll thank yourself when reviewing history.

​
Rolling Back

To revert to a previous version:
  1. Open the evaluator
  2. Click the version dropdown in the header to see all versions
  3. Select the version you want to restore
  4. Click Deploy to make that version active
The previous version becomes the new deployed version. Your version history is preserved, and rolling back doesn’t delete any versions.

Python Evaluators

Create code-based evaluators

LLM Evaluators

Create prompt-based evaluators