Product Updates

​

Core Platform

• Added list of allowed characters for project names

​

Python SDK (Logger)

​

HoneyHive Logger (honeyhive-logger) released

• The logger sdk has
  1. No external dependencies
  2. A fully stateless design
• Optimized for
  • Serverless environments
  • Highly regulated environments with strict security requirements

​

TypeScript SDK (Logger)

​

HoneyHive Logger (@honeyhive/logger) released

• The logger sdk has
  1. No external dependencies
  2. A fully stateless design
• Optimized for
  • Serverless environments
  • Highly regulated environments with strict security requirements

​

Python SDK - Version [v0.2.49]

• Added type annotation to decorators and the evaluation harness

​

Documentation

• Added documentation for Python/Typescript Loggers
• Updated gemini integration documentation to use latest sdk (Python and TypeScript)

​

Core Platform

​

Support for External Datasets in Experiments

You can now log experiments using external datasets with custom IDs for both datasets and datapoints. External dataset IDs will display with the “EXT-” prefix in the UI. This feature provides greater flexibility for teams working with custom datasets while maintaining full integration with our experiment tracking.

{ 
"id": "<CUSTOM_DATASET_ID>",  // Optional 
"name": "<DATASET_NAME>",     // Optional
"data": [ 
    { 
        "id": "<CUSTOM_DATAPOINT_ID_1>",  // Optional 
        "inputs": { ... }, 
        "ground_truths": { ... }, 
    }
    // Additional datapoints...
] 
}

​

Documentation

• Standardizes parameter names and clarified evaluation order in Experiments Quickstart and Python/TS SDK docs.
• Adds cookbook: Inspirational Quotes Recommender with Qdrant and OpenAI

​

Core Platform

• Bug fixes and improvements across various areas to enhance performance and stability.

​

Documentation

• Adds Evaluating External Logs tutorial.
• Updates Python and TypeScript SDK’s references and overall documentation to align with recent improvements and best practices.

​

Core Platform

• Bug fixes for playground & evaluator version controls.

​

Documentation

• Adds Datasets Introduction Guide.
• Adds Server-side Evaluator Templates List documentation.
• Adds LangGraph Integration documentation.

​

Core Platform

​

Wide Mode

We’ve introduced a new Wide Mode option that allows users to hide the sidebar, providing:

• Expanded workspace area for a more immersive viewing experience
• Distraction-free environment when focusing on complex tasks
• Better content visibility on smaller screens and split-window setups
• Toggle controls accessible via the header menu for easy switching

​

Improved Experiments Layout

Our redesigned comparison interface improves result analysis with:

• Structured input visualization with collapsible sections
• Clear side-by-side metrics display for easier model comparison
• Improved performance statistics with visual rating indicators

Other updates:

• Bug fixes and stability improvements for filtering functionality.
• Added support for exists and not exists operators in filters.
• Frontend styling improvements to enhance the user interface.
• Bug fixes and stability enhancements for a smoother user experience.

​

Documentation

• Improved documentation for async function handling.
• Added integration documentation for model providers:
  • Openai..
  • Azure OpenAI.
  • AWS Bedrock.
• Tutorial for running experiments with multi-step LLM applications wit MongoDB and OpenAI.
• Adds Streamlit Cookbook for tracing model calls with collected user feedback on AI response.

​

Core Platform

• Enhanced filter functionality: Added the ability to edit filters and improved schema discovery within filters.
• Fixed pagination issue for events table.

​

Python SDK - Version [v0.2.44]

• Improved error tracking for the tracer: Enhanced the capture of error messages for custom-decorated functions.
• Git context enrichment: Added support for capturing Git branch status in traces and experiments.
• Introduced the disable_http_tracing parameter during tracer initialization to disable HTTP event tracing.
• Fixed the traceloop version to 0.30.0 to resolve protobuf dependency conflicts.

​

TypeScript SDK - Version [v1.0.33]

• Improved error tracking for the tracer: Enhanced the capture of error messages for traced functions.
• Git context enrichment: Added support for capturing Git branch status in traces and experiments.
• Introduced the disableHttpTracing parameter during tracer initialization to disable HTTP event tracing.

​

Documentation

• Standardized all JavaScript/TypeScript code examples to TypeScript across the documentation.
• Added troubleshooting guidance for SSL validation failures.
• Documented the disable_http_tracing/disableHttpTracing parameter in the SDK Reference.
• Removed references to init_from_session_id in favor of using init with the session_id parameter.
• Updated the Observability Tutorial Documentation/Cookbook to use enrichSession instead of setFeedback/setMetadata
• Integrations - added CrewAI Integration documentation.

​

Core Platform

​

Introducing Review Mode

A new way for domain experts to annotate traces with human feedback.

With Review Mode, you can:

• Tag traces with annotations from your Human Evaluators definitions
• Apply your custom criteria right in the UI
• Add comments when something interesting pops up

This should make life easier when you’re combing through traces and need to mark things for later. Perfect for when the whole team needs to analyze outputs together.

Check it out in Experiments and Data Store - look for the “Review Mode” button.

​

Python SDK - Version [v0.2.36]

• Reduced package size for AWS lambda usage
• Removed Langchain dependency. For using Langchain callbacks, install Langchain separately
• Add lambda, core, and eval poetry installation groups

​

TypeScript SDK - Version [v1.0.23]

• Reduced package size for AWS lambda usage
• Disabled CommonJS autotracing 3rd party packages: Anthropic, Bedrock, Pinecone, ChromaDB, Cohere, Langchain, LlamaIndex, OpenAI. Please use custom tracing for instrumenting Typescript.
• Refactor custom tracer for better initialization syntax and using typescript

​

Documentation

• Added Schema Overview documentation to describe our schemas in detail including a list of reserved properties.
• Added Client-side Evaluators documentation to describe the use of client-side evaluators for both tracing and experiments
• Updated Custom Spans documentation to add reference to tracing methods traceModel/traceTool/traceChain (TypeScript)
• Integrations - added LanceDB Integration documentation
• Integrations - added Zilliz Integration documentation