Skip to main content
Monitor your Devin sessions in HoneyHive to evaluate agent behavior, review conversation quality, and track usage across runs. The Devin exporter syncs sessions as structured traces, giving you full visibility into what your coding agent did and how it performed.

​
Quick Start

1

Clone and install

git clone https://github.com/honeyhiveai/honeyhive-daemon.git
cd honeyhive-daemon/devin
pip install -r requirements.txt
2

Set environment variables

export DEVIN_API_KEY=<your Devin API key>
export HH_API_KEY=<your HoneyHive API key>
export HH_API_URL=<your HoneyHive data plane URL>
For v3 keys (cog_* prefix), also set:
export DEVIN_ORG_ID=<your Devin organization ID>
3

Run the exporter

One-shot sync:
python devin_to_honeyhive.py
Daemon mode (continuous polling):
python devin_to_honeyhive.py --daemon --interval 60
After syncing, open Traces to inspect your Devin sessions.

​
What Gets Traced

Each Devin session becomes a trace tree in HoneyHive:
Event nameTypeDescription
session titlesessionRoot event with session metadata, status, PR links, and chat history.
user_messagechainUser messages (includes initial_user_message for the first prompt).
devin_messagemodelAgent responses from Devin.
session.endchainSession completion with a full conversation transcript artifact.
The root session event includes metadata for linking back to Devin (devin_url, devin_status, devin_pull_requests) and metrics.acus_consumed for tracking spend (ACUs are Devin’s Agent Compute Units, their billing unit). Re-running the exporter is safe - it tracks sync state on disk and only processes new data.

​
Troubleshooting

SymptomFix
Authentication error from DevinVerify your key prefix: apk_* for v1, cog_* for v3. Set DEVIN_ORG_ID for v3.
401 from HoneyHiveCheck HH_API_URL points to the correct data plane (e.g. https://api.dp1.us.honeyhive.ai).
Duplicate or stuck sessionsDelete the state file (sync_state.json) to force a full re-sync.
Need more detailRun with --verbose for per-session sync logs and API responses.
For full configuration options (environment variables, CLI flags, incremental sync details), see the source repo README.

Source code

Devin exporter script and documentation

Claude Code Integration

Real-time Claude Code tracing via hooks

Tracing Quickstart

Get started with HoneyHive tracing

Query Your Data

Filter and analyze traces