Troubleshooting & FAQs
Troubleshooting common issues with the tracer
This document lists the common issues users run into when using our tracer.
Please refer to the proposed solutions and see if they resolve your problem. If the issue still persists or isn’t mentioned here, please reach out on our Discord support channel.
Debugging specific issues
For detailed SDK logs, we recommend setting the argument verbose=True on the Python tracer initialization to see the error trace.
General recommendations for Python
A final fallback solution for both Python and JavaScript if all else fails is to
- Separate your provider call into a separate function
- Manually instrument that function by adding the
tracedecorator on it ortraceFunctionfor JS/TS.
Known issues
- Colab notebooks aren’t supported by our Python auto-tracer
- ES Module projects aren’t supported by our JavaScript auto-instrumentation
Tracing Rate Limits
We support up to 5MB on individual requests.
Our filters and aggregates are supported up to 5 levels of nesting.
We have a default rate limit of 1000 requests per minute.
Our online evaluators can be scoped by event_type and event_name.
Latest Package Versions tested
As of 09/18/2024
The below tables list the latest version of a provider’s package that we have tested our tracers against. It’s often the case that future versions after these are also supported. As long as the providers haven’t changed the contract on the specific inference functions that are being auto-traced, the tracer will continue to work.
Python packages tested
| Package | Version Tested for Tracing |
|---|---|
| langchain | 0.2.5 |
| llama-index | 0.10.59 |
| openai | 1.31.1 |
| aleph_alpha_client | 7.1.0 |
| boto3 | 1.34.120 |
| chromadb | 0.5.0 |
| cohere | 5.3.3 |
| google-generativeai | 0.6.0 |
| groq | 0.10.0 |
| anthropic | 0.25.2 |
| mistralai | 0.2.0 |
| ollama | 0.2.0 |
| pinecone-client | 5.0.0 |
| qdrant-client | 1.9.1 |
| replicate | 0.23.1 |
| together | 1.2.0 |
| weaviate-client | 3.26.0 |
| haystack-ai | 2.0.0 |
| marqo | 3.5.1 |
| milvus | 2.4.1 |
| ibm-watson-machine-learning | 1.0.333 |
Javascript packages tested
| Package | Version |
|---|---|
| langchain | 0.2.12 |
| llamaindex | 0.1.16 |
| @anthropic-ai/sdk | 0.27.1 |
| @azure/openai | 1.0.0-beta.10 |
| @aws-sdk/client-bedrock-runtime | 3.499.0 |
| chromadb | 1.8.1 |
| cohere-ai | 7.7.5 |
| openai | 4.57.0 |
| ollama | 0.2.0 |
| @pinecone-database/pinecone | 2.0.1 |
| @qdrant/js-client-rest | 1.9.0 |
| @google-cloud/vertexai | 1.2.0 |
| @google-cloud/aiplatform | 3.10.0 |