{
"source": "evaluation",
"project_id": "65e0fc2d6a2eb95f55a92cbc",
"event_id": "fead4996-5bec-4710-bc71-c1f97d311782",
"parent_id": "397c9cbc-297f-42e9-bc1d-b2b0db850df5",
"session_id": "397c9cbc-297f-42e9-bc1d-b2b0db850df5",
"children_ids": [],
"event_name": "Ramp Docs Answerer",
"event_type": "model",
"config": {
"model": "mistralai/mistral-7b-instruct:free",
"provider": "openrouter",
"template": [
{
"role": "system",
"content": "\nAnswer the user's question only using provided context. Don't lie.\n\nContext: {{context}}\n "
},
{
"role": "user",
"content": "{{question}}"
}
]
},
"inputs": {
"question": "How do I find all the limits that have been set?",
"context": "Search documentation\nOverview\nGetting started\nRate limiting\nConventions\nAccounting setup\nError Codes\nChangelog\nAuthorization\nApp connection\nRequest authorization\nOAuth scopes\nREST API\nAccounting\nAccounting Connections\nBills\nBusiness\nCard Programs\nCards\nCashbacks\nDepartments\nEntities\nLeads\nLedger Accounts\nLimits\nList limits\nCreate a limit\nFetch deferred task status\nFetch a limit\nUpdate a limit\nTerminate a limit\nSuspend a limit\nUnsuspend a limit\nLocations\nMemos\nMerchants\nReceipt Integrations\nReceipts\nReimbursements\nSpend Programs\nStatements\nToken\nTransactions\nTransfers\nUsers\nVendors\n\nSwitch to Light theme\nLimits\nList limits\nOAuth scopes\nlimits:read\nRequest Schemas\nRequest Body\nThis request has no body.\nRequest query string parameters\nentity_id string<uuid>\noptional\nspend_program_id string<uuid>\noptional\nuser_id string<uuid>\noptional\nstart string<uuid>\noptional\npage_size integer\noptional\nResponse Schemas\nHTTP 200\n\ndata array<object>\nrequired\n\npage object\nrequired\nGET /developer/v1/limits\n\nShell\n\nJavascript\n\nPython\n\ncurl \\\n -H \"Accept: application/json\" \\\n -H \"Authorization: Bearer $RAMP_API_TOKEN\" \\\n 'https://api.ramp.com/developer/v1/limits'\nSample response\nHTTP 200\n{\n \"data\": [\n {\n \"balance\": {\n \"cleared\": 65,\n \"pending\": 35,\n \"total\": 100\n },\n \"cards\": [\n {\n \"card_id\": \"a40a6ce8-70d4-4d06-91e1-0728ad9bbe39\"\n }\n ],\n \"display_name\": \"T&E\",\n \"entity_id\": \"c18d9d2e-964f-476d-8bb3-9ac078f00e11\",\n \"has_program_overridden\": false,\n \"id\": \"d8135cfe-0396-4b2d-b2cf-ad809fb04731\",\n \"permitted_spend_types\": {\n \"primary_card_enabled\": true,\n \"reimbursements_enabled\": false\n },\n \"restrictions\": {\n \"auto_lock_date\": null,\n \"categories_whitelist\": [\n 35\n ],\n \"interval\": \"MONTHLY\",\n \"limit\": 500,\n \"next_interval_reset\": \"2022-12-01T00:00:00+00:00\",\n \"start_of_interval_date\": \"2022-11-01T00:00:00+00:00\",\n \"temporary_limit\": null,\n \"transaction_amount_limit\": 200,\n \"vendor_blacklist\": [\n 61\n ]\n },\n \"spend_program_id\": \"3a5b1f62-988f-4190-bf31-b7ae87c5dfee\",\n \"state\": \"ACTIVE\",\n \"suspension\": {\n \"acting_user_id\": \"e9186c3a-4650-48ef-aee4-56b77f5019bd\",\n \"inserted_at\": \"2022-11-03T00:00:00+00:00\",\n \"suspended_by_ramp\": false\n },\n \"users\": [\n {\n \"user_id\": \"2ba219ba-5867-453f-bec2-b8d0414b7f75\"\n }\n ]\n }\n ],\n \"page\": {\n \"next\": \"https://api.ramp.com/developer/v1/<resources>?<new_params>\"\n }\n}\nCreate a limit\nLimit may either be created with spend program id (can provide display name and spending restrictions, cannot provide payment restrictions) or without (must provide display name, spending restrictions, and payment restrictions).\n\nOAuth scopes\nlimits:write\nRequest Schemas\nRequest Body\ndisplay_name string\noptional\nCosmetic display name of the limit.\n\n\nfulfillment object\noptional\nFulfillment details of the limit's card.\n\nidempotency_key string\nrequired\nAn idempotency key is a unique value generated by the client which the server uses to recognize subsequent retries of the same request. To avoid collisions, we encourage clients to use random generated UUIDs.\n\n\npermitted_spend_types object\noptional\nSpecifies the permitted spend types.\n\nspend_program_id string<uuid>\noptional\nThe id of the associated spend program.\n "
},
{
"role": "user",
"content": "How do I find all the limits that have been set?"
}
]
},
"outputs": {
"content": "To find all the limits, you can use the Ramp API. You can make an HTTP GET request to \"https://api.ramp.com/developer/v1/limits\". This request will return a list of limits in response. The response will contain an array of objects, each representing a limit, and will also include additional metadata, such as the page of results and the total number ofles.\n\nFor more information about the Ramp API, and how to use it, please refer to the Ramp API documentation. The documentation provides details on the request and response formats, as well as information on each of the available operations and their parameters."
},
"start_time": 1710147521.798,
"end_time": 1710147531.367,
"duration": 9569.497,
"metrics": {
"Answer Faithfulness": 4.0,
"Answer Faithfulness_explanation": "The AI assistant's answer provides a clear and accurate explanation of the two environments available for the Ramp API: Production and Sandbox. It correctly mentions that API calls in the Production environment should be directed to "https://api.ramp.com" and that this environment is intended for releasing the application to the public. It also correctly states that API calls in the Sandbox environment should be directed to "https://demo-api.ramp.com" and that this environment is for exploring different API endpoints and testing applications.",
"Number of words": 100
},
"feedback": {},
"metadata": {
"completion_length": 139
},
"user_properties": {},
"error": null,
}