--- title: Agent Observability description: Manage Agent Observability spans, data, projects, datasets, dataset records, experiments, prompts, and annotations. breadcrumbs: Docs > API > Agent Observability --- > For the complete documentation index, see [llms.txt](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/llms.txt). # Agent Observability Manage Agent Observability spans, data, projects, datasets, dataset records, experiments, prompts, and annotations. ## [List Agent Observability projects](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-projects.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------ | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/projects | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/projects | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/projects | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projects | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projects | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projects | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/projects | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projects | ## [Create an Agent Observability project](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-an-agent-observability-project.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/projects | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/projects | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/projects | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projects | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projects | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projects | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/projects | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projects | ## [Update an Agent Observability project](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-an-agent-observability-project.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id} | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id} | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id} | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/projects/{project_id} | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id} | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id} | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id} | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/projects/{project_id} | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projects/{project_id} | ## [Delete Agent Observability projects](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-agent-observability-projects.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/projects/delete | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/projects/delete | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects/delete | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/projects/delete | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projects/delete | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projects/delete | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projects/delete | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/projects/delete | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projects/delete | ## [List Agent Observability datasets](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-datasets.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets | ## [Create an Agent Observability dataset](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-an-agent-observability-dataset.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets | ## [List Agent Observability dataset records](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-dataset-records.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | ## [Append records to an Agent Observability dataset](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/append-records-to-an-agent-observability-dataset.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | ## [Update an Agent Observability dataset](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-an-agent-observability-dataset.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id} | ## [Update Agent Observability dataset records](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-agent-observability-dataset-records.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------------ | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records | ## [Delete Agent Observability datasets](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-agent-observability-datasets.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/delete | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/delete | ## [Delete Agent Observability dataset records](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-agent-observability-dataset-records.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------------------ | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete | ## [List Agent Observability experiments](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-experiments.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/experiments | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments | ## [Create an Agent Observability experiment](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-an-agent-observability-experiment.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/experiments | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments | ## [Update an Agent Observability experiment](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-an-agent-observability-experiment.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/{experiment_id} | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id} | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id} | ## [Delete Agent Observability experiments](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-agent-observability-experiments.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/experiments/delete | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/delete | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/delete | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/delete | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/delete | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/delete | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/delete | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/delete | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/delete | ## [Push events for an Agent Observability experiment](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/push-events-for-an-agent-observability-experiment.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | ## [List Agent Observability annotation queues](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-annotation-queues.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues | ## [Create an Agent Observability annotation queue](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-an-agent-observability-annotation-queue.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues | ## [Update an Agent Observability annotation queue](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-an-agent-observability-annotation-queue.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | ## [Delete an Agent Observability annotation queue](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-an-agent-observability-annotation-queue.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------------- | | app.datadoghq.com | DELETE https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | us3.datadoghq.com | DELETE https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | us5.datadoghq.com | DELETE https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | app.datadoghq.eu | DELETE https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | ap1.datadoghq.com | DELETE https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | ap2.datadoghq.com | DELETE https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | uk1.datadoghq.com | DELETE https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | app.ddog-gov.com | DELETE https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | | us2.ddog-gov.com | DELETE https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id} | ## [Add annotation queue interactions](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/add-annotation-queue-interactions.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions | ## [Get annotated queue interactions](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-annotated-queue-interactions.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions | ## [Delete annotation queue interactions](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-annotation-queue-interactions.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete | ## [Get a custom evaluator configuration](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-a-custom-evaluator-configuration.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | ## [Create or update a custom evaluator configuration](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-or-update-a-custom-evaluator-configuration.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------- | | app.datadoghq.com | PUT https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us3.datadoghq.com | PUT https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us5.datadoghq.com | PUT https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | app.datadoghq.eu | PUT https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | ap1.datadoghq.com | PUT https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | ap2.datadoghq.com | PUT https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | uk1.datadoghq.com | PUT https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | app.ddog-gov.com | PUT https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us2.ddog-gov.com | PUT https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | ## [Delete a custom evaluator configuration](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-a-custom-evaluator-configuration.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------------- | | app.datadoghq.com | DELETE https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us3.datadoghq.com | DELETE https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us5.datadoghq.com | DELETE https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | app.datadoghq.eu | DELETE https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | ap1.datadoghq.com | DELETE https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | ap2.datadoghq.com | DELETE https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | uk1.datadoghq.com | DELETE https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | app.ddog-gov.com | DELETE https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | | us2.ddog-gov.com | DELETE https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name} | ## [Create or update annotations](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-or-update-annotations.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations | ## [Delete annotations](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-annotations.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete | ## [List events for an Agent Observability experiment](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-events-for-an-agent-observability-experiment.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events | ## [Search Agent Observability experimentation](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/search-agent-observability-experimentation.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/experimentation/search | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentation/search | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experimentation/search | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/experimentation/search | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentation/search | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentation/search | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentation/search | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/experimentation/search | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentation/search | ## [Simple search experimentation entities](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/simple-search-experimentation-entities.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/experimentation/simple-search | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/experimentation/simple-search | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentation/simple-search | ## [Aggregate Agent Observability experimentation](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/aggregate-agent-observability-experimentation.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------ | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/experimentation/analytics | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/experimentation/analytics | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentation/analytics | ## [List Agent Observability spans](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-spans.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/spans/events | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/spans/events | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/spans/events | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/spans/events | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/spans/events | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/spans/events | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/spans/events | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/spans/events | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/spans/events | ## [Search Agent Observability spans](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/search-agent-observability-spans.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------ | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/spans/events/search | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/spans/events/search | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/spans/events/search | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/spans/events/search | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/spans/events/search | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/spans/events/search | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/spans/events/search | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/spans/events/search | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/spans/events/search | ## [List LLM integration accounts](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-llm-integration-accounts.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/integrations/{integration}/accounts | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/accounts | ## [List LLM integration models](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-llm-integration-models.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models | ## [Run an LLM inference](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/run-an-llm-inference.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------------------ | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference | ## [Get annotated interactions by content IDs](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-annotated-interactions-by-content-ids.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/annotated-interactions | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/annotated-interactions | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotated-interactions | ## [Get Agent Observability dataset draft state](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-agent-observability-dataset-draft-state.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state | ## [Lock Agent Observability dataset draft state](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/lock-agent-observability-dataset-draft-state.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock | ## [Unlock Agent Observability dataset draft state](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/unlock-agent-observability-dataset-draft-state.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock | ## [List Agent Observability dataset versions](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-dataset-versions.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions | ## [Export an Agent Observability dataset](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/export-an-agent-observability-dataset.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export | ## [Batch update Agent Observability dataset records](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/batch-update-agent-observability-dataset-records.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update | ## [Clone an Agent Observability dataset](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/clone-an-agent-observability-dataset.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone | ## [Restore an Agent Observability dataset version](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/restore-an-agent-observability-dataset-version.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore | ## [Upload records to an Agent Observability dataset](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/upload-records-to-an-agent-observability-dataset.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------------------ | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload | ## [List Agent Observability experiment spans (v1)](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-experiment-spans-v1.md) (deprecated) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events | ## [List Agent Observability experiment events (v2)](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-experiment-events-v2.md) (deprecated) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events | ## [Get annotation queue label schema](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-annotation-queue-label-schema.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | ## [Update annotation queue label schema](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-annotation-queue-label-schema.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------------------- | | app.datadoghq.com | PUT https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | us3.datadoghq.com | PUT https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | us5.datadoghq.com | PUT https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | app.datadoghq.eu | PUT https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | ap1.datadoghq.com | PUT https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | ap2.datadoghq.com | PUT https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | uk1.datadoghq.com | PUT https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | app.ddog-gov.com | PUT https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | | us2.ddog-gov.com | PUT https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema | ## [Create or update a patterns configuration](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-or-update-a-patterns-configuration.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------- | | app.datadoghq.com | PUT https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | us3.datadoghq.com | PUT https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | us5.datadoghq.com | PUT https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | app.datadoghq.eu | PUT https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configs | | ap1.datadoghq.com | PUT https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | ap2.datadoghq.com | PUT https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | uk1.datadoghq.com | PUT https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | app.ddog-gov.com | PUT https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs | | us2.ddog-gov.com | PUT https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs | ## [Delete a patterns configuration](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-a-patterns-configuration.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------ | | app.datadoghq.com | DELETE https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | us3.datadoghq.com | DELETE https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | us5.datadoghq.com | DELETE https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | app.datadoghq.eu | DELETE https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | ap1.datadoghq.com | DELETE https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | ap2.datadoghq.com | DELETE https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | uk1.datadoghq.com | DELETE https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | app.ddog-gov.com | DELETE https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | | us2.ddog-gov.com | DELETE https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id} | ## [Trigger a patterns run](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/trigger-a-patterns-run.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-runs | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs | ## [Get patterns run status](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-patterns-run-status.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-runs/status | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs/status | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs/status | ## [List patterns runs](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-patterns-runs.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------ | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-runs | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs | ## [List patterns topics](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-patterns-topics.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-topics | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topics | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topics | ## [List patterns clustered points](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-patterns-clustered-points.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------ | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-clustered-points | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-clustered-points | ## [List patterns topics with clustered points](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-patterns-topics-with-clustered-points.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points | ## [Get a patterns configuration](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-a-patterns-configuration.md) (preview) | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configs/latest | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/latest | ## [List patterns configurations](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-patterns-configurations.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configs | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs | ## [List Agent Observability prompts](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-agent-observability-prompts.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/prompts | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts | ## [Create an Agent Observability prompt](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-an-agent-observability-prompt.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------ | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/prompts | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts | ## [Get an Agent Observability prompt](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-an-agent-observability-prompt.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id} | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id} | ## [Update an Agent Observability prompt](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-an-agent-observability-prompt.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id} | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id} | ## [Delete an Agent Observability prompt](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/delete-an-agent-observability-prompt.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------- | | app.datadoghq.com | DELETE https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us3.datadoghq.com | DELETE https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us5.datadoghq.com | DELETE https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | app.datadoghq.eu | DELETE https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id} | | ap1.datadoghq.com | DELETE https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | ap2.datadoghq.com | DELETE https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | uk1.datadoghq.com | DELETE https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | app.ddog-gov.com | DELETE https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id} | | us2.ddog-gov.com | DELETE https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id} | ## [List versions of an Agent Observability prompt](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-versions-of-an-agent-observability-prompt.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | ## [Create a new Agent Observability prompt version](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/create-a-new-agent-observability-prompt-version.md) (preview) | Datadog site | API endpoint | | ----------------- | --------------------------------------------------------------------------------- | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | uk1.datadoghq.com | POST https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions | ## [Get a specific Agent Observability prompt version](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-a-specific-agent-observability-prompt-version.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------ | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | ## [Update an Agent Observability prompt version](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/update-an-agent-observability-prompt-version.md) (preview) | Datadog site | API endpoint | | ----------------- | -------------------------------------------------------------------------------------------- | | app.datadoghq.com | PATCH https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | us3.datadoghq.com | PATCH https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | us5.datadoghq.com | PATCH https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | app.datadoghq.eu | PATCH https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | ap1.datadoghq.com | PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | ap2.datadoghq.com | PATCH https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | uk1.datadoghq.com | PATCH https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | app.ddog-gov.com | PATCH https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | | us2.ddog-gov.com | PATCH https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version} | ## [List custom evaluator configurations](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-custom-evaluator-configurations.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom | ## [Get an annotated queue interaction](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/get-an-annotated-queue-interaction.md) (preview) | Datadog site | API endpoint | | ----------------- | ------------------------------------------------------------------------------------------------------------------------ | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id} | ## [List patterns templates](https://dnd37xeb23o8n.cloudfront.net/stefon.simmons/docs-astro-web-10435/api/latest/agent-observability/list-patterns-templates.md) (preview) | Datadog site | API endpoint | | ----------------- | ----------------------------------------------------------------------------- | | app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-templates | | us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-templates | | us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-templates | | app.datadoghq.eu | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-templates | | ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-templates | | ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-templates | | uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-templates | | app.ddog-gov.com | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-templates | | us2.ddog-gov.com | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-templates |