주석 생성 또는 업데이트
https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations개요
대기열 내 상호작용에 대한 주석을 생성하거나 업데이트합니다. 각 주석은 interaction_id 및
요청한 사용자의 ID를 기준과 일치합니다.
응답의 결과 및 오류는 interaction_id를 통해 요청 항목과 연결됩니다.
개별 항목에 대한 오류는 나머지 배치 작업을 차단하지 않고 errors 필드에 반환됩니다.
모든 항목이 대기열 액세스 규칙에 의해 거부된 요청은 403을 반환합니다.
인수
경로 파라미터
queue_id [required]The ID of the Agent Observability annotation queue.
요청
Body Data (required)
주석 생성 또는 업데이트를 위한 페이로드입니다.
data [required]주석 대기열 내 상호작용에 대한 주석 생성 또는 업데이트 요청입니다.
attributes [required]Attributes for creating or updating annotations.
annotations [required]List of annotations to create or update. Must contain at least one item.
interaction_id [required]ID of the interaction to annotate.
label_values [required]Label values for this annotation. Each entry references a label schema by ID and provides the corresponding value validated against the schema type constraints.
assessmentAssessment result for a label value.
pass, faillabel_schema_id [required]ID of the label schema this value corresponds to.
reasoningFree text reasoning for this label value.
value [required]The value for this label. Must comply with the label schema type constraints.
Object 1A scalar numeric value.
Object 2A scalar value represented as a string.
Object 3For categorical-type labels allowing multiple selections.
Object 4A scalar boolean value.
type [required]Resource type for Agent Observability annotations.
annotations{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"assessment": "pass",
"label_schema_id": "abc-123",
"reasoning": "The response was accurate and well-structured.",
"value": 0
}
]
}
]
},
"type": "annotations"
}
}응답
OK — annotations created or updated. For mixed batches, denied items and other per-item errors are listed in errors.
Response containing the created or updated annotations.
data [required]Data object for the annotations response.
attributes [required]Attributes of the annotations response.
annotations [required]Successfully created or updated annotations.
created_at [required]Timestamp when the annotation was created.
created_by [required]Identifier of the user who created the annotation.
id [required]Unique identifier of the annotation.
interaction_id [required]Identifier of the interaction this annotation belongs to.
label_values [required]Label values for this annotation. Each entry references a label schema by ID and provides the corresponding value.
assessmentAssessment result for a label value.
pass, faillabel_schema_id [required]ID of the label schema this value corresponds to.
name_when_savedName of the label schema at the time the annotation was created.
reasoningFree text reasoning for this label value.
typeType of a label in an annotation queue label schema.
score, categorical, boolean, textvalue [required]The value for this label. Must comply with the label schema type constraints.
Object 1A scalar numeric value.
Object 2A scalar value represented as a string.
Object 3For categorical-type labels allowing multiple selections.
Object 4A scalar boolean value.
modified_at [required]Timestamp when the annotation was last modified.
modified_by [required]Identifier of the user who last modified the annotation.
errorsPartial errors for annotations that could not be processed.
annotation_idID of the annotation that failed, if applicable.
codeStable error code. permission_denied indicates the item was rejected by queue access rules.
permission_deniederror [required]Error message.
interaction_id [required]ID of the interaction that failed.
id [required]The annotation queue ID.
type [required]Resource type for Agent Observability annotations.
annotations{
"data": {
"attributes": {
"annotations": [
{
"created_at": "2024-01-15T10:30:00Z",
"created_by": "00000000-0000-0000-0000-000000000002",
"id": "annotation-789",
"interaction_id": "interaction-456",
"label_values": [
{
"assessment": "pass",
"label_schema_id": "abc-123",
"name_when_saved": "quality",
"reasoning": "The response was accurate and well-structured.",
"type": "score",
"value": 0
}
],
"modified_at": "2024-01-15T10:30:00Z",
"modified_by": "00000000-0000-0000-0000-000000000002"
}
],
"errors": [
{
"annotation_id": "00000000-0000-0000-0000-000000000000",
"code": "permission_denied",
"error": "interaction not found",
"interaction_id": "00000000-0000-0000-0000-000000000001"
}
]
},
"id": "00000000-0000-0000-0000-000000000001",
"type": "annotations"
}
}Bad Request
API error response.
errors [required]A list of errors.
detailA human-readable explanation specific to this occurrence of the error.
metaNon-standard meta-information about the error
sourceReferences to the source of the error.
headerA string indicating the name of a single request header which caused the error.
parameterA string indicating which URI query parameter caused the error.
pointerA JSON pointer to the value in the request document that caused the error.
statusStatus code of the response.
titleShort human-readable summary of the error.
{
"errors": [
{
"detail": "Missing required attribute in body",
"meta": {},
"source": {
"header": "Authorization",
"parameter": "limit",
"pointer": "/data/attributes/title"
},
"status": "400",
"title": "Bad Request"
}
]
}Unauthorized
API error response.
errors [required]A list of errors.
detailA human-readable explanation specific to this occurrence of the error.
metaNon-standard meta-information about the error
sourceReferences to the source of the error.
headerA string indicating the name of a single request header which caused the error.
parameterA string indicating which URI query parameter caused the error.
pointerA JSON pointer to the value in the request document that caused the error.
statusStatus code of the response.
titleShort human-readable summary of the error.
{
"errors": [
{
"detail": "Missing required attribute in body",
"meta": {},
"source": {
"header": "Authorization",
"parameter": "limit",
"pointer": "/data/attributes/title"
},
"status": "400",
"title": "Bad Request"
}
]
}Forbidden — all request items were denied by queue access rules
API error response.
errors [required]A list of errors.
detailA human-readable explanation specific to this occurrence of the error.
metaNon-standard meta-information about the error
sourceReferences to the source of the error.
headerA string indicating the name of a single request header which caused the error.
parameterA string indicating which URI query parameter caused the error.
pointerA JSON pointer to the value in the request document that caused the error.
statusStatus code of the response.
titleShort human-readable summary of the error.
{
"errors": [
{
"detail": "Missing required attribute in body",
"meta": {},
"source": {
"header": "Authorization",
"parameter": "limit",
"pointer": "/data/attributes/title"
},
"status": "400",
"title": "Bad Request"
}
]
}Not Found — the queue does not exist.
API error response.
errors [required]A list of errors.
detailA human-readable explanation specific to this occurrence of the error.
metaNon-standard meta-information about the error
sourceReferences to the source of the error.
headerA string indicating the name of a single request header which caused the error.
parameterA string indicating which URI query parameter caused the error.
pointerA JSON pointer to the value in the request document that caused the error.
statusStatus code of the response.
titleShort human-readable summary of the error.
{
"errors": [
{
"detail": "Missing required attribute in body",
"meta": {},
"source": {
"header": "Authorization",
"parameter": "limit",
"pointer": "/data/attributes/title"
},
"status": "400",
"title": "Bad Request"
}
]
}Too many requests
API error response.
errors [required]A list of errors.
{
"errors": [
"Bad Request"
]
}코드 예시
# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="us3.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="us5.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="datadoghq.eu"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="ap1.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="ap2.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="uk1.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="ddog-gov.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF# Path parameters
export queue_id="00000000-0000-0000-0000-000000000001"
# Set your Datadog site and credentials
export DD_SITE="us2.ddog-gov.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/llm-obs/v1/annotation-queues/${queue_id}/annotations" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"annotations": [
{
"interaction_id": "00000000-0000-0000-0000-000000000001",
"label_values": [
{
"label_schema_id": "abc-123",
"value": "good"
},
{
"label_schema_id": "ef56gh78",
"value": "positive"
}
]
}
]
},
"type": "annotations"
}
}
EOF// Create or update annotations returns "OK — annotations created or updated. For mixed batches, denied items and other
// per-item errors are listed in `errors`." response
package main
import (
"context"
"encoding/json"
"fmt"
"os"
"github.com/DataDog/datadog-api-client-go/v2/api/datadog"
"github.com/DataDog/datadog-api-client-go/v2/api/datadogV2"
)
func main() {
body := datadogV2.LLMObsAnnotationsRequest{
Data: datadogV2.LLMObsAnnotationsDataRequest{
Attributes: datadogV2.LLMObsAnnotationsDataAttributesRequest{
Annotations: []datadogV2.LLMObsUpsertAnnotationItem{
{
InteractionId: "00000000-0000-0000-0000-000000000001",
LabelValues: []datadogV2.LLMObsAnnotationLabelValue{
{
LabelSchemaId: "abc-123",
Value: datadogV2.LLMObsAnnotationLabelValueValue{
AnyValueString: datadog.PtrString("good")},
},
{
LabelSchemaId: "ef56gh78",
Value: datadogV2.LLMObsAnnotationLabelValueValue{
AnyValueString: datadog.PtrString("positive")},
},
},
},
},
},
Type: datadogV2.LLMOBSANNOTATIONSTYPE_ANNOTATIONS,
},
}
ctx := datadog.NewDefaultContext(context.Background())
ctx = context.WithValue(ctx, datadog.ContextAccessToken, os.Getenv("DD_BEARER_TOKEN"))
configuration := datadog.NewConfiguration()
configuration.SetUnstableOperationEnabled("v2.UpsertLLMObsAnnotations", true)
apiClient := datadog.NewAPIClient(configuration)
api := datadogV2.NewAgentObservabilityApi(apiClient)
resp, r, err := api.UpsertLLMObsAnnotations(ctx, "queue_id", body)
if err != nil {
fmt.Fprintf(os.Stderr, "Error when calling `AgentObservabilityApi.UpsertLLMObsAnnotations`: %v\n", err)
fmt.Fprintf(os.Stderr, "Full HTTP response: %v\n", r)
}
responseContent, _ := json.MarshalIndent(resp, "", " ")
fmt.Fprintf(os.Stdout, "Response from `AgentObservabilityApi.UpsertLLMObsAnnotations`:\n%s\n", responseContent)
}
Instructions
First install the library and its dependencies and then save the example to main.go and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"// Create or update annotations returns "OK — annotations created or updated. For mixed batches,
// denied items and other
// per-item errors are listed in `errors`." response
import com.datadog.api.client.ApiClient;
import com.datadog.api.client.ApiException;
import com.datadog.api.client.v2.api.AgentObservabilityApi;
import com.datadog.api.client.v2.model.LLMObsAnnotationLabelValue;
import com.datadog.api.client.v2.model.LLMObsAnnotationLabelValueValue;
import com.datadog.api.client.v2.model.LLMObsAnnotationsDataAttributesRequest;
import com.datadog.api.client.v2.model.LLMObsAnnotationsDataRequest;
import com.datadog.api.client.v2.model.LLMObsAnnotationsRequest;
import com.datadog.api.client.v2.model.LLMObsAnnotationsResponse;
import com.datadog.api.client.v2.model.LLMObsAnnotationsType;
import com.datadog.api.client.v2.model.LLMObsUpsertAnnotationItem;
import java.util.Arrays;
import java.util.Collections;
public class Example {
public static void main(String[] args) {
ApiClient defaultClient = ApiClient.getDefaultApiClient();
defaultClient.setAccessToken(System.getenv("DD_BEARER_TOKEN"));
defaultClient.setUnstableOperationEnabled("v2.upsertLLMObsAnnotations", true);
AgentObservabilityApi apiInstance = new AgentObservabilityApi(defaultClient);
LLMObsAnnotationsRequest body =
new LLMObsAnnotationsRequest()
.data(
new LLMObsAnnotationsDataRequest()
.attributes(
new LLMObsAnnotationsDataAttributesRequest()
.annotations(
Collections.singletonList(
new LLMObsUpsertAnnotationItem()
.interactionId("00000000-0000-0000-0000-000000000001")
.labelValues(
Arrays.asList(
new LLMObsAnnotationLabelValue()
.labelSchemaId("abc-123")
.value(
new LLMObsAnnotationLabelValueValue(
"good")),
new LLMObsAnnotationLabelValue()
.labelSchemaId("ef56gh78")
.value(
new LLMObsAnnotationLabelValueValue(
"positive")))))))
.type(LLMObsAnnotationsType.ANNOTATIONS));
try {
LLMObsAnnotationsResponse result =
apiInstance.upsertLLMObsAnnotations("00000000-0000-0000-0000-000000000001", body);
System.out.println(result);
} catch (ApiException e) {
System.err.println("Exception when calling AgentObservabilityApi#upsertLLMObsAnnotations");
System.err.println("Status code: " + e.getCode());
System.err.println("Reason: " + e.getResponseBody());
System.err.println("Response headers: " + e.getResponseHeaders());
e.printStackTrace();
}
}
}
Instructions
First install the library and its dependencies and then save the example to Example.java and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java""""
Create or update annotations returns "OK — annotations created or updated. For mixed batches, denied items and other
per-item errors are listed in `errors`." response
"""
from os import environ
from datadog_api_client import ApiClient, Configuration
from datadog_api_client.v2.api.agent_observability_api import AgentObservabilityApi
from datadog_api_client.v2.model.llm_obs_annotation_label_value import LLMObsAnnotationLabelValue
from datadog_api_client.v2.model.llm_obs_annotations_data_attributes_request import (
LLMObsAnnotationsDataAttributesRequest,
)
from datadog_api_client.v2.model.llm_obs_annotations_data_request import LLMObsAnnotationsDataRequest
from datadog_api_client.v2.model.llm_obs_annotations_request import LLMObsAnnotationsRequest
from datadog_api_client.v2.model.llm_obs_annotations_type import LLMObsAnnotationsType
from datadog_api_client.v2.model.llm_obs_upsert_annotation_item import LLMObsUpsertAnnotationItem
body = LLMObsAnnotationsRequest(
data=LLMObsAnnotationsDataRequest(
attributes=LLMObsAnnotationsDataAttributesRequest(
annotations=[
LLMObsUpsertAnnotationItem(
interaction_id="00000000-0000-0000-0000-000000000001",
label_values=[
LLMObsAnnotationLabelValue(
label_schema_id="abc-123",
value="good",
),
LLMObsAnnotationLabelValue(
label_schema_id="ef56gh78",
value="positive",
),
],
),
],
),
type=LLMObsAnnotationsType.ANNOTATIONS,
),
)
configuration = Configuration()
configuration.access_token = environ["DD_BEARER_TOKEN"]
configuration.unstable_operations["upsert_llm_obs_annotations"] = True
with ApiClient(configuration) as api_client:
api_instance = AgentObservabilityApi(api_client)
response = api_instance.upsert_llm_obs_annotations(queue_id="queue_id", body=body)
print(response)
Instructions
First install the library and its dependencies and then save the example to example.py and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"# Create or update annotations returns "OK — annotations created or updated. For mixed batches, denied items and other
# per-item errors are listed in `errors`." response
require "datadog_api_client"
DatadogAPIClient.configure do |config|
config.access_token = ENV["DD_BEARER_TOKEN"]
config.unstable_operations["v2.upsert_llm_obs_annotations".to_sym] = true
end
api_instance = DatadogAPIClient::V2::AgentObservabilityAPI.new
body = DatadogAPIClient::V2::LLMObsAnnotationsRequest.new({
data: DatadogAPIClient::V2::LLMObsAnnotationsDataRequest.new({
attributes: DatadogAPIClient::V2::LLMObsAnnotationsDataAttributesRequest.new({
annotations: [
DatadogAPIClient::V2::LLMObsUpsertAnnotationItem.new({
interaction_id: "00000000-0000-0000-0000-000000000001",
label_values: [
DatadogAPIClient::V2::LLMObsAnnotationLabelValue.new({
label_schema_id: "abc-123",
value: "good",
}),
DatadogAPIClient::V2::LLMObsAnnotationLabelValue.new({
label_schema_id: "ef56gh78",
value: "positive",
}),
],
}),
],
}),
type: DatadogAPIClient::V2::LLMObsAnnotationsType::ANNOTATIONS,
}),
})
p api_instance.upsert_llm_obs_annotations("queue_id", body)
Instructions
First install the library and its dependencies and then save the example to example.rb and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"// Create or update annotations returns "OK — annotations created or updated. For
// mixed batches, denied items and other per-item errors are listed in `errors`."
// response
use datadog_api_client::datadog;
use datadog_api_client::datadogV2::api_agent_observability::AgentObservabilityAPI;
use datadog_api_client::datadogV2::model::LLMObsAnnotationLabelValue;
use datadog_api_client::datadogV2::model::LLMObsAnnotationLabelValueValue;
use datadog_api_client::datadogV2::model::LLMObsAnnotationsDataAttributesRequest;
use datadog_api_client::datadogV2::model::LLMObsAnnotationsDataRequest;
use datadog_api_client::datadogV2::model::LLMObsAnnotationsRequest;
use datadog_api_client::datadogV2::model::LLMObsAnnotationsType;
use datadog_api_client::datadogV2::model::LLMObsUpsertAnnotationItem;
#[tokio::main]
async fn main() {
let body = LLMObsAnnotationsRequest::new(LLMObsAnnotationsDataRequest::new(
LLMObsAnnotationsDataAttributesRequest::new(vec![LLMObsUpsertAnnotationItem::new(
"00000000-0000-0000-0000-000000000001".to_string(),
vec![
LLMObsAnnotationLabelValue::new(
"abc-123".to_string(),
LLMObsAnnotationLabelValueValue::AnyValueString("good".to_string()),
),
LLMObsAnnotationLabelValue::new(
"ef56gh78".to_string(),
LLMObsAnnotationLabelValueValue::AnyValueString("positive".to_string()),
),
],
)]),
LLMObsAnnotationsType::ANNOTATIONS,
));
let mut configuration = datadog::Configuration::new();
configuration.set_unstable_operation_enabled("v2.upsert_llm_obs_annotations", true);
let api = AgentObservabilityAPI::with_config(configuration);
let resp = api
.upsert_llm_obs_annotations("queue_id".to_string(), body)
.await;
if let Ok(value) = resp {
println!("{:#?}", value);
} else {
println!("{:#?}", resp.unwrap_err());
}
}
Instructions
First install the library and its dependencies and then save the example to src/main.rs and run following commands:
DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="us3.datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="us5.datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="datadoghq.eu" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="ap1.datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="ap2.datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="uk1.datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="ddog-gov.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo runDD_SITE="us2.ddog-gov.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo run/**
* Create or update annotations returns "OK — annotations created or updated. For mixed batches, denied items and other
* per-item errors are listed in `errors`." response
*/
import { client, v2 } from "@datadog/datadog-api-client";
const configuration = client.createConfiguration({
authMethods: {
AuthZ: {
accessToken: process.env.DD_BEARER_TOKEN as string,
},
},
});
configuration.unstableOperations["v2.upsertLLMObsAnnotations"] = true;
const apiInstance = new v2.AgentObservabilityApi(configuration);
const params: v2.AgentObservabilityApiUpsertLLMObsAnnotationsRequest = {
body: {
data: {
attributes: {
annotations: [
{
interactionId: "00000000-0000-0000-0000-000000000001",
labelValues: [
{
labelSchemaId: "abc-123",
value: "good",
},
{
labelSchemaId: "ef56gh78",
value: "positive",
},
],
},
],
},
type: "annotations",
},
},
queueId: "queue_id",
};
apiInstance
.upsertLLMObsAnnotations(params)
.then((data: v2.LLMObsAnnotationsResponse) => {
console.log(
"API called successfully. Returned data: " + JSON.stringify(data)
);
})
.catch((error: any) => console.error(error));
Instructions
First install the library and its dependencies and then save the example to example.ts and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"