Create a Databricks integration account
警告Note: This endpoint is in preview and is subject to change.
If you have any feedback, contact Datadog support.
POST
https://api.datadoghq.com/api/v2/integration-interfaces/databricks/accountshttps://api.us3.datadoghq.com/api/v2/integration-interfaces/databricks/accountshttps://api.us5.datadoghq.com/api/v2/integration-interfaces/databricks/accountshttps://api.datadoghq.eu/api/v2/integration-interfaces/databricks/accountshttps://api.ap1.datadoghq.com/api/v2/integration-interfaces/databricks/accountshttps://api.ap2.datadoghq.com/api/v2/integration-interfaces/databricks/accountshttps://api.uk1.datadoghq.com/api/v2/integration-interfaces/databricks/accountshttps://api.ddog-gov.com/api/v2/integration-interfaces/databricks/accountshttps://api.us2.ddog-gov.com/api/v2/integration-interfaces/databricks/accounts概要
Create a Databricks integration account.
リクエスト
Body Data (required)
フィールド
タイプ
説明
data [required]object
Data envelope for creating a Databricks integration account.
attributes [required]object
Writable attributes used to create a Databricks integration account.
authentication [required]<oneOf>
Authentication for creating the Databricks integration account. Exactly one method is set. Choosing private_action_runner leaves the databricks-model-serving-metrics dataflow unable to collect data. bearer_token is not available on creation: Databricks accepts it only on accounts that already use it, so it can only appear on read and update.
<auth_type=databricks_oauth>object
Databricks OAuth machine-to-machine authentication using a service principal.
auth_type [required]enum
The authentication method type.
databricks_oauthAllowed enum values:
databricks_oauthazure_tenant_idstring
Microsoft Entra ID tenant of the service principal, for Azure Databricks workspaces.
client_id [required]string
Client ID of the Databricks service principal.
client_secret [required]string
Secret of the Databricks service principal. Generate it under User management > Service principals > Credentials & secrets in Databricks.
<auth_type=private_action_runner>object
Private Action Runner authentication. The runner holds the Databricks credentials, so this method carries no secrets.
auth_type [required]enum
The authentication method type.
private_action_runnerAllowed enum values:
private_action_runnerconnection_id [required]uuid
Unique identifier of the Private Action Runner connection holding the credentials.
secret_pathstring
Path of the credential inside the secret backend configured on the runner.
user_uuid [required]uuid
Unique identifier of the user the Private Action Runner connection belongs to.
dataflowsobject
Data Datadog collects from Databricks, keyed by dataflow id. Each dataflow turns on a distinct kind of collection: set enabled to start or stop it, and use settings to configure what it collects. Defaults listed on each dataflow apply when the account is created; on update, omitted fields keep their current values. Some dataflows have prerequisites, noted on each; unless one is documented as rejecting the request, it is not verified, so a dataflow enabled without it is stored but collects no data.
databricks-cloud-cost-metricsobject
Cost data collected from your Databricks system tables. Cloud Cost Management must be enabled for your organization while this dataflow is on; any request that leaves it enabled without that is rejected with a 422 response.
enabledboolean
Whether Datadog collects this data. Defaults to false; set to true to start collection.
settingsobject
Settings of the Cloud Cost Management dataflow. Only the fields provided are changed.
ccm_collect_all_workspacesboolean
Whether cost data is collected for every workspace in the Databricks account rather than this workspace only. This takes effect across the Databricks account: if any one workspace enables it, Datadog collects cost data for all of them regardless of their individual settings, and every covered workspace incurs Cloud Cost Management charges. Defaults to true.
databricks-data-observability-jobs-monitoringobject
Data Jobs Monitoring, which collects performance, reliability, and cost data for your Databricks jobs.
enabledboolean
Whether Datadog collects this data. Defaults to true; set to false to stop collection.
settingsobject
Settings of the Data Jobs Monitoring dataflow. Only the fields provided are changed.
dd_api_key_idstring
ID of the Datadog API key the global init script uses to submit data. Setting or changing it requires dd_api_key_secret in the same request.
dd_api_key_secretstring
Secret value of the Datadog API key identified by dd_api_key_id.
djm_global_init_script_enabledboolean
Whether Datadog installs and manages the Agent on your Databricks clusters through a global init script. Installation can take up to 15 minutes and requires Databricks Workspace Admin permissions. The script does not apply to clusters in Standard access mode. Leave this false to install the Agent yourself. Defaults to false.
script_gpum_enabledboolean
Whether GPU metrics are collected from your Databricks clusters. The Agent installed by the global init script performs the collection, so this requires the dataflow to be enabled with djm_global_init_script_enabled set to true. Defaults to false.
script_logs_enabledboolean
Whether driver and worker logs are collected from your Databricks clusters. The Agent installed by the global init script performs the collection, so this requires the dataflow to be enabled with djm_global_init_script_enabled set to true. Defaults to false.
serverless_jobs_enabledboolean
Whether health and cost data is collected for jobs running on Serverless or SQL Warehouse compute. This compute has no clusters for the global init script to target, so collection reads the Databricks system tables and requires system_tables_sql_warehouse_id. Defaults to true.
databricks-data-observability-quality-monitoringobject
Data Observability, which collects lineage and data quality information from your Databricks catalogs so you can explore how data flows and detect, resolve, and prevent quality issues.
enabledboolean
Whether Datadog collects this data. Defaults to false; set to true to start collection.
settingsobject
Settings of the Data Observability dataflow. Only the fields provided are changed.
do_crawlers_cronstring
Cron expression setting how often Datadog connects to your Databricks warehouse to collect metadata. Currently, only hourly (0 * * * *) and daily (0 0 * * *) are supported. Defaults to hourly (0 * * * *).
sync_system_catalogboolean
Whether metadata from the Databricks system catalog is included in Data Observability alongside your data catalogs. Defaults to false.
databricks-model-serving-metricsobject
Health and usage metrics for your Databricks model serving endpoints. Not supported on accounts that authenticate with private_action_runner; on those accounts this dataflow collects no data.
enabledboolean
Whether Datadog collects this data. Defaults to false; set to true to start collection.
name [required]string
Human-readable name of the Databricks integration account.
settings [required]object
Settings for creating the Databricks integration account.
system_tables_sql_warehouse_idstring
ID of the SQL warehouse used to query the Databricks system tables. Find it at the end of the HTTP Path under Warehouses > Connection Details in the Databricks console. Required when the cloud cost metrics or the Data Observability dataflow is enabled, or when serverless_jobs_enabled is on; since serverless jobs are on unless explicitly disabled, omitting this field otherwise causes the request to be rejected with a 422 response.
workspace_url [required]string
URL of the Databricks workspace.
type [required]enum
The type of the integration account resource. Always integration-account.
integration-accountAllowed enum values:
integration-account{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}応答
Created
Response payload for a single Databricks integration account.
フィールド
タイプ
説明
data [required]object
Data envelope of a Databricks integration account, including server-assigned identity.
attributes [required]object
Attributes of a Databricks integration account returned in responses.
authentication<oneOf>
Authentication configured on the Databricks integration account. A bearer_token method indicates an account still on token authentication, which Databricks accepts only on accounts that already use it.
<auth_type=databricks_oauth>object
The Databricks OAuth authentication method and service principal configured on the account.
auth_type [required]enum
The authentication method type.
databricks_oauthAllowed enum values:
databricks_oauthazure_tenant_idstring
Microsoft Entra ID tenant of the service principal, for Azure Databricks workspaces.
client_id [required]string
Client ID of the Databricks service principal.
<auth_type=private_action_runner>object
The Private Action Runner authentication method configured on the account.
auth_type [required]enum
The authentication method type.
private_action_runnerAllowed enum values:
private_action_runnerconnection_id [required]uuid
Unique identifier of the Private Action Runner connection holding the credentials.
secret_pathstring
Path of the credential inside the secret backend configured on the runner.
user_uuid [required]uuid
Unique identifier of the user the Private Action Runner connection belongs to.
<auth_type=bearer_token>object
The bearer token authentication method configured on the account.
auth_type [required]enum
The authentication method type.
bearer_tokenAllowed enum values:
bearer_tokendataflowsobject
Data Datadog collects from Databricks, keyed by dataflow id.
databricks-cloud-cost-metricsobject
Cost data collected from your Databricks system tables. Requires Cloud Cost Management to be set up for your organization.
enabledboolean
Whether Datadog collects this data.
settingsobject
Settings of the Cloud Cost Management dataflow.
ccm_collect_all_workspacesboolean
Whether cost data is collected for every workspace in the Databricks account rather than this workspace only. This takes effect across the Databricks account: if any one workspace enables it, Datadog collects cost data for all of them regardless of their individual settings, and every covered workspace incurs Cloud Cost Management charges.
databricks-data-observability-jobs-monitoringobject
Data Jobs Monitoring, which collects performance, reliability, and cost data for your Databricks jobs.
enabledboolean
Whether Datadog collects this data.
settingsobject
Settings of the Data Jobs Monitoring dataflow.
dd_api_key_idstring
ID of the Datadog API key the global init script uses to submit data.
djm_global_init_script_enabledboolean
Whether Datadog installs and manages the Agent on your Databricks clusters through a global init script. The script does not apply to clusters in Standard access mode. When false, the Agent is installed manually.
script_gpum_enabledboolean
Whether GPU metrics are collected from your Databricks clusters. The Agent installed by the global init script performs the collection, so this requires the dataflow to be enabled with djm_global_init_script_enabled set to true.
script_logs_enabledboolean
Whether driver and worker logs are collected from your Databricks clusters. The Agent installed by the global init script performs the collection, so this requires the dataflow to be enabled with djm_global_init_script_enabled set to true.
serverless_jobs_enabledboolean
Whether health and cost data is collected for jobs running on Serverless or SQL Warehouse compute. This compute has no clusters for the global init script to target, so collection reads the Databricks system tables and requires system_tables_sql_warehouse_id.
databricks-data-observability-quality-monitoringobject
Data Observability, which collects lineage and data quality information from your Databricks catalogs so you can explore how data flows and detect, resolve, and prevent quality issues.
enabledboolean
Whether Datadog collects this data.
settingsobject
Settings of the Data Observability dataflow.
do_crawlers_cronstring
Cron expression setting how often Datadog connects to your Databricks warehouse to collect metadata. Currently, only hourly (0 * * * *) and daily (0 0 * * *) are supported.
sync_system_catalogboolean
Whether metadata from the Databricks system catalog is included in Data Observability alongside your data catalogs.
databricks-model-serving-metricsobject
Health and usage metrics for your Databricks model serving endpoints. Not supported on accounts that authenticate with private_action_runner; on those accounts this dataflow collects no data.
enabledboolean
Whether Datadog collects this data.
name [required]string
Human-readable name of the Databricks integration account.
settings [required]object
Settings configured on the Databricks integration account.
system_tables_sql_warehouse_idstring
ID of the SQL warehouse used to query the Databricks system tables.
workspace_url [required]string
URL of the Databricks workspace.
id [required]string
Server-generated unique identifier of the Databricks integration account.
type [required]enum
The type of the integration account resource. Always integration-account.
integration-accountAllowed enum values:
integration-account{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"id": "a9a69c2e-4f8d-4e42-9c1a-2a7a2d3b7c6f",
"type": "integration-account"
}
}Bad Request
API error response.
フィールド
タイプ
説明
errors [required][string]
A list of errors.
{
"errors": [
"Bad Request"
]
}Forbidden
API error response.
フィールド
タイプ
説明
errors [required][string]
A list of errors.
{
"errors": [
"Bad Request"
]
}Not Found
API error response.
フィールド
タイプ
説明
errors [required][string]
A list of errors.
{
"errors": [
"Bad Request"
]
}The server cannot process the request because it contains invalid data.
API error response.
フィールド
タイプ
説明
errors [required][object]
A list of errors.
detailstring
A human-readable explanation specific to this occurrence of the error.
metaobject
Non-standard meta-information about the error
sourceobject
References to the source of the error.
headerstring
A string indicating the name of a single request header which caused the error.
parameterstring
A string indicating which URI query parameter caused the error.
pointerstring
A JSON pointer to the value in the request document that caused the error.
statusstring
Status code of the response.
titlestring
Short human-readable summary of the error.
{
"errors": [
{
"detail": "Missing required attribute in body",
"meta": {},
"source": {
"header": "Authorization",
"parameter": "limit",
"pointer": "/data/attributes/title"
},
"status": "400",
"title": "Bad Request"
}
]
}Too many requests
API error response.
フィールド
タイプ
説明
errors [required][string]
A list of errors.
{
"errors": [
"Bad Request"
]
}コード例
# Set your Datadog site and credentials
export DD_SITE="datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="us3.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="us5.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="datadoghq.eu"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="ap1.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="ap2.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="uk1.datadoghq.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="ddog-gov.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF# Set your Datadog site and credentials
export DD_SITE="us2.ddog-gov.com"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"
curl -X POST "https://api.${DD_SITE}/api/v2/integration-interfaces/databricks/accounts" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}" \
-d @- << EOF
{
"data": {
"attributes": {
"authentication": {
"auth_type": "databricks_oauth",
"azure_tenant_id": "4d3bac44-0230-4732-9e70-cc00736f0a97",
"client_id": "5c10654a-b3a3-4840-b37f-f477590c70a0",
"client_secret": "your-client-secret"
},
"dataflows": {
"databricks-cloud-cost-metrics": {
"enabled": true,
"settings": {
"ccm_collect_all_workspaces": true
}
},
"databricks-data-observability-jobs-monitoring": {
"enabled": true,
"settings": {
"dd_api_key_id": "fe383f4e-09fc-46bf-8e10-4efdd453a646",
"dd_api_key_secret": "your-datadog-api-key",
"djm_global_init_script_enabled": true,
"script_gpum_enabled": true,
"script_logs_enabled": true,
"serverless_jobs_enabled": true
}
},
"databricks-data-observability-quality-monitoring": {
"enabled": true,
"settings": {
"do_crawlers_cron": "0 * * * *",
"sync_system_catalog": true
}
},
"databricks-model-serving-metrics": {
"enabled": true
}
},
"name": "My Databricks Workspace",
"settings": {
"system_tables_sql_warehouse_id": "aba7c023d4172910",
"workspace_url": "https://dbc-1234abcd.cloud.databricks.com"
}
},
"type": "integration-account"
}
}
EOF// Create a Databricks integration account returns "Created" response
package main
import (
"context"
"encoding/json"
"fmt"
"os"
"github.com/DataDog/datadog-api-client-go/v2/api/datadog"
"github.com/DataDog/datadog-api-client-go/v2/api/datadogV2"
)
func main() {
body := datadogV2.DatabricksIntegrationAccountCreateRequest{
Data: datadogV2.DatabricksIntegrationAccountCreateData{
Attributes: datadogV2.DatabricksIntegrationAccountCreateAttributes{
Authentication: datadogV2.DatabricksIntegrationAccountAuthenticationRequest{
DatabricksIntegrationAccountOAuthAuthRequest: &datadogV2.DatabricksIntegrationAccountOAuthAuthRequest{
AuthType: datadogV2.DATABRICKSINTEGRATIONACCOUNTOAUTHAUTHTYPE_DATABRICKS_OAUTH,
AzureTenantId: datadog.PtrString("4d3bac44-0230-4732-9e70-cc00736f0a97"),
ClientId: "5c10654a-b3a3-4840-b37f-f477590c70a0",
ClientSecret: "your-client-secret",
}},
Dataflows: &datadogV2.DatabricksIntegrationDataflowsRequest{
DatabricksCloudCostMetrics: &datadogV2.DatabricksCloudCostMetricsIntegrationDataflowRequest{
Enabled: datadog.PtrBool(true),
Settings: &datadogV2.DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest{
CcmCollectAllWorkspaces: datadog.PtrBool(true),
},
},
DatabricksDataObservabilityJobsMonitoring: &datadogV2.DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest{
Enabled: datadog.PtrBool(true),
Settings: &datadogV2.DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest{
DdApiKeyId: datadog.PtrString("fe383f4e-09fc-46bf-8e10-4efdd453a646"),
DdApiKeySecret: datadog.PtrString("your-datadog-api-key"),
DjmGlobalInitScriptEnabled: datadog.PtrBool(true),
ScriptGpumEnabled: datadog.PtrBool(true),
ScriptLogsEnabled: datadog.PtrBool(true),
ServerlessJobsEnabled: datadog.PtrBool(true),
},
},
DatabricksDataObservabilityQualityMonitoring: &datadogV2.DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest{
Enabled: datadog.PtrBool(true),
Settings: &datadogV2.DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest{
DoCrawlersCron: datadog.PtrString("0 * * * *"),
SyncSystemCatalog: datadog.PtrBool(true),
},
},
DatabricksModelServingMetrics: &datadogV2.DatabricksModelServingMetricsIntegrationDataflowRequest{
Enabled: datadog.PtrBool(true),
},
},
Name: "My Databricks Workspace",
Settings: datadogV2.DatabricksIntegrationAccountSettingsRequest{
SystemTablesSqlWarehouseId: datadog.PtrString("aba7c023d4172910"),
WorkspaceUrl: "https://dbc-1234abcd.cloud.databricks.com",
},
},
Type: datadogV2.INTEGRATIONACCOUNTTYPE_INTEGRATION_ACCOUNT,
},
}
ctx := datadog.NewDefaultContext(context.Background())
ctx = context.WithValue(ctx, datadog.ContextAccessToken, os.Getenv("DD_BEARER_TOKEN"))
configuration := datadog.NewConfiguration()
configuration.SetUnstableOperationEnabled("v2.CreateDatabricksIntegrationAccount", true)
apiClient := datadog.NewAPIClient(configuration)
api := datadogV2.NewDatabricksIntegrationApi(apiClient)
resp, r, err := api.CreateDatabricksIntegrationAccount(ctx, body)
if err != nil {
fmt.Fprintf(os.Stderr, "Error when calling `DatabricksIntegrationApi.CreateDatabricksIntegrationAccount`: %v\n", err)
fmt.Fprintf(os.Stderr, "Full HTTP response: %v\n", r)
}
responseContent, _ := json.MarshalIndent(resp, "", " ")
fmt.Fprintf(os.Stdout, "Response from `DatabricksIntegrationApi.CreateDatabricksIntegrationAccount`:\n%s\n", responseContent)
}
Instructions
First install the library and its dependencies and then save the example to main.go and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" go run "main.go"// Create a Databricks integration account returns "Created" response
import com.datadog.api.client.ApiClient;
import com.datadog.api.client.ApiException;
import com.datadog.api.client.v2.api.DatabricksIntegrationApi;
import com.datadog.api.client.v2.model.DatabricksCloudCostMetricsIntegrationDataflowRequest;
import com.datadog.api.client.v2.model.DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest;
import com.datadog.api.client.v2.model.DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest;
import com.datadog.api.client.v2.model.DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest;
import com.datadog.api.client.v2.model.DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest;
import com.datadog.api.client.v2.model.DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountAuthenticationRequest;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountCreateAttributes;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountCreateData;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountCreateRequest;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountOAuthAuthRequest;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountOAuthAuthType;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountResponse;
import com.datadog.api.client.v2.model.DatabricksIntegrationAccountSettingsRequest;
import com.datadog.api.client.v2.model.DatabricksIntegrationDataflowsRequest;
import com.datadog.api.client.v2.model.DatabricksModelServingMetricsIntegrationDataflowRequest;
import com.datadog.api.client.v2.model.IntegrationAccountType;
public class Example {
public static void main(String[] args) {
ApiClient defaultClient = ApiClient.getDefaultApiClient();
defaultClient.setAccessToken(System.getenv("DD_BEARER_TOKEN"));
defaultClient.setUnstableOperationEnabled("v2.createDatabricksIntegrationAccount", true);
DatabricksIntegrationApi apiInstance = new DatabricksIntegrationApi(defaultClient);
DatabricksIntegrationAccountCreateRequest body =
new DatabricksIntegrationAccountCreateRequest()
.data(
new DatabricksIntegrationAccountCreateData()
.attributes(
new DatabricksIntegrationAccountCreateAttributes()
.authentication(
new DatabricksIntegrationAccountAuthenticationRequest(
new DatabricksIntegrationAccountOAuthAuthRequest()
.authType(
DatabricksIntegrationAccountOAuthAuthType
.DATABRICKS_OAUTH)
.azureTenantId("4d3bac44-0230-4732-9e70-cc00736f0a97")
.clientId("5c10654a-b3a3-4840-b37f-f477590c70a0")
.clientSecret("your-client-secret")))
.dataflows(
new DatabricksIntegrationDataflowsRequest()
.databricksCloudCostMetrics(
new DatabricksCloudCostMetricsIntegrationDataflowRequest()
.enabled(true)
.settings(
new DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest()
.ccmCollectAllWorkspaces(true)))
.databricksDataObservabilityJobsMonitoring(
new DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest()
.enabled(true)
.settings(
new DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest()
.ddApiKeyId(
"fe383f4e-09fc-46bf-8e10-4efdd453a646")
.ddApiKeySecret("your-datadog-api-key")
.djmGlobalInitScriptEnabled(true)
.scriptGpumEnabled(true)
.scriptLogsEnabled(true)
.serverlessJobsEnabled(true)))
.databricksDataObservabilityQualityMonitoring(
new DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest()
.enabled(true)
.settings(
new DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest()
.doCrawlersCron("0 * * * *")
.syncSystemCatalog(true)))
.databricksModelServingMetrics(
new DatabricksModelServingMetricsIntegrationDataflowRequest()
.enabled(true)))
.name("My Databricks Workspace")
.settings(
new DatabricksIntegrationAccountSettingsRequest()
.systemTablesSqlWarehouseId("aba7c023d4172910")
.workspaceUrl("https://dbc-1234abcd.cloud.databricks.com")))
.type(IntegrationAccountType.INTEGRATION_ACCOUNT));
try {
DatabricksIntegrationAccountResponse result =
apiInstance.createDatabricksIntegrationAccount(body);
System.out.println(result);
} catch (ApiException e) {
System.err.println(
"Exception when calling DatabricksIntegrationApi#createDatabricksIntegrationAccount");
System.err.println("Status code: " + e.getCode());
System.err.println("Reason: " + e.getResponseBody());
System.err.println("Response headers: " + e.getResponseHeaders());
e.printStackTrace();
}
}
}
Instructions
First install the library and its dependencies and then save the example to Example.java and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" java "Example.java""""
Create a Databricks integration account returns "Created" response
"""
from os import environ
from datadog_api_client import ApiClient, Configuration
from datadog_api_client.v2.api.databricks_integration_api import DatabricksIntegrationApi
from datadog_api_client.v2.model.databricks_cloud_cost_metrics_integration_dataflow_request import (
DatabricksCloudCostMetricsIntegrationDataflowRequest,
)
from datadog_api_client.v2.model.databricks_cloud_cost_metrics_integration_dataflow_settings_request import (
DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest,
)
from datadog_api_client.v2.model.databricks_data_observability_jobs_monitoring_integration_dataflow_request import (
DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest,
)
from datadog_api_client.v2.model.databricks_data_observability_jobs_monitoring_integration_dataflow_settings_request import (
DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest,
)
from datadog_api_client.v2.model.databricks_data_observability_quality_monitoring_integration_dataflow_request import (
DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest,
)
from datadog_api_client.v2.model.databricks_data_observability_quality_monitoring_integration_dataflow_settings_request import (
DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest,
)
from datadog_api_client.v2.model.databricks_integration_account_create_attributes import (
DatabricksIntegrationAccountCreateAttributes,
)
from datadog_api_client.v2.model.databricks_integration_account_create_data import (
DatabricksIntegrationAccountCreateData,
)
from datadog_api_client.v2.model.databricks_integration_account_create_request import (
DatabricksIntegrationAccountCreateRequest,
)
from datadog_api_client.v2.model.databricks_integration_account_o_auth_auth_request import (
DatabricksIntegrationAccountOAuthAuthRequest,
)
from datadog_api_client.v2.model.databricks_integration_account_o_auth_auth_type import (
DatabricksIntegrationAccountOAuthAuthType,
)
from datadog_api_client.v2.model.databricks_integration_account_settings_request import (
DatabricksIntegrationAccountSettingsRequest,
)
from datadog_api_client.v2.model.databricks_integration_dataflows_request import DatabricksIntegrationDataflowsRequest
from datadog_api_client.v2.model.databricks_model_serving_metrics_integration_dataflow_request import (
DatabricksModelServingMetricsIntegrationDataflowRequest,
)
from datadog_api_client.v2.model.integration_account_type import IntegrationAccountType
body = DatabricksIntegrationAccountCreateRequest(
data=DatabricksIntegrationAccountCreateData(
attributes=DatabricksIntegrationAccountCreateAttributes(
authentication=DatabricksIntegrationAccountOAuthAuthRequest(
auth_type=DatabricksIntegrationAccountOAuthAuthType.DATABRICKS_OAUTH,
azure_tenant_id="4d3bac44-0230-4732-9e70-cc00736f0a97",
client_id="5c10654a-b3a3-4840-b37f-f477590c70a0",
client_secret="your-client-secret",
),
dataflows=DatabricksIntegrationDataflowsRequest(
databricks_cloud_cost_metrics=DatabricksCloudCostMetricsIntegrationDataflowRequest(
enabled=True,
settings=DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest(
ccm_collect_all_workspaces=True,
),
),
databricks_data_observability_jobs_monitoring=DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest(
enabled=True,
settings=DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest(
dd_api_key_id="fe383f4e-09fc-46bf-8e10-4efdd453a646",
dd_api_key_secret="your-datadog-api-key",
djm_global_init_script_enabled=True,
script_gpum_enabled=True,
script_logs_enabled=True,
serverless_jobs_enabled=True,
),
),
databricks_data_observability_quality_monitoring=DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest(
enabled=True,
settings=DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest(
do_crawlers_cron="0 * * * *",
sync_system_catalog=True,
),
),
databricks_model_serving_metrics=DatabricksModelServingMetricsIntegrationDataflowRequest(
enabled=True,
),
),
name="My Databricks Workspace",
settings=DatabricksIntegrationAccountSettingsRequest(
system_tables_sql_warehouse_id="aba7c023d4172910",
workspace_url="https://dbc-1234abcd.cloud.databricks.com",
),
),
type=IntegrationAccountType.INTEGRATION_ACCOUNT,
),
)
configuration = Configuration()
configuration.access_token = environ["DD_BEARER_TOKEN"]
configuration.unstable_operations["create_databricks_integration_account"] = True
with ApiClient(configuration) as api_client:
api_instance = DatabricksIntegrationApi(api_client)
response = api_instance.create_databricks_integration_account(body=body)
print(response)
Instructions
First install the library and its dependencies and then save the example to example.py and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" python3 "example.py"# Create a Databricks integration account returns "Created" response
require "datadog_api_client"
DatadogAPIClient.configure do |config|
config.access_token = ENV["DD_BEARER_TOKEN"]
config.unstable_operations["v2.create_databricks_integration_account".to_sym] = true
end
api_instance = DatadogAPIClient::V2::DatabricksIntegrationAPI.new
body = DatadogAPIClient::V2::DatabricksIntegrationAccountCreateRequest.new({
data: DatadogAPIClient::V2::DatabricksIntegrationAccountCreateData.new({
attributes: DatadogAPIClient::V2::DatabricksIntegrationAccountCreateAttributes.new({
authentication: DatadogAPIClient::V2::DatabricksIntegrationAccountOAuthAuthRequest.new({
auth_type: DatadogAPIClient::V2::DatabricksIntegrationAccountOAuthAuthType::DATABRICKS_OAUTH,
azure_tenant_id: "4d3bac44-0230-4732-9e70-cc00736f0a97",
client_id: "5c10654a-b3a3-4840-b37f-f477590c70a0",
client_secret: "your-client-secret",
}),
dataflows: DatadogAPIClient::V2::DatabricksIntegrationDataflowsRequest.new({
databricks_cloud_cost_metrics: DatadogAPIClient::V2::DatabricksCloudCostMetricsIntegrationDataflowRequest.new({
enabled: true,
settings: DatadogAPIClient::V2::DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest.new({
ccm_collect_all_workspaces: true,
}),
}),
databricks_data_observability_jobs_monitoring: DatadogAPIClient::V2::DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest.new({
enabled: true,
settings: DatadogAPIClient::V2::DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest.new({
dd_api_key_id: "fe383f4e-09fc-46bf-8e10-4efdd453a646",
dd_api_key_secret: "your-datadog-api-key",
djm_global_init_script_enabled: true,
script_gpum_enabled: true,
script_logs_enabled: true,
serverless_jobs_enabled: true,
}),
}),
databricks_data_observability_quality_monitoring: DatadogAPIClient::V2::DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest.new({
enabled: true,
settings: DatadogAPIClient::V2::DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest.new({
do_crawlers_cron: "0 * * * *",
sync_system_catalog: true,
}),
}),
databricks_model_serving_metrics: DatadogAPIClient::V2::DatabricksModelServingMetricsIntegrationDataflowRequest.new({
enabled: true,
}),
}),
name: "My Databricks Workspace",
settings: DatadogAPIClient::V2::DatabricksIntegrationAccountSettingsRequest.new({
system_tables_sql_warehouse_id: "aba7c023d4172910",
workspace_url: "https://dbc-1234abcd.cloud.databricks.com",
}),
}),
type: DatadogAPIClient::V2::IntegrationAccountType::INTEGRATION_ACCOUNT,
}),
})
p api_instance.create_databricks_integration_account(body)
Instructions
First install the library and its dependencies and then save the example to example.rb and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" rb "example.rb"// Create a Databricks integration account returns "Created" response
use datadog_api_client::datadog;
use datadog_api_client::datadogV2::api_databricks_integration::DatabricksIntegrationAPI;
use datadog_api_client::datadogV2::model::DatabricksCloudCostMetricsIntegrationDataflowRequest;
use datadog_api_client::datadogV2::model::DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest;
use datadog_api_client::datadogV2::model::DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest;
use datadog_api_client::datadogV2::model::DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest;
use datadog_api_client::datadogV2::model::DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest;
use datadog_api_client::datadogV2::model::DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountAuthenticationRequest;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountCreateAttributes;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountCreateData;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountCreateRequest;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountOAuthAuthRequest;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountOAuthAuthType;
use datadog_api_client::datadogV2::model::DatabricksIntegrationAccountSettingsRequest;
use datadog_api_client::datadogV2::model::DatabricksIntegrationDataflowsRequest;
use datadog_api_client::datadogV2::model::DatabricksModelServingMetricsIntegrationDataflowRequest;
use datadog_api_client::datadogV2::model::IntegrationAccountType;
#[tokio::main]
async fn main() {
let body =
DatabricksIntegrationAccountCreateRequest::new(
DatabricksIntegrationAccountCreateData::new(
DatabricksIntegrationAccountCreateAttributes::new(
DatabricksIntegrationAccountAuthenticationRequest::DatabricksIntegrationAccountOAuthAuthRequest(
Box::new(
DatabricksIntegrationAccountOAuthAuthRequest::new(
DatabricksIntegrationAccountOAuthAuthType::DATABRICKS_OAUTH,
"5c10654a-b3a3-4840-b37f-f477590c70a0".to_string(),
"your-client-secret".to_string(),
).azure_tenant_id("4d3bac44-0230-4732-9e70-cc00736f0a97".to_string()),
),
),
"My Databricks Workspace".to_string(),
DatabricksIntegrationAccountSettingsRequest::new(
"https://dbc-1234abcd.cloud.databricks.com".to_string(),
).system_tables_sql_warehouse_id("aba7c023d4172910".to_string()),
).dataflows(
DatabricksIntegrationDataflowsRequest::new()
.databricks_cloud_cost_metrics(
DatabricksCloudCostMetricsIntegrationDataflowRequest::new()
.enabled(true)
.settings(
DatabricksCloudCostMetricsIntegrationDataflowSettingsRequest
::new().ccm_collect_all_workspaces(true),
),
)
.databricks_data_observability_jobs_monitoring(
DatabricksDataObservabilityJobsMonitoringIntegrationDataflowRequest::new()
.enabled(true)
.settings(
DatabricksDataObservabilityJobsMonitoringIntegrationDataflowSettingsRequest::new()
.dd_api_key_id("fe383f4e-09fc-46bf-8e10-4efdd453a646".to_string())
.dd_api_key_secret("your-datadog-api-key".to_string())
.djm_global_init_script_enabled(true)
.script_gpum_enabled(true)
.script_logs_enabled(true)
.serverless_jobs_enabled(true),
),
)
.databricks_data_observability_quality_monitoring(
DatabricksDataObservabilityQualityMonitoringIntegrationDataflowRequest::new()
.enabled(true)
.settings(
DatabricksDataObservabilityQualityMonitoringIntegrationDataflowSettingsRequest
::new()
.do_crawlers_cron("0 * * * *".to_string())
.sync_system_catalog(true),
),
)
.databricks_model_serving_metrics(
DatabricksModelServingMetricsIntegrationDataflowRequest::new().enabled(true),
),
),
IntegrationAccountType::INTEGRATION_ACCOUNT,
),
);
let mut configuration = datadog::Configuration::new();
configuration.set_unstable_operation_enabled("v2.create_databricks_integration_account", true);
let api = DatabricksIntegrationAPI::with_config(configuration);
let resp = api.create_databricks_integration_account(body).await;
if let Ok(value) = resp {
println!("{:#?}", value);
} else {
println!("{:#?}", resp.unwrap_err());
}
}
Instructions
First install the library and its dependencies and then save the example to src/main.rs and run following commands:
DD_SITE="datadoghq.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="us3.datadoghq.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="us5.datadoghq.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="datadoghq.eu" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="ap1.datadoghq.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="ap2.datadoghq.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="uk1.datadoghq.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="ddog-gov.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo runDD_SITE="us2.ddog-gov.com" DD_API_KEY="<API-KEY>" DD_APP_KEY="<APP-KEY>" cargo run/**
* Create a Databricks integration account returns "Created" response
*/
import { client, v2 } from "@datadog/datadog-api-client";
const configuration = client.createConfiguration({
authMethods: {
AuthZ: {
accessToken: process.env.DD_BEARER_TOKEN as string,
},
},
});
configuration.unstableOperations["v2.createDatabricksIntegrationAccount"] =
true;
const apiInstance = new v2.DatabricksIntegrationApi(configuration);
const params: v2.DatabricksIntegrationApiCreateDatabricksIntegrationAccountRequest =
{
body: {
data: {
attributes: {
authentication: {
authType: "databricks_oauth",
azureTenantId: "4d3bac44-0230-4732-9e70-cc00736f0a97",
clientId: "5c10654a-b3a3-4840-b37f-f477590c70a0",
clientSecret: "your-client-secret",
},
dataflows: {
databricksCloudCostMetrics: {
enabled: true,
settings: {
ccmCollectAllWorkspaces: true,
},
},
databricksDataObservabilityJobsMonitoring: {
enabled: true,
settings: {
ddApiKeyId: "fe383f4e-09fc-46bf-8e10-4efdd453a646",
ddApiKeySecret: "your-datadog-api-key",
djmGlobalInitScriptEnabled: true,
scriptGpumEnabled: true,
scriptLogsEnabled: true,
serverlessJobsEnabled: true,
},
},
databricksDataObservabilityQualityMonitoring: {
enabled: true,
settings: {
doCrawlersCron: "0 * * * *",
syncSystemCatalog: true,
},
},
databricksModelServingMetrics: {
enabled: true,
},
},
name: "My Databricks Workspace",
settings: {
systemTablesSqlWarehouseId: "aba7c023d4172910",
workspaceUrl: "https://dbc-1234abcd.cloud.databricks.com",
},
},
type: "integration-account",
},
},
};
apiInstance
.createDatabricksIntegrationAccount(params)
.then((data: v2.DatabricksIntegrationAccountResponse) => {
console.log(
"API called successfully. Returned data: " + JSON.stringify(data)
);
})
.catch((error: any) => console.error(error));
Instructions
First install the library and its dependencies and then save the example to example.ts and run following commands:
DD_SITE="datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="us3.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="us5.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="datadoghq.eu" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="ap1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="ap2.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="uk1.datadoghq.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"DD_SITE="us2.ddog-gov.com" DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>" tsc "example.ts"