Skip to main content

Datadog

Availability
Available CoreAvailable StandardAvailable PlusAvailable ProAvailable Enterprise FlexAvailable PyAirbyte
Support Level
Marketplace
Connector Version
2.0.24 (last updated 10 months ago)
Sync Success Rate
Low
Usage Rate
High
Data workers used
0.2 per sync (Learn more)
Definition ID
1cfc30c7-82db-43f4-9fd7-ac1b42312cda

This is a setup guide for the Datadog source connector which collects data from its API.

Prerequisites​

An API key is required as well as an API application key. See the Datadog API and Application Keys section for more information.

Setup guide​

Step 1: Set up the Datadog connector in Airbyte​

For Airbyte Cloud:​

  1. Log into your Airbyte Cloud account.
  2. In the left navigation bar, click Sources. In the top-right corner, click +new source.
  3. On the Set up the source page, enter the name for the Datadog connector and select Datadog from the Source type dropdown.
  4. Enter your api_key - Datadog API key.
  5. Enter your application_key - Datadog application key.
  6. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
  7. Enter your limit - Number of records to collect per request.
  8. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
  9. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
  10. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Optional. Query Name.
    2. Select the data_source from dropdown - Optional. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Optional. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
  11. Click Set up source.

For Airbyte OSS:​

  1. Navigate to the Airbyte Open Source dashboard.
  2. Set the name for your source.
  3. Enter your api_key - Datadog API key.
  4. Enter your application_key - Datadog application key.
  5. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
  6. Enter your limit - Number of records to collect per request.
  7. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
  8. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
  9. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Required. Query Name.
    2. Select the data_source - Required. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Required. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
  10. Click Set up source.

Supported sync modes​

The Datadog source connector supports the following sync modes:

FeatureSupported?
Full Refresh SyncYes
Incremental SyncYes
SSL connectionYes
NamespacesNo

Supported Streams​

IP allow list​

If you use Airbyte Cloud and your organization restricts access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.

Reference​

Config fields reference

Field
Type
Property name
string
api_key
string
application_key
string
end_date
integer
max_records_per_request
array<object>
queries
string
query
string
site
string
start_date

Changelog​

Expand to review
VersionDatePull RequestSubject
2.0.242025-05-2460420Update dependencies
2.0.232025-05-1059399Update dependencies
2.0.222025-04-2658888Update dependencies
2.0.212025-04-1958342Update dependencies
2.0.202025-04-1257776Update dependencies
2.0.192025-04-0557246Update dependencies
2.0.182025-03-2956528Update dependencies
2.0.172025-03-2554206remove default end date value
2.0.162025-03-2255994Update dependencies
2.0.152025-03-0855280Update dependencies
2.0.142025-03-0154921Update dependencies
2.0.132025-02-2254444Update dependencies
2.0.122025-02-2054180🐛 Source Datadog : Fix the Pagination in the logs stream
2.0.112025-02-1553705Update dependencies
2.0.102025-02-0853382Update dependencies
2.0.92025-02-0152866Update dependencies
2.0.82025-01-2552350Update dependencies
2.0.72025-01-1851677Update dependencies
2.0.62024-01-1648537Update default start and end dates for logs stream, if they are not configured as default
2.0.52025-01-1151122Update dependencies
2.0.42024-12-2850567Update dependencies
2.0.32024-12-2149988Update dependencies
2.0.22024-12-1449472Update dependencies
2.0.12024-12-1248300Update dependencies
2.0.02024-12-0648833Remove is_read_only parameter from dashboards stream schema
1.1.12024-10-2846502Update dependencies
1.1.02023-10-0446387Migrate to manifest only
1.0.62024-09-2846190Update dependencies
1.0.52024-09-2145771Update dependencies
1.0.42024-09-1445581Update dependencies
1.0.32024-09-0745297Update dependencies
1.0.22024-08-3144992Update dependencies
1.0.12024-08-2444706Update dependencies
1.0.02024-08-1944371Update CDK version and dependencies, remove parameters and migrate to inline schemas
0.4.152024-08-1744313Update dependencies
0.4.142024-08-1243741Update dependencies
0.4.132024-08-1043555Update dependencies
0.4.122024-08-0343141Update dependencies
0.4.112024-07-2742776Update dependencies
0.4.102024-07-2042341Update dependencies
0.4.92024-07-1341783Update dependencies
0.4.82024-07-1041416Update dependencies
0.4.72024-07-0941168Update dependencies
0.4.62024-07-0640985Update dependencies
0.4.52024-06-2540306Update dependencies
0.4.42024-06-2240063Update dependencies
0.4.32024-06-1337590Change last_records to last_record
0.4.22024-06-0439060[autopull] Upgrade base image to v1.2.1
0.4.12024-05-2038424[autopull] base image + poetry + up_to_date
0.4.02023-12-0430999Add monitors and service_level_objectives Streams
0.3.02023-08-2729885Migrate to low code
0.2.22023-07-1028089Additional stream and query details in response
0.2.12023-06-2826534Support multiple query streams and pulling data from different datadog sites
0.2.02023-06-2827784Add necessary fields to schemas
0.1.12023-04-2725562Update testing dependencies
0.1.02022-10-1818150New Source: Datadog
Was this page helpful?