Datadog Integrations: AI/ML

Table of Contents

Overview

AI and machine-learning platforms, model servers, and LLM providers. These integrations collect inference throughput, token usage, latency, and cost metrics.

Supported Integrations

Integration Supported OS Min Agent Data Streams Source

Anthropic Usage and Costs

Linux, Windows, macOS

7.69.0

Metrics

anthropic_usage_and_costs

BentoML

Linux, Windows, macOS

7.70.1

Metrics, Logs

bentoml

Hugging Face TGI

Linux, Windows, macOS

7.70.1

Metrics, Logs

hugging_face_tgi

LangChain

Linux, Windows, macOS

7.47.0

Metrics

langchain

Microsoft Copilot

Any

—

Metrics, Logs

microsoft_copilot

Milvus

Linux, Windows, macOS

7.62.0

Metrics, Logs

milvus

Nvidia DCGM Exporter

Linux, Windows, macOS

7.47.0

Metrics

dcgm

Nvidia NIM

Linux, Windows, macOS

7.61.0

Metrics, Logs

nvidia_nim

Nvidia Triton

Linux, Windows, macOS

7.50.0

Metrics, Logs

nvidia_triton

OpenAI

Linux, Windows, macOS

—

Metrics

openai

Ray

Linux, Windows, macOS

7.48.0

Metrics, Logs

ray

TorchServe

Linux, Windows, macOS

7.47.0

Metrics, Logs

torchserve

vLLM

Linux, Windows, macOS

7.56.0

Metrics, Logs

vllm