GILD analysis
Datadog Agent Observability Review
Choose Datadog Agent Observability, renamed from LLM Observability in 2026, when your operators work in Datadog and want agent traces under the same trace ID as APM, as Handshake runs it beside Arize AX. It bills only model calls, from US$160 a month for 100,000 LLM spans billed annually, with 40,000 free (Datadog pricing, Oct 28, 2026). Source.ag found duplicate spans overcounting its spend about 2.2 times in June 2026, so check span counts and token totals on your own stack.
- AI Observability
- AI Costs
The decision
- Best fit
- Teams already running Datadog APM that want LLM and agent traces, cost, and evaluations beside service and user data, priced by model call.
- Consider another workflow
- If AI engineers need their own evaluation workspace or a tracer they host, evaluate Arize or Langfuse. If evals gate every release and product teams review them, evaluate Braintrust.
- Adoption condition
- Count LLM spans per agent run on a week of real traffic and match token totals against your model bills. Search under both names: Datadog renamed LLM Observability to Agent Observability, and setup still uses llm_observability URLs and DD_LLMOBS settings.