#observability
11 posts
-
Missing Token Counts on Streamed LLM Calls (and Why Your Spend Total Reads Low)
A streamed response reports its token usage in one final payload. When that payload never arrives, the call is recorded with no tokens and prices at zero, so it drops out of every spend total while still counting as a call.
-
Cursor OpenTelemetry Export: What Ships Today, and What You Get Without Enterprise
Cursor now streams OTLP metrics and logs to a collector you run. The exact wire, the six things it will not send, and what the other plans can actually export.
-
Instrument Your AI Agent, Then Find Where the Money Goes
Patch your provider client in one line so the TokenJam SDK captures every LLM call to a local, on-disk trace, then run local analyzers that turn those traces into priced savings across your self-built agent.
-
Why Subagent Token Counts Are Wrong (and How to Fix Them)
Popular usage tools miscount subagent tokens by replaying the parent thread for each one, and here is how to reconstruct accurate per-subagent attribution from the raw JSONL.
-
Reddit is 40% of your agent's retrieval surface
What 150K LLM citations tell builders about prompt-time grounding, eval coverage, and the source biases their agents inherit by default.
-
Claude Code OTel: What the Wire Emits and What /cost Hides
Claude Code emits OTel metrics and events; traces are still beta behind their own flag. What the wire carries per call, and the failure shapes /cost hides.
-
LangSmith Cost in 2026: Real TCO vs Self-Hosted Alternatives
LangSmith's $39/seat sticker runs ~10.7x that in real TCO. A sourced teardown vs Langfuse self-host and a local-first DuckDB alternative, with real numbers and config.
-
How to Monitor Claude Code with OTel (Before a $1,700 Bill)
Monitor Claude Code on your laptop in 5 steps: enable Anthropic's OTel telemetry, store spans locally, and alert on retry loops while the agent still runs.
-
AI Agent Drift Detection: How to Spot It in Your Own Sessions
Catch agent drift with no embedding model and no labelled dataset. What to measure over your own session history, and which signals are worth alerting on.
-
What is OpenTelemetry, and why does it matter for AI agents?
OpenTelemetry, OTLP, and the GenAI semantic conventions: how the CNCF observability standard is becoming the lingua franca for AI agent telemetry.
-
What is agent observability?
How AI agent observability works: capturing tool calls, token costs, traces, and behavioral patterns at production scale.