Start here. This is the direct spoken answer to practice first.
Overview
An AI response often crosses enough components that a final log line cannot explain its behavior.
I create one trace for the user operation with spans for application routing, model calls, retrieval, tools, validation, retries, and fallback. Each span records timing, outcome, relevant version identifiers, and correlation to the parent request. Together, the spans explain which path ran and where time or quality was lost without requiring raw sensitive prompts in every telemetry system.