Latitude connects traces, semantic failure discovery, human annotations, evaluations, and regression tests, but teams still need representative traffic, calibrated labels, and careful telemetry controls.
Direct verdict
Latitude earns a shortlist for AI teams that want open-source observability organized around recurring agent failures instead of isolated traces. Pilot its signal discovery against a labeled failure set, calibrate monitors with reviewers, and establish redaction and retention before broad ingestion.
What to verify
Instrument one consequential agent with redacted telemetry and seed 100 known failures across tool errors, refusals, hallucinations, jailbreaks, memory drift, and incomplete tasks. Compare discovered behaviors with human labels; measure trace completeness, cluster precision, missed cases, alert noise, regression reproducibility, query latency, storage growth, and credits per session.