https://nicolevanderhoeven.com/tags/genai/Recent content in Genai on Nicole van der HoevenHugo -- gohugo.ioen-usNicole van der HoevenWed, 21 Jan 2026 16:00:00 +0100https://nicolevanderhoeven.com/blog/20260121-gocc04-observability-for-genai-applications/Wed, 21 Jan 2026 16:00:00 +0100https://nicolevanderhoeven.com/blog/20260121-gocc04-observability-for-genai-applications/<p>In this community call with my coworker Liudmila Molkova, we dove into the emerging field of observability for Generative AI applications. We explored how to instrument LLM-powered applications using OpenTelemetry, what metrics and traces matter most when monitoring AI workloads, and how to debug issues in complex AI pipelines. The discussion covered prompt tracing, token usage monitoring, latency considerations, and the unique challenges of observing non-deterministic AI systems.</p> <div style="position: relative; padding-bottom: 56.25%; height: 0; overflow: hidden;"> <iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share; fullscreen" loading="eager" referrerpolicy="strict-origin-when-cross-origin" src="https://www.youtube.com/embed/LfDVygRWQJU?autoplay=0&amp;controls=1&amp;end=0&amp;loop=0&amp;mute=0&amp;start=0" style="position: absolute; top: 0; left: 0; width: 100%; height: 100%; border:0;" title="YouTube video"></iframe> </div>