Houston, We Have a Hallucination [ukr]
Launching a Diia AI Against All Odds
What does it take to build a conversational AI assistant for millions of citizens? The journey of creating Diia.AI, Ukraine's national digital assistant, started with a simple, promising Proof of Concept. But moving from a controlled demo to a live, production system that handles sensitive data and real-life services was a journey filled with unexpected turbulence.
This talk is an honest, behind-the-scenes look at our architectural evolution. We'll dive deep into the real-world challenges we faced: from tackling unpredictable LLM hallucinations and integrating with complex legacy government registries, to designing for national-level security and scale under extreme pressure. This isn't a story of seamless success; it's a story of problems solved, from the absurdly simple to the monumentally complex.
Join us to learn the practical lessons that aren't in the textbooks. We will cover how we architected for resilience using a RAG-based approach to fight misinformation, implemented robust Guardrails to ensure safety, and built a scalable, fault-tolerant ecosystem. This session is for any architect, developer, or product leader who wants to understand the battle scars and hard-won insights that come from launching a massive AI platform against all odds.
- Dima has got over 15-year experience in IT.
- For the last decade, Dima has lead System Architecture Group, crucial technology directions and consulting services in one of the biggest Ukrainian service companies.
- As a technology leader, Dima continues growing architecture and consulting experience in the N-iX company.
- As an architecture trainer and speaker Dima tries to share his experience with the community via custom training, conferences, and architecture meetups.