Vighnesh Deshpande
AI Engineer
Vivanti Consulting
Where Should the Dice Roll? Placing Non-Determinism Deliberately in Enterprise AI
Where Should the Dice Roll? Placing Non-Determinism Deliberately in Enterprise AI
Most production AI guidance assumes you want consistency: pin the prompt, lower the temperature, eval for drift. But a whole class of enterprise use cases - idea generation, recommendation, exploration, synthesis - is worthless if the output is predictable. The engineering problem flips: how do you make variance useful, keep it safe, and convince a governance function that a system with no single right answer is still under control?
This talk is the build story of a production AI concept-generation pipeline. I'll cover the concrete decisions: constraining the shape of outputs with strict schemas while leaving the content free; grounding generation in competitive and regulatory data so novelty stays feasible; designing a three-stage human funnel (expert weighted scoring, swipe-based crowd screening, review loop) that turns volume into a shortlist.
The evaluation approach when there's no ground truth - measuring diversity, feasibility, and survival-through-funnel instead of correctness.
Vighnesh Deshpande
Viggy is a Consultant at Vivanti, an Australian Data & AI consulting firm, where he leads delivery of production AI systems for regulated enterprises across government, financial services and consumer health. He leads Vivanti's AI governance cadence and works across the delivery, governance and commercial sides of getting AI into production. He contributes to the Vivanti Academy and is managing the LangChain partnership within the company.