This episode is a perfect fit for anyone who wants to learn how to apply AI into their product especially for high fidelity analytics use cases. Utkarsh Ohm is Director of AI at Thoughtspot. He previously was a Co-Founder & eng leader at various startups. In this episode, we cover applying LLMs alongside other models to customer facing products. We discuss where LLMs in particular are helpful vs traditional ML models, why text to SQL use cases need to be supplemented by internal insights to improve accuracy, and how to approach data security for LLMs. We deep dive specifically into Sage, Thoughtspot’s LLM enabled product and the infrastructure that allows Sage to produce accurate insights for customers. Over the course of the episode, we discuss plenty of advice for teams building with LLMs to learn from and take into account.
