Back To Schedule
Tuesday, October 31 • 11:00am - 11:25am
[Virtual Exclusive] PRO Workshop (AI): GPT on a Leash: Techniques for Mitigating Risks and Maximizing Benefits with LLMs in Production

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Philip Tannor, Deepchecks, Co-Founder & CEO

In this talk, we'll delve into how to handle the challenges and risks of integrating Large Language Models (LLMs) in production applications. Amidst the promise of LLMs, their stochastic nature, tendency for hallucinations, potential biases, and the issue of robust, affordable evaluation pose significant challenges. We'll explore methods for creating solid evaluation sets, efficient evaluation of product versions, and comprehensive strategies for testing to counteract inherent model weaknesses, including bias, hallucinations, prompt injection attacks, topic deviations, and harmful output. By addressing these testing challenges and establishing rigorous requirements, we can maximize the potential of LLMs while reducing associated risks. 

avatar for Shir Chorev

Shir Chorev

Co-founder & CTO, Deepchecks
Shir is the co-founder and CTO of Deepchecks, an MLOps startup for continuous validation of ML models and data. Previously, Shir worked at the Prime Minister’s Office and at Unit 8200, conducting and leading research in various Machine Learning and Cybersecurity related challenges... Read More →

Tuesday October 31, 2023 11:00am - 11:25am PDT
VIRTUAL AI DevWorld -- Workshop Stage https://app.hopin.com/events/api-world-2023-ai-devworld/sessions