PyData Global 2023

Dean Pleban

With a background combining Machine Learning, Software Engineering, Physics, and design – Dean applies a multi-disciplinary to building products for machine learning and AI teams.

Dean is the CEO and co-founder of DagsHub, a platform for machine learning & AI teams that lets them build better models and manage their project's data, models, experiments, and code effectively—combining popular open-source tools and formats to create a central source of truth for AI projects.

Dean is also the host of the MLOps Podcast, where he speaks with industry experts about getting ML models to production.

The speaker's profile picture

Sessions

12-07
17:30
30min
Customizing and Evaluating LLMs, an Ops Perspective
Dean Pleban

With LLM hype growing ever greater, almost every company is racing to create their LLM application, whether it's an internal tool to boost productivity, or a chat interface for their product.

However, if your product or domain isn't fully generic, you'll probably hit a lot of challenges that make deploying your LLM application a meaningful risk.

In this talk, I'll discuss the main challenges in customizing and evaluating LLMs for specific domains and applications, and suggest a few workflows and tools to help solve for those challenges.

Machine Learning Track
Machine Learning Track