Andrey Cheptsov
Andrey is the core contributor to dstack, an open-source framework for running LLM workloads across any clouds. Before dstack, Andrey worked at JetBrains as a PM for PyCharm and other dev tools.
Sessions
12-08
13:00
30min
Leveraging open-source LLMs for production
Andrey Cheptsov
This talk examines using open-source LLMs for real-world purposes. It compares the benefits and drawbacks of open-source LLMs to proprietary options like OpenAI. The discussion covers the economics of hosting open-source LLMs, highlights serving frameworks, explores cloud GPU availability, and gives an overview of key open-source LLMs.
LLMs Track
LLM Track