Cover Image for Leveraging open-source LLMs for production

Leveraging open-source LLMs for production

Welcome! Multiple ticket options are available for this event. Please choose your desired option.
About Event

Data Phoenix team invites you all to our upcoming webinar that’s going to take place on November 30th, 10 am PST.

  • Topic: Leveraging open-source LLMs for production

  • Speaker: Andrey Cheptsov (CEO & Founder of dstack)

  • Participation: free (but you’ll be required to register)

This talk examines using open-source LLMs for real-world purposes. It compares the benefits and drawbacks of open-source LLMs to proprietary options like OpenAI. The discussion covers the economics of hosting open-source LLMs, highlights serving frameworks, explores cloud GPU availability, gives an overview of key open-source LLMs, and shows how to run and refine these models using the dstack open-source tool.

Andrey is the founder of dstack, an open-source toolkit for orchestrating GPU workloads across clouds. Prior to this, Andrey worked at JetBrains with the PyCharm team.

Follow DataPhoenix on LinkedIn & YouTube to stay updated with our community events and the latest AI/Data industrial news.