Cover Image for Leveraging open-source LLMs for production

Leveraging open-source LLMs for production

Past Event
Welcome! Please choose your desired ticket type:
About Event

Data Phoenix team invites you all to our upcoming webinar that’s going to take place on November 30th, 10 am PST.

  • Topic: Leveraging open-source LLMs for production

  • Speaker: Andrey Cheptsov (CEO & Founder of dstack)

  • Participation: free (but you’ll be required to register)

This talk examines using open-source LLMs for real-world purposes. It compares the benefits and drawbacks of open-source LLMs to proprietary options like OpenAI. The discussion covers the economics of hosting open-source LLMs, highlights serving frameworks, explores cloud GPU availability, gives an overview of key open-source LLMs, and shows how to run and refine these models using the dstack open-source tool.

Andrey is the founder of dstack, an open-source toolkit for orchestrating GPU workloads across clouds. Prior to this, Andrey worked at JetBrains with the PyCharm team.

Follow DataPhoenix on LinkedIn & YouTube to stay updated with our community events and the latest AI/Data industrial news.