Cover Image for The Fifth vLLM Meetup @ AWS Startup Loft
Cover Image for The Fifth vLLM Meetup @ AWS Startup Loft
208 Going

The Fifth vLLM Meetup @ AWS Startup Loft

Hosted by Vivek Gangasani & 5 others
Registration
Past Event
Please click on the button below to join the waitlist. You will be notified if additional spots become available.
About Event

β€‹πŸ¦™πŸ¦™πŸ¦™ Join us with to discuss how to run Meta Llama 3.1 with vLLM! πŸ¦™πŸ¦™πŸ¦™

​We are excited to invite you to the vLLM meetup hosted by AWS on July 24thΒ at the AWS Startup Loft at 525 Market Street.

​To get there:

​2nd Floor, 525 Market St
(Main entrance up the stairs to SW of building. Alternative access via elevators in main building lobby).

​Refreshments: Light refreshments will be available to keep you energized throughout the event.

​All attendees will be required to show a photo Id at reception.

  1. ​5:00 - 6:00 Social hour

  2. ​6:00 - 6:30 AWS Presentation

    1. ​20 min vLLM's AWS Neuron Support by Liangfu Chen

    2. ​10 min vLLM in Production with SageMaker LLM by Qing Lan

  3. ​6:30 - 7:00 vLLM community update and key speaker

    1. ​15 min vLLM Feature Update by the vLLM team from UC Berkeley

    2. ​15min Pipeline Parallelism Deep Dive by Murali Andoorveedu

  4. ​7:00 - 7:30 vLLM Q&A Session

  5. ​7:30 - 8:30 Social hour

​What to Expect:

  • ​Inspiring Talks: Hear from experts at vLLM and AWS teams as they present recent updates and innovative advancements in the field.

  • ​Networking Opportunities: Connect with fellow AI builders, researchers, and enthusiasts to share ideas and inspire each other.

  • ​Expert Insights: Dive into the latest developments in vLLM, AWS Neuron, and Amazon SageMaker, brought to you by the vLLM team and experts from AWS.

Location
525 Market St
San Francisco, CA 94105, USA
208 Going