Cover Image for The Fifth vLLM Meetup @ AWS Startup Loft
Cover Image for The Fifth vLLM Meetup @ AWS Startup Loft
Avatar for vLLM Meetups and Events
Join the vLLM community to discuss optimizing LLM inference!
208 Going
Registration
Past Event
Please click on the button below to join the waitlist. You will be notified if additional spots become available.
About Event

β€‹πŸ¦™πŸ¦™πŸ¦™ Join us with to discuss how to run Meta Llama 3.1 with vLLM! πŸ¦™πŸ¦™πŸ¦™

​We are excited to invite you to the vLLM meetup hosted by AWS on July 24thΒ at the AWS Startup Loft at 525 Market Street.

​To get there:

​2nd Floor, 525 Market St
(Main entrance up the stairs to SW of building. Alternative access via elevators in main building lobby).

​Refreshments: Light refreshments will be available to keep you energized throughout the event.

​All attendees will be required to show a photo Id at reception.

  1. ​5:00 - 6:00 Social hour

  2. ​6:00 - 6:30 AWS Presentation

    1. ​20 min vLLM's AWS Neuron Support

    2. ​10 min vLLM in Production with SageMaker LLM

  3. ​6:30 - 7:00 vLLM community update and key speaker

    1. ​15 min vLLM Feature Update

    2. ​15min Pipeline Parallelism Deep Dive

  4. ​7:00 - 7:30 vLLM Q&A Session

  5. ​7:30 - 8:30 Social hour

​What to Expect:

  • ​Inspiring Talks: Hear from experts at vLLM and AWS teams as they present recent updates and innovative advancements in the field.

  • ​Networking Opportunities: Connect with fellow AI builders, researchers, and enthusiasts to share ideas and inspire each other.

  • ​Expert Insights: Dive into the latest developments in vLLM, AWS Neuron, and Amazon SageMaker, brought to you by the vLLM team and experts from AWS.

Location
525 Market St
San Francisco, CA 94105, USA
Avatar for vLLM Meetups and Events
Join the vLLM community to discuss optimizing LLM inference!
208 Going