⏩ LLM Problem Solvers - Cost Saving in LLM / Agent Systems
we will be looking at:
Description: In this open collaboration session, we’ll first share a set of fundamental approaches to cost saving in an LLM based system, including commonly shared techniques and empirical experiences, aiming to cover both API usage and compute usage. We’ll open up discussion to the floor for participants to also share tips from their own experience, which would also be gathered into a doc to be shared with everyone on the call later.
Short Bio of the Discussion Lead: Ian Yu is a pragmatic ML Engineer in the age of generative AI. He's worked at GroupBy Inc. for the past 3.5+ years and comes with a wealth of practical knowledge via consulting, teaching, and community gigs he's been involved in.
We coordinate through slack
Discussion doc for this session n/a