Fine Tuning Friday - "Tab Tab" Code Completion Model

​Welcome to a new series from the Oxen.ai Herd called Fine Tuning Fridays! Each week we will take an open source model and put it head to head against a closed source foundation model on a specialized task.

​We will be giving you practical examples with reference code, reference data, model weights, and the end to end infrastructure to reproduce experiments on your own.

​The format will be live on Zoom at Friday, 10am PST, similar to our Arxiv Dive series in the past.

​This Week

​We're building in public with this one as we work on fine tuning a Cursor-like "tab tab" code completion model. Tab once to skip to the next edit, tab again to accept the next edit. We'll have baselines to compare to state-of-the-art options like Claude and GPT-4.

​Have you done similar work? We'd love to see it too.