Tech Talk with Matt: Scraping The Internet At Scale - Seeing the internet through the eyes of an LLM

​Matt will be demonstrating a few of the techniques and technologies used to scrape the internet for data at scale.

This includes using LLM models to assist in the scraping process by deciphering patterns, classifying pages, and pre-processing/embedding data before it gets saved.

​As always group participation is welcome. Feel free to share your adventures scraping the internet.