Databricks DevConnect | Chicago, IL
🔊🌟 Calling all data engineers🌟🔊
Join us for Databricks DevConnect Chicago on Tuesday, August 19 from 5:00pm - 9:00pm CT!
Databricks DevConnect is a technical meetup designed for data engineers to experience an immersive evening of insights, collaborative learning, and community – hosted by the Databricks Developer Relations team. Bringing together data enthusiasts and innovators, we’ll explore the latest advancements in Databricks data engineering, AI, and analytics. You’ll have the chance to dive deep into technical discussions, share real-world experiences, and discover new ways to leverage Databricks’s technologies. Whether you’re a seasoned data engineer or just starting your journey, this event is designed to spark creativity and foster growth in our community. Let’s connect, learn, and push the boundaries of what’s possible with data – together!
Why You Can't Miss This Event:
🔓 Unlock the Power of Databricks: Discover how our unified platform can power your data engineering and AI initiatives.
🧠 Learn from Experts: Gain actionable insights from Databricks Engineers, Product Managers, DevRel, and MVPs.
💻 Engaging Technical Sessions: Deepen technical expertise through interactive demos of the Databricks platform, and tools.
🤝 Network with the Community: Connect and build relationships with peers, MVPs, Databricks product managers, developer advocates, and engineers.
👕 Access to exclusive content and goodies: Swag will be raffled off throughout the event and attendees will get access to hands-on training and guided labs through Databricks Academy Labs post event!
AGENDA
5:00 PM: Registration & Mingling
6:00 PM: Welcome Remarks
6:15 PM ➡️ Session #1: The Unified Lakehouse: Format Interoperability and transparent Governance with Unity Catalog presented by:
Spencer Cook, Lead Solutions Architect, Databricks
6:45 PM ➡️ Session #2: End-to-End Development with Databricks Assistant: From Data Discovery to Production
7:15 PM ➡️ Session #3: Turning the Tables on Tuning your Tables
7:55 PM: Closing Remarks by:
8:00 PM: Networking Reception
9:00 PM: Good night
SESSION DESCRIPTIONS
The Unified Lakehouse: Format Interoperability and transparent Governance with Unity Catalog: This technical session demonstrates how Databricks' Unity Catalog simplifies data integration and governance across the lakehouse, regardless of data format. Learn how Unity Catalog enables seamless connectivity to diverse data sources, providing full format interoperability, while empowering data engineers to implement robust governance and security measures. We will delve into leveraging open standards for data management, implementing fine-grained access controls, utilizing advanced lineage tracking, and establishing secure collaboration workflows. Discover how to manage data assets effectively, ensure compliance with data regulations, and architect a well-governed, secure lakehouse that fosters innovation and maintains data integrity.
End-to-End Development with Databricks Assistant: From Data Discovery to Production: In this technical deep dive, we’ll explore how developers can leverage the Databricks Assistant to streamline workflows across the entire development lifecycle—from data discovery to production deployment. Learn how AI-powered features like Catalog Explorer integration simplify schema exploration and metadata retrieval, while SQL optimization tools help refine query performance. We’ll also showcase new capabilities for diagnosing job errors and troubleshooting DLT pipelines, enabling faster debugging and issue resolution in Python-based workflows. Whether you're authoring SQL queries, troubleshooting Python scripts, or debugging production workflows, discover how the Databricks Assistant accelerates development and enhances operational efficiency.
Turning the Tables on Tuning your Tables: Traditionally, data engineers spend a lot of time on tuning their tables together with their workloads. Picking partition keys. Choosing whether to use ZORDER or partitioning. Scheduling OPTIMIZE and VACUUM. Planning your schedules carefully to avoid concurrent writes and OPTIMIZES... This talk is about how the Databricks Data Intelligence Platform takes all of those worries out of your hands, so that you can focus on your real job. You'll learn about a number of innovations that combine to make your life easier, including Liquid Clustering, Row-Level Concurrency, and Predictive Optimization. Using these features, you can forget about all that manual tuning and get back to the business at hand!
SPEAKERS
Franco Patano, Principal Specialist Solutions Architect, Databricks
Spencer Cook, Lead Solutions Architect, Databricks