Future of Data: Databricks Engineer Connect
🚀 Join Databricks on April 23rd for an exclusive evening of networking and technical deep dives!
Join us for an exclusive evening exploring the cutting-edge work behind our multicloud Data and AI platform—empowering businesses across industries with the power of Data Intelligence. Hear directly from the leaders building this platform as they share insights into the challenges and complexities they’re solving. You'll also have the opportunity to network with Databricks engineers and industry peers.
📍 Venue: Provided upon registration
📅 Date: April 23 6:00-9:00 PM
🎟 Invite-Only | Limited Seats
This event will feature Databricks’ leadership, Vinod Marur, SVP of Engineering, Sameer Paranjpye, VP of Engineering and Bengaluru Site Lead, and Rohit A., Director of Engineering and Bengaluru Site Lead, alongside our Bengaluru-based Engineering leaders. Expect an exclusive, invite-only gathering of top engineers and leaders from throughout the Bengaluru tech ecosystem amidst art and photography, food, and drinks.
What to Expect:
🔹 Exclusive insights from our leaders on our Bengaluru R&D site roadmap and the high-impact projects our Engineering teams are working on
🔹 Technical talks on our cutting-edge engineering challenges
🔹 Networking with an intimate, select group of engineers and tech leaders from the Bangalore tech ecosystem and local Databricks employees
Our Speakers:
🎤 David Meyer – SVP, Product, Databricks
🎤 Atul Adya – Principal Engineer, Databricks
Infrastructure at Databricks: An unexpected journey
Infrastructure abstractions are the engine behind high-performance, scalable, and efficient products at Databricks. While hyperscalers like AWS, Azure, and GCP have addressed infrastructure challenges for most companies, Databricks plays by different rules. We serve customers across every cloud and region where their data lives, forcing us to build uniform infrastructure in diverse environments - a scenario hyperscalers cannot cater to. This unique model spurs tough challenges in networking, distributed systems, machine learning, storage, caching and many more! In this talk, we’ll outline these challenges and dive into our groundbreaking approaches in storage and caching.
🎤 Martin Grund – Principal Engineer, Databricks
Revolutionizing Connectivity for Apache Spark Workloads in Databricks using Spark Connect
The introduction of Spark Connect in Apache Spark 3.4 allowed for a complete rethinking of how workloads are executed in Databricks and has started a full transformation of our architecture starting with our serverless platform. In this talk, I will introduce how Spark Connect allows for a fully decoupled architecture and how we leverage it to build a secure full multi-user platform. Based on this platform principle, I will explain in more detail how Spark Connect is used as a foundational communication protocol in our serverless platform. Lastly, I will give an outlook on how Spark Connect can be used to simplify the development of new client connectors for a vast majority of use cases ranging from traditional database drivers like JDBC and ODBC to allowing users to connect to Databricks serverless platform from any language.
Meet Databricks Bengaluru
Opening in March 2025, our new Bengaluru R&D center will be Databricks’ largest international engineering hub, driving innovation across our Data Intelligence Platform. With 100+ founding engineers tackling critical challenges in data foundations, search platforms, system tables, infrastructure, storage, SaaS connectors, and automation, we’re growing fast—aiming to double our headcount this year. Our team includes top talent from leading institutions (over 60% are IIT alumni) and world-class companies like Google, Meta, and AWS. We’re looking for exceptional engineers to help shape the future of data intelligence and advance our mission to democratize data and AI for all.
📩 P.S.: This is an invite-only event with limited seats. RSVP now to secure your spot! Please note that all registrations are subject to review and confirmed attendees will receive a formal invitation.