Uncovering Data Transformation & Warehousing: A Netflix Casestudy
As is usually the case with fast-advancing technologies, AI has inspired massive FOMO, FUD and FEUDS. Data transformation is the process of converting data from one format to another, typically from the format of a source system into the required format of a destination system.
A data warehouse incorporates information about many subject areas, often the entire enterprise. Typically you use a dimensional data model to design a data warehouse and a data pipeline is a series of processes that migrate data from a source to a destination database.
At its most basic, the ETL process encompasses data extraction, transformation, and loading.
In this session you will learn:
- Artificial Intelligence Hierarchy of Needs
- Data Transformation Process
- An Overview of Data Warehouse
- Understanding Data Pipeline & ETL Process
- Walkthrough of a Data Engineering Project at Netflix
About: Pritam Banerjee:
Seasoned Software Engineer with more than 10 years of diversified experience in the healthcare, automotive and financial industry.
Currently working as a Technical Lead at IQVIA. Previously worked as a Senior Data Engineer at Mercedes Benz Research and Development, India.
I have got a strong hands-on experience using various big data tools like Apache Spark Streaming/batch, Hadoop, Apache Storm, Kafka, Oozie, Hive, Pig, Scoop, Apache Airflow, etc.
Also gained good expertise working with Azure cloud computing platform especially using its services like Blob storage, Azure HDI, Azure EventHub and IOTHub, Azure CosmosDB, Databricks, logic apps, Kusto, Azure data factory, Azure synapse, Azure Kubernetes Service(AKS), Azure app services, etc
Languages used: Java, Scala, Python
Last but not least. I keep a strong believe in the philosophy of changing the knowledge paradigm from "know it all' to "learn it all"
About Antwak
Antwak is an experiential learning platform that has 1000+ free, bite-sized professional learning courses in 15+ domains such as Cybersecurity, Digital Marketing, Data Engineering powered by 2,500+ experts from 500+ brands & corporates across 30+ countries.
Antwak offers 16 week LIVE courses powered by the industry’s top professionals. Antwak enables college students and early professionals to get trained on in-demand skills and accelerate their career in digital first domains at a fraction of the costs of available alternatives. For more information, visit: www.antwak.com.
You can get in touch with the team at outreach@antwak.com
About AntWak Data Engineering Program:
Get ready for a new job in Data engineering.
A LIVE online Data Engineering course where you will learn Data Warehousing, Data Lakes, Data Processing, Big Data & Hadoop, Advanced SQL, Data Visualization & many more from top professionals and get endorsed by them - Apply Here
Follow us on Linkedin to get job updates and subscribe to our youtube channel to see recordings of all past events. Also, do check out our Data Engineering Masters Program here.
Keep learning and growing!
Cheers