Databricks on AWS Cloud Integration Demo
Did you ever wonder how Databricks plays a role in AWS data intergrations? Well, wonder no more. Time stamps: 0:00 Databricks Lakehouse on AWS overview 0:20 Connecting to EC2, S3, Glue, and IAM 0:46 Ingesting Kinesis streams into Delta Lake 1:32 Viewing Delta Lake tables in the Glue console 1:49 Databricks – Redshift integration 2:20 […]
Read More
Databricks Lakehouse Overview Training
Databricks provides this course on Databricks Lakehouse. In this course, you’ll discover how the Databricks Lakehouse Platform can help you compete in the world of big data and artificial intelligence. In the first half of the course, we’ll introduce you to foundational concepts in big data, explain key roles and abilities to look for when […]
Read More
Becoming a Data Driven Organization with Modern Lakehouse
I often say that “Data is the new oil,” but to transform it into anything useful, you need a high performing oil refinery. This talk by Databricks highlights the emerging “Lakehouse” pattern that’s taking enterprises by storm.
Read More
Introducing Databricks on Google Cloud
Databricks is now on Google Cloud and it brings an open lake house platform to the open data cloud to unify data engineering, data science, and analytics.
Read More
Data + AI Summit 2021 – Call for Presentations
The Data + AI Summit 2021 Call for Presentations is closing soon. Submit your full-length session ideas, lightning talk ideas, and more for the world’s largest gathering of Data + AI practitioners. The conference is at the end of May, but the CFP is due on Sunday, February 28. Data engineering, data analytics, AI, data […]
Read More
Introduction to Databricks Unified Data Platform
Simplify your data lake. Simplify your data architecture. Simplify your data engineering. Powered by Delta Lake, Databricks combines the best of data warehouses and data lakes into a lakehouse architecture, giving you one platform to collaborate on all of your data, analytics and AI workloads.
Read More
Achieving Lakehouse Models with Spark 3.0
It’s very easy to be distracted by the latest and greatest approaches with technology, but sometimes there’s a reason old approaches stand the test of time. Star Schemas & Kimball is one of those things that isn’t going anywhere, but as we move towards the “Data Lakehouse” paradigm – how appropriate is this modelling technique, […]
Read More
Common Strategies for Improving Performance on Your Delta Lakehouse
In this video, Franco Patano shows you how to improve the performance of your Delta Lakehouse. The Delta Architecture pattern has made the lives of data engineers much simpler, but what about improving query performance for data analysts?
Read More
Delta Lakehouse Data Profiler and SQL Analytics Demo
Coming from a data warehousing and BI background, Franco Patano wanted to have a catalogue of the Lakehouse, including schema and profiling statistics. He created the Lakehouse Data Profiler notebook using Python and SQL to analyze the data and generate schema and statistics tables. He then uses the new SQL Analytics product from Databricks to […]
Read More
BI to Lakehouse Round 3: Community Questions Answered
Considering shifting gears into Spark Data Engineering? We have another fun session with Simon Whiteley and Denny Lee as they answer your questions from their last two tech talks.
Read More