Lakehouse

AWS Databricks

Databricks on AWS Cloud Integration Demo

Did you ever wonder how Databricks plays a role in AWS data intergrations? Well, wonder no more. Time stamps: 0:00 Databricks Lakehouse on AWS overview 0:20 Connecting to EC2, S3, Glue, and IAM 0:46 Ingesting Kinesis streams into Delta Lake 1:32 Viewing Delta Lake tables in the Glue console 1:49 Databricks – Redshift integration 2:20 […]

Read More
Data Warehouse

Databricks Lakehouse Overview Training

Databricks provides this course on Databricks Lakehouse. In this course, you’ll discover how the Databricks Lakehouse Platform can help you compete in the world of big data and artificial intelligence. In the first half of the course, we’ll introduce you to foundational concepts in big data, explain key roles and abilities to look for when […]

Read More
Data Warehouse Databricks

Becoming a Data Driven Organization with Modern Lakehouse

I often say that “Data is the new oil,” but to transform it into anything useful, you need a high performing oil refinery. This talk by Databricks highlights the emerging “Lakehouse” pattern that’s taking enterprises by storm.

Read More
Databricks Google

Introducing Databricks on Google Cloud

Databricks is now on Google Cloud and it brings an open lake house platform to the open data cloud to unify data engineering, data science, and analytics.

Read More
AI Big Data Data

Data + AI Summit 2021 – Call for Presentations

The Data + AI Summit 2021 Call for Presentations is closing soon. Submit your full-length session ideas, lightning talk ideas, and more for the world’s largest gathering of Data + AI practitioners. The conference is at the end of May, but the CFP is due on Sunday, February 28. Data engineering, data analytics, AI, data […]

Read More
Databricks

Introduction to Databricks Unified Data Platform

Simplify your data lake. Simplify your data architecture. Simplify your data engineering. Powered by Delta Lake, Databricks combines the best of data warehouses and data lakes into a lakehouse architecture, giving you one platform to collaborate on all of your data, analytics and AI workloads.

Read More
Big Data Data Databricks

Achieving Lakehouse Models with Spark 3.0

It’s very easy to be distracted by the latest and greatest approaches with technology, but sometimes there’s a reason old approaches stand the test of time. Star Schemas & Kimball is one of those things that isn’t going anywhere, but as we move towards the “Data Lakehouse” paradigm – how appropriate is this modelling technique, […]

Read More
Databricks

Common Strategies for Improving Performance on Your Delta Lakehouse

In this video, Franco Patano shows you how to improve the performance of your Delta Lakehouse. The Delta Architecture pattern has made the lives of data engineers much simpler, but what about improving query performance for data analysts? 

Read More
Databricks

Delta Lakehouse Data Profiler and SQL Analytics Demo

Coming from a data warehousing and BI background, Franco Patano wanted to have a catalogue of the Lakehouse, including schema and profiling statistics. He created the Lakehouse Data Profiler notebook using Python and SQL to analyze the data and generate schema and statistics tables. He then uses the new SQL Analytics product from Databricks to […]

Read More
Databricks

BI to Lakehouse Round 3: Community Questions Answered

Considering shifting gears into Spark Data Engineering? We have another fun session with Simon Whiteley  and Denny Lee as they answer your questions from their last two tech talks.

Read More