Data + AI Summit 2021 – Call for Presentations

Data + AI Summit 2021 – Call for Presentations

The Data + AI Summit 2021 Call for Presentations is closing soon. Submit your full-length session ideas, lightning talk ideas, and more for the world's... Details
Conquer Data Sprawl and Unleash Digital Transformation with Azure Purview

Conquer Data Sprawl and Unleash Digital Transformation with Azure Purview

Data holds secrets to insights that can transform your business – but only if you know where your data is and what it is. We're... Details
Manual Lineage with the Purview PyApacheAtlas API

Manual Lineage with the Purview PyApacheAtlas API

Simon from Advancing Analytics explores the Atlas API that's exposed under the covers of the new Azure Purview data governance offering. There are a couple... Details
Apache Spark and Cassandra Integration

Apache Spark and Cassandra Integration

Big Data Engineering covers Apache Spark and Cassandra Integration in this insightful video. Details
eBay’s Work on Dynamic Partition Pruning & Runtime Filter

eBay’s Work on Dynamic Partition Pruning & Runtime Filter

Databricks highlights the problems eBay faced in making sure they could handle customers’ interactive SQL queries. Details
Is Apache Kafka 2.7 One Step Closer to Killing ZooKeeper

Is Apache Kafka 2.7 One Step Closer to Killing ZooKeeper

In this video Hussein Nasser goes through the new features in Apache Kafka 2.7, and examines the amount of work Apache Kafka is doing to... Details
How to Design and Implement a Real-time Data Lake with Dynamically Changing Schema

How to Design and Implement a Real-time Data Lake with Dynamically Changing Schema

Building a curated data lake on real time data is an emerging data warehouse pattern with delta. However in the real world, what we many... Details
Cost Efficiency Strategies for Managed Apache Spark Service

Cost Efficiency Strategies for Managed Apache Spark Service

With cloud-native rising, the conversation of infrastructure costs seeped from R&D Directors to every person in the R&D: “How does much a VM cost?” “can... Details
Kafka + Spark Streaming + Hive Example

Kafka + Spark Streaming + Hive Example

Davis Busteed walks us through building a proof of concept for Spark Streaming from a Kafka Source to Hive. Check out the README and resource... Details
Achieving Lakehouse Models with Spark 3.0

Achieving Lakehouse Models with Spark 3.0

It’s very easy to be distracted by the latest and greatest approaches with technology, but sometimes there’s a reason old approaches stand the test of... Details