Kafka

CosmosDB

Kafka Connect for Azure Cosmos DB – Episode 21

In this video, Mark Brown is joined by Abinav Rameesh to talk about and dig into the new Kafka Connector for Azure Cosmos DB. Kafka, with its rich ecosystem of source and sink connectors, enables microservices to communicate with each other while still being independent of the underlying databases. Learn more about the Kafka connector […]

Read More
Big Data

Kafka + Spark Streaming + Hive Example

Davis Busteed walks us through building a proof of concept for Spark Streaming from a Kafka Source to Hive. Check out the README and resource files at https://github.com/dbusteed/kafka-spark-streaming-example 

Read More
Azure Big Data IoT

Big data processing with Azure Event Hubs for Apache Kafka

Are you working with Apache Kafka and want to simplify management of your infrastructure? Lena Hall joins Scott Hanselman to show you can keep using Apache Kafka libraries for hundreds of projects, and try Azure Event Hubs behind the scenes to focus on code instead of maintaining infrastructure      Related Links Apache Kafka Applications Can Work […]

Read More
Azure Data Data Warehouse

Modern Data Warehousing Part 1: Azure Data Ingestion Options

In this video, Chris Seferlis  discusses stage one of the Modern Data Warehouse Process: Data Ingestion. Related Links: Azure Data Factory – https://azure.microsoft.com/en-us/services/data-factory/ Azure Databricks – https://azure.microsoft.com/en-us/services/databricks/ Azure HDInsight – https://azure.microsoft.com/en-us/services/hdinsight/ Azure Synapse – https://azure.microsoft.com/en-us/services/synapse-analytics/ Azure Data Box – https://azure.microsoft.com/en-us/services/databox/ Event Hubs – https://azure.microsoft.com/en-us/services/event-hubs/ Kafka on HDInsight – https://docs.microsoft.com/en-us/azure/hdinsight/kafka/apache-kafka-introduction IoT Hub – https://azure.microsoft.com/en-us/services/iot-hub/

Read More
Azure IoT

Azure Event Hubs Supported Protocols

In this episode, Serkant Karaca and Shubha Vijayasarathy from the Azure Event Hubs team sit with Cecil to discuss the various protocols that are supported by Azure Event Hubs. They dive into the AMQP support, compatibility with Apache Kafka and even discuss some customer use cases. Useful Links Azure Event Hubs Documentation GitHub repo with […]

Read More
Azure Big Data IoT

Azure Event Hubs with Kafka

Corey Sanders, Corporate VP – Microsoft Azure Compute team sat down with Dan Rosanova, Principal PM responsible for Azure messaging services. Dan shares some new functionality around Event Hubs with Kafka compatibility. Post any questions, topic ideas or general conversation here in the comments OR online on via Twitter with #AzureTwC

Read More
Azure Big Data

Siphon on HDInsight Kafka

In this episode of Azure Friday, Thomas Alex discusses how Microsoft uses Apache Kafka for HDInsight to power Siphon, a data ingestion service for internal use. Apache Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service. Microsoft created Siphon as a highly available and reliable service to ingest massive amounts of data for processing in […]

Read More
Azure Data IoT

Kafka Integration with Azure IoT Hub

Learn how Azure IoT Hub allows to easily consume IoT devices data from Kafka, in this episode of the IoT Show.

Read More
Big Data

Understanding Kafka

Frank Kane, creator of many great Udemy courses, explains Kafka in his trademark clear and straightforward manner.

Read More
Azure Big Data Hadoop

Apache Kafka on HDInsight

Raghav Mohan joins Scott Hanselman to talk about Apache Kafka on HDInsight, which added the open-source distributed streaming platform last year to complete a scalable, big data streaming scenario on Azure. Kafka is capable of processing millions of events/sec, petabytes of data/day to power scenarios like Toyota’s connected car, Office 365’s clickstream analytics, fraud detection […]

Read More