In this episode of Azure Friday, Thomas Alex discusses how Microsoft uses Apache Kafka for HDInsight to power Siphon, a data ingestion service for internal use.

Apache Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service. Microsoft created Siphon as a highly available and reliable service to ingest massive amounts of data for processing in near real time. Siphon handles ingestion of over a trillion events per day across multiple business-critical scenarios at Microsoft. In this episode, learn how Siphon uses Apache Kafka for HDInsight as its scalable pub/sub message queue.

 

For more information:

In this video, Murali Krishnaprasad discusses Interactive Query (also called Hive LLAP, or Low Latency Analytical Processing, or Live Long and Process), which is an Azure HDInsight cluster type. Interactive Query supports in-memory caching, which makes Hive queries super-fast and interactive. See how to use HDInsight Interactive Query to analyze extremely large datasets (~100TB) in common file formats such as ORC and CSV using common BI/SQL tools including Zeppelin notebooks and VS Code.

For more information, see:

Online chat, real-time dashboards, social media sites and even games are just a few examples of where real-time technology can make a huge impact on user experience. ASP.NET Core SignalR is an open-source library that simplifies adding real-time functionality to your applications.

In this episode, Anthony Chu comes on to talk about how we can get started with ASP.NET Core SignalR. He also shows us how the Azure SignalR Service allows us to easily scale our real-time connections.

Useful Links

Machine learning models, especially deep learning ones, can be complex.

In this video from QCon.ai 2018, Chi Zeng walks us through how to debug, monitor, and examine the decisions of a TensorFlow-based model using the TensorBoard suite of visualizations.

Chi Zeng works on the TensorBoard suite of visualizations within Google Brain.

Collected and predicted data, coupled with the farmer’s knowledge about the farm, can help increase farm productivity and reduce costs. Microsoft already enabled precision farming through FarmBeats and partnerships with solution integrators leveraging the Azure IoT platform and solutions.
Here is an introduction to the upcoming Microsoft’s IoT In Action Agriculture Webinar.
Tune in to watch the webinar live on August 23, 2018 10:00a.m. PST / 11:00a.m. CET / 1:00p.m. SGT