Supercharge Data and AI Innovation with Azure Databricks
Imagine you’re given a toolbox—a really good one. It’s packed with every tool you could possibly need to build and manage a vast, complex machinery. Now, your challenge is not only to learn how to use each tool effectively but to integrate them so seamlessly that the machinery runs more efficiently than ever before. That, […]
Read More
How to Simplify Streaming Pipelines with Lakeflow
Imagine you’re behind the steering wheel of a futuristic car, hurtling through city streets at speeds only seen in sci-fi films. Every red light, stop sign, and curve in the road demands instant, flawless navigation. Now, replace that thrilling drive with the world of data streaming, where every millisecond of processing speed can lead to […]
Read More
AI’s Silent Killer: Technical Debt & the Hidden Costs of Bad Data
Recently, I was a guest on a podcast on AI and the importance of Data Engineering. Delving into the technological endeavors of AI is like embarking on a grand voyage. It’s thrilling but fraught with hidden icebergs and unforeseen currents. The push towards integrating AI into business operations stirs up a mix of excitement and […]
Read More
Maximizing Power BI Efficiency: Alternatives to Measure Tables
Creating and managing measures is a fundamental aspect of data analytics. Measures, which are numerical metrics based on column data, are essential for performing calculations and generating insights from datasets. Traditionally, many data analysts have used measures tables as a convenient way to store and organize their measures. These tables collate all measures in one […]
Read More
What’s New in Fabric? January 2025
- Frank
- February 17, 2025
- Copilot and AI
- Copy Job
- Data Engineering
- Data Factory
- Data Science
- Data Warehouse
- dataflow gen2
- direct lake mode
- intellisense
- microsoft fabric
- Mirroring
- Native Execution Engine
- NotebookUtils
- onedrive
- OneLake Catalog
- Open Mirroring
- Power BI Desktop
- power bi service
- PowerPoint
- python notebook
- Query Insights
- Real-Time Intelligence
- SAP data
- Semantic model
- sharepoint
- Spark Job
- SQL analytics
- TMDL
One of the standout features of Microsoft Fabric is its adaptability. As technology continues to evolve at an unprecedented pace, it is essential for businesses to stay ahead of the curve. Microsoft Fabric is designed to do just that. With its robust framework and flexible architecture, it can be customized to meet the unique needs […]
Read More
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote
- Frank
- January 8, 2025
- artificial intelligence
- Big Data
- Business Intelligence
- Business software
- Cloud Computing
- Cloud storage
- Data cloud
- Data driven economy
- data economy
- Data Engineering
- Data Lake
- Data Science
- Data Scientist
- Data Warehouse
- Data Warehousing
- Predictive Analytics
- snowflake
- Snowflake cloud
- Snowflake company
- Snowflake computing
- Snowflake data warehouse
- Snowflake database
- The Data Cloud
Artificial Intelligence (AI) is a transformative technology that, like electricity, is increasingly becoming indispensable in our daily lives. This transformative power of AI is due to its ability to automate complex tasks, generate insights from vast amounts of data, and enable new applications that were not possible before. Today, I would like to discuss the […]
Read More
Should You Still Learn SSIS in 2025?
- Frank
- December 27, 2024
- Azure
- Azure Data Factory
- Business Intelligence
- Cloud Computing
- Cloud-Native Tools
- Data Analytics
- Data Engineering
- Data Integration
- data migration
- Data Orchestration
- data pipeline
- Data Transformation
- Data Workflows
- ETL
- Hybrid Cloud
- Legacy Technology
- Microsoft Ecosystem
- microsoft fabric
- on-premises infrastructure
- SQL Server
- SQL Server Integration Services
- SSIS
- T-SQL
- Technology Longevity
As the holiday season brings a mix of nostalgia and anticipation for the future, it’s a fitting time to talk about SQL Server Integration Services (SSIS) — a technology as classic as Christmas carols but often met with mixed reactions, much like fruitcake. Despite being around for nearly two decades, SSIS remains a cornerstone in […]
Read More
Tis the Season for SSIS: Celebrating a Data Engineering Classic
The holiday season is a time for reflection and celebration, and here at Data Driven, we’re diving into a topic as classic as Christmas carols and as warmly debated as fruitcake: SQL Server Integration Services (SSIS). In this festive podcast episode, Frank and Andy unwrap the enduring significance of SSIS, a stalwart in the data […]
Read More