How to Securely Connect Power Automate to Databricks for Seamless Workflow Automation
Discover how to integrate Microsoft Power Automate with Databricks to enhance your data workflows with governed, low-code automation capabilities. This integration allows you to execute SQL queries and trigger Databricks jobs efficiently while maintaining secure, zero-copy data access. Based on content from Databricks Introduction Automating data workflows through the integration of Databricks and Power Automate […]
Read More
Introduction to Lakebase: OLTP for Data Apps and AI Agents
Imagine you’re the chef in a bustling kitchen, but instead of cooking, you’re blending vast amounts of data to serve up timely, accurate information across your enterprise. This is where the concept of Lakebase by Databricks leaps into the scene—much like a sous chef who specializes in the art of managing both ingredients and the […]
Read More
Databricks CEO at Microsoft Ignite 2025 Partner Keynote
Ever wonder how we can make sense of the vast oceans of data swirling around us? It’s quite a challenge, akin to organizing a garage that hasn’t been touched in decades—full of everything from valuable heirlooms to forgotten junk. But imagine if you had a system that not only helps you organize all those items […]
Read More
How to Simplify Streaming Pipelines with Lakeflow
Imagine you’re behind the steering wheel of a futuristic car, hurtling through city streets at speeds only seen in sci-fi films. Every red light, stop sign, and curve in the road demands instant, flawless navigation. Now, replace that thrilling drive with the world of data streaming, where every millisecond of processing speed can lead to […]
Read More
Databricks Free Edition: A Game-Changer for Learning AI and Data Engineering
Back when I first started diving into data and analytics, getting hands-on experience with real-world tools felt like trying to tinker with a high-performance engine while only having access to toy parts. Sure, there were tutorials and simulators, but the real thing? That was locked behind enterprise licenses and corporate firewalls. So, when I read […]
Read More
Fine tuning Gemma with LoRA in Google Colab
Traditionally, fine-tuning methods can be computationally expensive, especially for large language models that consist of millions or even billions of parameters. To overcome this challenge, we introduce a more efficient technique, known as low-rank adaptation, or LoRA. LoRA is an innovative approach that leverages the concept of low-rank matrices to reduce the number of trainable […]
Read More
Mixture of Memory Experts (MoME) | Data Brew | Episode 36
-
Frank
- January 15, 2025
- Agentic Workflows
- AI
- AI Accuracy
- ai hallucinations
- AI Infrastructure
- AI innovation
- Business Automation
- Data Brew
- Data Pipelines
- Data Science
- Databricks
- Document Reasoning
- Enterprise AI
- Fine-tuning
- function calling
- Generative AI
- gpt
- large language models
- Lini
- LLM
- lora
- Machine Learning
- Memory Tuning
- Sharon Zhou
- Superintelligence
- Text-to-SQL
Recently, I tuned into an episode of Data Brew by Databricks hosted by Denny Lee and Brooke Wenig, featuring Sharon Zhou, co-founder and CEO of Lini. For anyone navigating the ever-evolving world of generative AI and machine learning, this episode was a masterclass in understanding both the opportunities and challenges in the field. Sharon’s deep […]
Read More%20|%20Data%20Brew%20|%20Episode%2036){kind=link}
Epsilon: The importance of leveraging data and AI to connect clients with consumers
In modern business, the mastery of data has emerged as a non-negotiable cornerstone of success. Companies are increasingly recognizing the transformative power of effectively harnessing data, analytics, and artificial intelligence (AI) to drive a deeper understanding of consumer behavior and preferences. This shift towards a data-centric approach is not merely a trend but a fundamental […]
Read More
Eight Weeks, Two Developers, One Production AI Conference Assistant
Join the creators of Brickbot, the innovative AI assistant developed for DAIS ’24, as they take you behind the scenes of the app’s design and implementation. In this podcast-style discussion, the team shares their key takeaways and lessons learned from building an AI-powered tool customized to meet the needs of the DAIS audience. With just […]
Read More
GumGum Media’s Data Science Journey on Databricks
In the bustling world of advertising technology (AdTech), the quest to forge meaningful connections between advertisers and audiences is a complex puzzle. At GumGum, an innovative AdTech company, this challenge is met head-on with a blend of creativity, technology, and a deep commitment to data science. As a senior engineering manager overseeing various data teams, […]
Read More