Data Engineering

Data Science Developer

How Data & Software Teams Can Collaborate to Ensure Smooth Data Integrations

This presentation was recorded at GOTO Conferences. ABSTRACT Imagine this scenario: The engineering team at your company is about to launch a new product or feature. The pressure is on the data team to deliver metrics and stats from the get-go, as everyone is keen to see how the new feature is performing. Behind the […]

Read More
Data Microsoft Spark

Data Engineering in Microsoft Fabric

Dive into the world of data factory pipelines and Spark notebooks, where we’ll unravel the secrets behind designing efficient data pipelines and leveraging interactive notebooks for seamless data processing.

Read More
AI Generative AI

Data + AI World Tour 2023 Singapore: Generation AI

Data + AI World Tour landed in Singapore on 22 September 2023 and gathered over 1,000 industry leaders and data and AI experts. FOMO? Watch the on-demand here: https://pages.databricks.com/FY24Q3-FE-DAIWT2023Singapore-1781_Data–AI-World-Tour-2023-Singapore–On-Demand.html

Read More
Data Python

Data Engineering 101: How to Build a real world dataset end-to-end: Part II

This video is from Deep Data Science. Data Engineering is a fundamental yet neglected skill by many data scientists. In this series I’m going to show step-by-step how I construct real world dataset for machine learning (e.g. FlowDB 2.0) from a variety of sources. I will also describe differences between this dataset and constructing data-lakes […]

Read More
AI Big Data Data

The Importance of Data Pipelines in AI and Data Science: An Overview

Data is the lifeblood of Artificial Intelligence (AI) and Data Science. It drives insights, powers decisions, and propels innovations. To unlock its full potential, data must be correctly handled, and this is where data pipelines come into play. What are Data Pipelines? Data pipelines are a series of data processing steps where data is ingested […]

Read More
AI

Data Science Mastery with ChatGPT Prompt Engineering: Learn Faster!

Unlock the power of ChatGPT to master data science & engineering. In this video from DecisionForest learn how to turbocharge your skills with clear prompts, epic data cleaning, visualisations and machine learning algorithms without any data science prior knowledge.

Read More
Databricks

Data Ingestion using Auto Loader

In this video is from Databricks, you will learn how to ingest your data using Auto Loader. Ingestion with Auto Loader allows you to incrementally process new files as they land in cloud object storage while being extremely cost-effective at the same time. It can ingest JSON, CSV, PARQUET, and other file formats. Access more […]

Read More