Big Data Databricks Spark

Data Quality Testing in the Medallion Architecture with PyTest and PySpark

Here’s a great Lightning talk from Data + AI Summit 2020 by Carter Kilgour on ”Why data quality is especially important in the medallion architecture, and how to ensure it with scheduled testing and reporting.”

Read More