Data Quality Testing in the Medallion Architecture with PyTest and PySpark

Big Data Databricks Spark
Closed
17 sec read

Data Quality Testing in the Medallion Architecture with PyTest and PySpark

Frank
November 25, 2020

Here’s a great Lightning talk from Data + AI Summit 2020 by Carter Kilgour on
”Why data quality is especially important in the medallion architecture, and how to ensure it with scheduled testing and reporting.”

Frank

Total Post: 4241

#DataScientist, #DataEngineer, Blogger, Vlogger, Podcaster at http://DataDriven.tv . Back @Microsoft to help customers leverage #AI Opinions mine. #武當派 fan. I blog to help you become a better data scientist/ML engineer Opinions are mine. All mine.