Day: December 28, 2020

Big Data Data Databricks

Scale and Optimize Data Engineering Pipelines with Best Practices

Amidst rapidly changing conditions, many companies build ETL pipelines using ad-hoc strategy. However, this approach makes automated testing for data reliability almost impossible and leads to ineffective and time-consuming manual ETL monitoring. Software engineering decouples code dependency, enables automated testing, and powers engineers to design, deploy, and serve reliable data in a module manner. As […]

Read More
Career Livestream

From Student to Data Scientist

Today, I had the chance to speak with Supriya Sri about her work as a grad student in data science.

Read More