For a long time, we’ve all had to make do with several workarounds for integrating Databricks into our application lifecycle — syncing single notebooks, or pulling down entire directories via the CLI, a very manual process.
This week, Databricks released “Repos for Git”, which allows for whole repositories to be cloned and managed within the Databricks workspace.
In today’s video, Simon takes a look at how you enable the repos preview and follows a simple feature branching workflow – adding a notebook, updating a notebook and following the pull request back into our primary collaboration branch.
For more info on the repos release, check it out here: https://docs.databricks.com/repos.html k
In this episode, Abel and Damian talk about why DevOps is important for on prem applications. They’ll walk through creating a CI/CD pipeline for our VM-based application and database using Azure Pipelines and GitHub Actions.
- [00:53] Why do we even bother with DevOps?
- [01:49] Where do we start?
- [02:36] Demo: Creating a Pipeline in Azure Pipelines
- [06:30] Building our artifacts
- [07:15] Configuring environments
- [10:05] Deploying to environments
- [13:29] Doing it in GitHub Actions
- Create and Target an Environment in Azure Pipelines https://aka.ms/DevOpsLab/AzurePipelinescreate
- Environments in GitHub Actions: https://aka.ms/DevOpsLab/GitHubActionsEnv
- MS Learn: Create a Build Pipeline with Azure Pipelines: https://aka.ms/DevOpsLab/LearnAzurePipelines
- MS Learn: Automate your workflow with GitHub Actions: https://aka.ms/DevOpsLab/LearnGHActions
- Subscribe to Azure DevOps YouTube channel
TechWorld with Nana explains how Fluentd simplifies collecting and consuming logs.
In this episode of DevOpsLab, Abel and Dan discuss the different integration points between Azure Boards and GitHub.
We will answer the questions of: Why use Azure Boards for planning and GitHub for code? What are the benefits of using them both together and what is the Azure Boards App in GitHub? What problem does it solve? What are the open source actions for and how to use them?
TechWorld with Nana provides us with a DevOps Roadmap for 2021.
TechWorld with Nana shows us around the basic concepts of GitHub Action and more in this video tutorial.
Data & ML projects bring many new complexities beyond the traditional software development lifecycle.
Unlike software projects, after they were successfully delivered and deployed, they cannot be abandoned but must be continuously monitored if model performance still satisfies all requirements.
Furthermore, we can always have new data with new structural and/or statistical characteristics that can break our pipelines or alter model performance.
During this webinar Emanuele Viglianisi, Data Engineer at Runtastic will show how Runtasic is using CI/CD templates during their day to day development to run, test and deploy their pipelines directly from PyCharm IDE to Databricks.
Emanuele will present the challenges Runtastic has faced and how they successfully solved them by integrating the CI/CD template in their workflow.
In this episode of CodeStories, Sherry List, Azure Developer Engagement Lead, visits Marilag Dimatulac, a Filipina tech entrepreneur living in Copenhagen. Marilag give us a tour around her home and shares her story, to inspire us to become happy developers.
She also gives us an insight on what she does as a cloud architect, including designing event driven applications and increasing developer velocity through devops practices