AI/ML, Azure, Cloud Computing, DevOps

3 Mins Read

How Artificial Intelligence / Machine Learning and DevOps Works Better Together

Machine Learning (ML) and Artificial Intelligence (AI) have extended their capabilities of software application that you can see throughout our daily life like banking services, face recognition, photo captioning and product recommendations, etc. The challenging part about integrating AI or ML into an application is not just the technology, the math, the science behind it or the algorithms. The challenge is to deploy the model into a production environment and keep it operated and supportive.

In the same way, DevOps has become the de-facto development standard for IT operations and Cloud services.  It places emphasis on process, automation and fosters a culture that encourages new ways of working together across teams.

For DevOps, it becomes essential to the IT operations to keep up with the pace, depth of the product and organization is working on. There must be software development teams who are familiar with the product flow, analytics, troubleshooting and must be able to figure out errors in the process and report accordingly.

Here, the challenge is to put human efforts to troubleshoot and finding issues.

But when it comes to putting the AI/ML and DevOps together to implement an application pipeline specific to AI/ML or to automate and wrap the application with good deployment practices, the implementation needs some effort to be successful.

How to integrate DevOps for AI/ML

Azure Machine Learning service provides customers with an asset such as management and orchestration services, enabling effective AI/ML lifecycle management. With this, the software development team can bring their Machine Learning models to production and solve their business key problems faster and more accurately than ever before.

How Artificial Intelligence / Machine Learning and DevOps Works Better Together

You can build a continuous integration pipeline for an AI application. In the above diagram, the pipeline for AI application picks the latest commit from the GitHub repository and the latest pre-trained Machine Learning model from the Azure Storage container. It stores the image in a private image repository on Azure Container Registry (ACR) and deploys it on a Kubernetes cluster running on Azure container service (AKS).

Azure Machine Learning service also provides a Cloud-based environment you can use to develop, train, test, deploy, manage and track Machine Learning models.

How Artificial Intelligence / Machine Learning and DevOps Works Better Together

Let’s have a look at how to build the Continuous Integration and Continuous Delivery pipelines for a Machine Learning project with Azure Pipelines.

We will use the Azure DevOps project to build and release pipelines along with Azure ML services for ML/AI model management and operation.

Before you begin

  1. You need a Microsoft Azure account to perform Azure labs. If you do not have one, you can sign up for a free trial.
  2. You will need an Azure DevOps If you do not have one, you can sign up for free here.
  3. Use Azure DevOps Demo Generator to provision the project on your Azure DevOps organization. This hyperlink selects the Azure Machine Learning template in the demo generator. This template contains the code and pipeline definition for a machine learning project explaining how to automate an end to end ML/AI project.

Exercise1: Configure CI Pipeline for AI/ML Project

In this exercise, you will configure the CI pipeline for the ML/AI project. This build pipeline includes model version management, model evaluation/selection, DevOps tasks for data sanity test, model training on different compute targets, etc.

The following are the steps performed in the CI pipeline:

 Exercise2: Configure CD Pipeline for ML/AI Project

 In this exercise, the Release Pipeline will be configured. The image created from the build pipeline will deploy to Azure Container Instance and Azure Kubernetes Services.

The following are the steps performed in the CD pipeline:

Exercise3: Update the Config file in the source code to trigger CI and CD

 Navigate to Repos. Open the config.json file from the folder aml_config/ and update your Azure subscription ID. After commit, since we have enabled CI trigger, a build will be queued automatically.


To know more about Azure Machine Learning and DevOps courses, kindly visit:

Feel free to post your comments in the comment section below.

Voiced by Amazon Polly


CloudThat is a leading provider of cloud training and consulting services, empowering individuals and organizations to leverage the full potential of cloud computing. With a commitment to delivering cutting-edge expertise, CloudThat equips professionals with the skills needed to thrive in the digital era.



  1. Brij Bhushan

    Feb 23, 2022


    Machine learning is the coolest field to build a better career. I was looking for some point which help me to become a machine learning engineer. After reading your blog every picture become clear in my mind. Now I can design my career path. Thank you for best career advice. Your blog have fabulous information.

  2. Bhavani

    May 19, 2021


    nice information

  3. social prachar10

    May 19, 2021


    Good article sir

  4. Bhavani

    Apr 14, 2021


    I really like when people are expressing their opinion and thought. So I like the way you are writing

  5. DevOps Training In Hyderabad

    Nov 17, 2020


    nice post

  6. Kirti

    Oct 14, 2020


    Very useful exercises

  7. Anusha

    Sep 30, 2020


    Great article. Lot of interesting material available for AI enthusiasts

    • Anjali Srivastava

      Oct 5, 2020


      Thanks, Anusha.

    Click to Comment

Get The Most Out Of Us

Our support doesn't end here. We have monthly newsletters, study guides, practice questions, and more to assist you in upgrading your cloud career. Subscribe to get them all!