Integrating Azure DevOps CI/CD pipeline with


Khalid Ansari

June 14, 2021

4 Min


Integrating your application with involves the following 3 things:

  1. Sending your logs to, covered in other blog posts
  2. Letting know when you successfully complete a build and when you deploy the build to an environment, covered in this blog post
  3. Integrating with your ticketing system so that can pull your ticket data and add tickets to your ticketing system, covered in other blog posts

If you do all 3 of these things you will be able to leverage the full AI powered capabilities of to help you find quick resolutions to the problems plaguing your application.

The following sections show you how to set up Azure DevOps Pipelines and Releases to let know when your builds and deployments are successfully completed.

Difficulty 1: Raw errors are bulky and messy

To let railtown know when a build successfully completes you need to create a new Service hook under Project Settings

Choose the Web Hooks service

Choose the Build completed trigger, your Build pipeline and a Build Status of Succeeded

Go to your Project settings CI/CD section and expand the Azure DevOps CI/CD section

Copy the Build Webhook

Paste the Build Webhook into the Azure DevOps service hook URL

Choose 2.0-preview.2 for the Resource Version and Finish creating your service hook

Congratulations you have successfully integrated your builds with

Next time you do a build will be informed of the successful build.

Let know when a build is deployed to an environment

Create a Service Connection

To let railtown know when a build is deployed successfully to an environment you first need to create a new Service connection under Project Settings

Choose the Generic service connection type

Go to your Project settings CI/CD section and expand Azure DevOps CI/CD section and scroll down to the Deployment Integration section

Copy the Deployment Webhook URL

Paste the Deployment Webhook URL into the Server URL field in the New Generic service connection, enter a Service connection name and click Save

Create a Release Post-deployment Gate

Next we are going to add a post-deployment gate to your release pipeline. Edit your release pipeline  and click the icon to the right of your pipeline stage, turn on the switch for Gates, click the Add button and choose Invoke REST API

Go back to your project configuration as you will need to copy the Headers and Body content. Before copying the Body content ensure you have selected the correct environment for your application

Go back to your post-deployment gate setup and choose Task version 1.*, enter a Display name, select the service connection you created earlier and paste in the Headers you copied from the configuration

Next copy the Body from the configuration ensuring that you selected the environment that matches with your pipeline deployment

Click the Save button.

Repeat the above steps for creating the post-deployment gate above for any other environments in your pipeline.

Congratulations you have successfully integrated your deployments with

Next time you release a build to an environment will be informed of the successful deployment to that environment.

The Builds page in will show you which builds are deployed to which environments.

To get the full AI powered capabilities of working for you make sure you also integrate your ticketing system so that can look at the logs coming in from your environments, bucket them into similar exception buckets, match them with the build deployed to that environment and then match it with tickets that may have resulted in causing the problem.

If you don’t already have a account sign up and let us help you improve the quality of your software and increase your developer velocity.

Keep reading

Root CauseHow AI Can Detect Software Bugs and Root Cause Analysis

Software bugs can be a significant source of frustration for developers and users alike. These errors in code can lead to crashes, data loss, and other issues that can negatively impact the user experience. Identifying and resolving software bugs is crucial for ensuring the quality and reliability of software applications. Artificial intelligence (AI) advances have made it possible to detect and diagnose software bugs more quickly and accurately than ever before


Marwan Haddad

March 29, 2023

5 Min


AppInsightsHow AI Can Help Your Company Save Time on Creating Release Notes

With our Release Notes solution, you can save time for your team by generating all of your release notes automatically. What’s more, our product will give you the freedom of choosing the final format for all of your release notes, be it a summary, a short list, or a full page.


Marwan Haddad

February 6, 2023

3 Min


Root CauseMachine Learning for Solving Root Cause Application Errors & Failures

In today's world, even a single application error could have significant consequences for both businesses and individual developers. From lost revenue and damaged reputation to disrupted services and frustrated customers, the cost of not addressing bugs in your code can be quite high.


Marwan Haddad

January 18, 2023

5 Min