Azure CSP

Introduction

When deploying the Azure CSP Extraction template for Exivity, some configuration is required within your Microsoft Cloud Solution Provider Potal. The following process must be completed in order to report on Azure CSP consumption:

  1. Create a Partner Center Web Application

  2. Configure Extractors for Azure CSP Usage, Billing & Ratecard

  3. Configure Transformers

  4. Create your Report

  5. Create your Workflows

It is necessary to create independent Extractors/Transformers for the Usage and Billing, the Usage Extractors will be retrieving the data on a daily basis giving an estimation of your daily costs. The Billing Extractor will consolidate the rates based on the blended costs per service for the billing period.

Create a Partner Center Web Application

Perform the following to create the Azure AD configured to access the Partner Center API

  • Browse to Partner Center, https://partnercenter.microsoft.com, and login using credentials that have admin agent and global admin privileges

  • Click on the following Dashboard –> Account Settings –> App Management

  • Click Add key to create a new Application Key for you App ID that can be used with Exivity.

Make sure to write down the App ID and its corresponding Key, since you will need these when configuring the Extractor later.

  • Go to the Billing section.

  • Open the last month's invoice in pdf format.

  • Take note of your billing period

Make sure to write down the billing period, since you will need it when configuring the Extractor later.

Configure Extractors for Azure CSP Usage, Billing & Ratecard

Go into the Exivity GUI and browse to Data Sources -> Extractors. Then click on Create Extractor and you should get a list of templates. Unfold Azure CSP and pick the AzureCSP_Extractor template:

After selecting the template, click the green Create button on the bottom right. Now make sure to give the new Extractor a name in field at the top:

Provide a name for the new Extractor

Now click again on the green Create button at the bottom right. Then click on the Variables menu item:

Fill in your Microsoft CSP connection details

Now make sure to fill in your Client ID, Secret and your onmicrosoft.com domain. When required, you can encrypt security sensitive field using the lock button on the right of each field. Once you are filling in these details, click the Update button.

Fill in “yes” for the items you would like to extract. For the other options fill in “no”

Now test the Extractor by going into the Run tab and providing a from and to date like in this example:

Provide a FROM and TO date in the Run tab

Now click the Run Now button and confirm it works as expected:

View Extractor execution results

The deployment of the AzureCSP-Extractor is completed!

Configure Transformers

Once you have successfully run your AzureCSP-Extractor, you can create the Transformers templates via Data Sources -> Transformers in the Exivity GUI. Browse to this location and click the Create Transformer button. You will need to create two separate transformers using these two templates:

The Azure_CSP_Daily-Usage Transformer will transform the daily usage data and the Azure_CSP_End-of-Month Transformer will consolidate the usage with the final blended rates.

The AzureCSP_Transformer will transform the daily recorded usage data combined with Microsoft’s general Ratecard to create an Estimated price for the service till it can be rerun based on the tenants own bill.

The AzureCSP_Create_invoiceRatecard will create a custom “Tenant/Service” related ratecard that is automatically used by the AzureCSP_Transformer to contain the correct pricing information.

Make any changes that you feel necessary and then select the Run tab to execute it for a single day as a test.Make sure that when running the Transformer you select custom range in the drop-down menu labelled Run for and select the same day as for which you have extracted consumption data in the previous step.

Create a Report

Once you have run both your Extractor and Transformer successfully create a Report Definition via the menu option Reports > Definitions:

Creating a Report Definition

Select the column(s) by which you would like to break down the costs. Once you have created the report, you should then click the Prepare Report button after first making sure you have selected a valid date range from the date selector shown when preparing the report.

Prepare your Report

Once this is done you should be able to run any of Accounts, Instances, Services or Invoices report types located under the Report menu for the date range you prepared the report for.

Create your Workflows

You may want to automate the CSP ETL process, you can achieve it by leveraging on the Exivity's Workflow capabilities. You will create two Workflows, one will run on a daily basis calculating the usage of your CSP subscriptions and the other one will run on a monthly basis to consolidate the service rates.

Start by browsing to Administration -> Workflows in the Exivity GUI and click on the +Create button.

Fill the Name and Description fields, in the SCHEDULES section configure the workflow to run on a daily basis at a convenient time.

In the STEPS section you can create as many steps as needed by adding them with the + button. For this workflow 4 steps are required for autonomous execution (As shown above).

For systems with less performance, it is an option to split the month Reconciliation from the daily Transformation. The first Workflow that is required is as follows:

This can be pared with a Monthly reconciliation workflow that is configured as the following:

Congratulations on deploying your Azure CSP ETL!