Upsert Operation in Cosmos DB using Azure Data Factory

This article covers the basics of upserting data in CosmosDB using Azure Data Factory.

Mapping Data Flows in Azure Data Factory

This article helps to create a data flow in Azure Data Factory, add conditional split logic to the flow, and transfer data from a file to an Azure SQL Database.

ADF Checking the Starting String

String Together ADF Strings

Dynamically Add a Timestamp To Files in Azure Data Factory

This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]

Running SSIS in ADF

Reading Stored Procedure Output Parameters in Azure Data Factory

This article will help you to work with Store Procedure with output parameters in Azure data factory.

Migrating SSIS packages to Azure - Lift and Shift using Azure Data Factory

Unlike an on premises SQL Server, Integration Services (SSIS) works very differently on Azure. If there are requirements to run our existing SSIS packages on Azure, then we need to understand our options. In this article we will talk about our options for migrating SSIS to Azure and what components are required to migrate SSIS packages. […]

Using ADF to Upload Disparate CSV Files into Azure MySQL

In this article our objective is to showcase how to leverage Azure Data Factory (ADF) and a custom script to upload data in Azure MySQL database when we have CSV files with different schemas. As there is no straightforward way to upload data directly using ADF for this given scenario, it will actually help to […]

Azure Data Factory Pipeline Logging Error Details

In this article we will cover how to capture and persist Azure Data Factory pipeline errors to an Azure SQL Database table.