Automate the Process for Reading and Writing Data in Azure Storage Account Gen2 with Azure Data bricks

Author – Ayush Chauhan, Associate Data Engineer INTRODUCTION In this article, we will learn how we can load multiple files from a storage account and how to transform data back to it and azure database, along with how to automate this whole process, so one didn’t have to change any variables or write any extra…

Data Migration Assistant

Have you ever been in a situation where migration became an issue for you? I was in a fix whether how one should migrate only the schema part, In such cases one can use the tool known as Data Migration Assistant. The Data Migration Assistant (DMA) helps you upgrade to a modern data platform by…

Data Migration Service – Part 2

Offline Migration Migration Steps (SQL Server to Azure SQL Database) Prerequisites: Create a Vnet for DMS Vnet’s nsg should not block communication ports 443, 53, 9354, 445, 12000 Configure your windows firewall open port 1433 If you’re running multiple named SQL Server instances using dynamic ports, you may wish to enable the SQL Browser Service…

Data Migration Service – Part 1

Online migration Migration Steps (SQL Server to Azure SQL Database) Prerequisites: Create a Vnet for DMS Vnet’s nsg should not block communication ports 443, 53, 9354, 445, 12000 Configure your windows firewall open port 1433 If you’re running multiple named SQL Server instances using dynamic ports, you may wish to enable the SQL Browser Service…