Azure Data Engineer / London / £85,000 + Bonus / Hybrid
We're working with a global media organisation who are seeking an Azure Data Engineer to join their Data and Analytics team.
In this role, you will design, develop, and implement data migration solutions, focusing on migrating data from existing Big Data platforms into Dynamics 365, Data Verse, and other Azure environments. You will lead the transition from traditional code-based ETL processes to modern Azure Cloud Computing solutions, aggregating data from various sources including SaaS platforms.
Your expertise will be critical in building robust data pipelines using Azure Data Factory, Azure Functions, Logic Apps, and SSIS with KingswaySoft. You will manage infrastructure provisioning using Terraform and maintain codebases with Git. Collaboration with cross-functional teams such as IT, marketing, and customer success will be essential to understand data requirements and deliver innovative solutions.
Additionally, you will implement CI/CD pipelines via Azure DevOps to automate deployments, monitor and optimise data workflows for scalability and reliability, and ensure data consistency and quality throughout integration processes.
• Proficiency in Azure Data Factory, Azure Functions, Logic Apps, Fabric, and Data Verse
• Experience with data migration and integration from Big Data platforms to Azure environments
• Infrastructure as Code (IaC) using Terraform
• Version control using Git
• Implementation of CI/CD pipelines with Azure DevOps
• Strong understanding of data integration techniques and best practices
• Excellent problem-solving and communication skills
• Collaboration with cross-functional teams
• Experience with Dynamics 365 (D365) and Microsoft Power Platform
