Job Description:

Azure Data Engineer
Location: Primarily Remote (Occasional travel to Mansfield)
Contract Length: 3 Months
Rate: £450 (Inside IR35)
 
We are seeking an experienced Azure Data Engineer to join a high-profile programme within the energy sector. This is an excellent opportunity to play a key role in designing, building and supporting a modern Azure data platform that enables secure, scalable and governed data solutions.
 
The Role
As an Azure Data Engineer, you will be responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks.
Working alongside data architects and engineering teams, you will help deliver new data products, onboard data sources and contribute to the ongoing data platform roadmap.
 
Key Responsibilities

• Build, operate and optimise an Azure data platform using Azure Databricks.
• Design and support Azure infrastructure for data storage, processing, integration and external data sharing.
• Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth.
• Develop and maintain data ingestion, transformation and data product pipelines.
• Collaborate with data architects and engineers to onboard new data sources and deliver business-critical data products.
• Support the ongoing development and delivery of the ATLAS data roadmap.
• Ensure solutions follow best practices for automation, Infrastructure as Code and CI/CD.

 
Essential Skills & Experience

• 5+ years' experience as an Azure Data Engineer.
• Strong experience with Azure Databricks.
• Azure Data Lake Storage (ADLS).
• Azure Data Factory (ADF).
• Python.
• SQL.
• Azure DevOps.
• CI/CD pipelines.
• Infrastructure as Code using Terraform and/or Bicep.
• Data governance, security and access control.
• Experience designing and supporting enterprise-scale Azure data platforms.