Job Description:

Data Architect (Databricks)

• Location: Remote (UK)
• Rate: £700 per day Inside IR35
• Duration: 12 months

Overview

We're looking for a hands-on Data Architect to design a scalable, secure data architecture on AWS, with Databricks as the central engine for all processing and transformation. Data models and tooling are already set, so this role is all about getting the most out of Databricks. You'll shape the technical design, set governance standards and mentor a team of experienced ETL engineers who are new to Databricks.

Key Responsibilities

• Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines
• Bring together source data from files and databases into a single AWS and Databricks platform
• Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture
• Make the right Databricks choices, including storage modes and compute cluster configuration
• Define governance standards, including roles and responsibilities across Databricks and downstream data users
• Work with other architects on best practice for data quality and observability
• Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns

Key Requirements

• Strong AWS experience
• Deep hands-on Databricks experience, including performance and cost optimisation
• Proven experience delivering Medallion architecture
• Strong ETL background
• Experience setting data governance standards
• Confident mentoring and upskilling engineering teams

Desirable

• Unity Catalog
• PySpark and Spark performance tuning
• Delta Lake
• Data quality and observability tooling
• Experience leading a team's move onto Databricks

Apply now or email for more information