Lead Data Engineer
Lead Data Engineer (Azure \| Databricks \| Fabric \| PySpark \| SQL)
Permanent \| Hybrid \| UK Public Sector Project
Overview
We are seeking a hands\-on Lead Data Engineer to join a growing Data \& Analytics practice. This role focuses on designing, building, optimising, and maintaining enterprise\-level data solutions.
You will work across the full data lifecycle, delivering scalable, high\-performance solutions using Azure and tools such as Databricks and Fabric.
Who We’re Looking For
A strong Data Engineer with deep technical expertise in Azure, Databricks and Fabric, who enjoys working in a collaborative, client\-facing environment and thrives at designing and delivering enterprise\-level data solutions, spanning initial requirements gathering, proof\-of\-concept development, architecture planning, deployment and delivery.
Key Responsibilities
- Develop solutions using Azure Databricks and/or Fabric
- Implement Medallion Architecture (Bronze, Silver, Gold)
- Develop data warehouse and lakehouse solutions
- Support BI, analytics, and AI workloads
- Optimise performance, cost, and reliability
- Collaborate with technical and functional stakeholders
- Proven ability to make both high\-level strategic and day\-to\-day operational decisions with confidence
- Strong leadership and interpersonal skills, with a track record of motivating and influencing stakeholders at all levels
- Sharp analytical mindset with the ability to proactively spot emerging opportunities and resolve challenges before they escalate
- Strong hands\-on experience with Azure Databricks and Fabric
- Strong SQL and data warehousing expertise
- Experience with data modelling
- Experience with Databricks AI/BI or Power BI
- Experience with CI/CD and DevOps practices
- Experience in consulting / professional services
- Exposure to AI and advanced analytics solutions
- Exposure to Agentic AI systems built on top of Large Language Models
- Experience with real\-time / streaming data
- Experience with Infrastructure as Code (Terraform or Bicep)
- Experience in regulated industries
- Passionate about staying at the forefront of industry developments, with a habit of actively monitoring emerging trends, tools, and technologies
- Databricks/Microsoft Azure certifications
- Strong problem\-solving skills
- Collaborative and team\-oriented mindset
- Clear communication and documentation skills
- Ability to work in fast\-paced delivery environments
- Role Type: Permanent \& Hybrid (2 days per week)
- Location: Guildford
- Clearance: Candidates must be eligible for UK Security Clearance (SC) or active SC
This listing is from indeed. View original listing ↗