Senior Data Engineer
Job Summary
We are seeking an experienced Senior Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures to support our organisation’s data\-driven initiatives. This role requires a strong understanding of big data technologies, cloud platforms, and database management systems. The Senior Data Engineer will collaborate with cross\-functional teams to optimise data processes and ensure the integrity and security of data assets. The position offers an excellent opportunity to work on innovative projects within a fast\-paced environment, leveraging cutting\-edge tools and technologies.
Responsibilities
- 10\+ years of experience in Data Engineering.
- Experience with streaming technologies such as Azure Event Hubs or Kafka.
- Experience with Power BI, Tableau, or other data visualisation tools.
- Knowledge of Docker, Kubernetes, Terraform, or related DevOps technologies.
- Experience within Financial Services, Banking, Economic Data, or Regulatory environments.
- Azure Data Engineer certifications (DP\-203 or equivalent).
- Minimum 3\+ years of hands\-on Azure Databricks experience.
- Strong expertise in Python, PySpark, Spark SQL, and SQL.
- Extensive experience with Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics.
- Strong understanding of Delta Lake architecture and Unity Catalog.
- Experience building and optimising large\-scale ETL/ELT pipelines.
- Hands\-on experience with Azure Purview, data governance, metadata management, and lineage.
- Experience with Azure DevOps, Git, and CI/CD implementation.
- Strong understanding of data warehousing, dimensional modelling, and data integration patterns.
- Experience with SQL and NoSQL databases.
- Strong analytical, problem\-solving, and communication skills.
- Experience working within Agile delivery environments.
Work Location: Hybrid remote in London
This listing is from indeed. View original listing ↗