Senior Data Engineer
Location: London
Type: Permanent

Required Background

10+ years' experience in Data Engineering, ideally within the insurance sector
Proven experience delivering enterprise data platforms and business-facing data products
Strong stakeholder management skills with the ability to work across business and technology teams
Experience working with underwriters, actuaries, or other business stakeholders
Strong understanding of data modelling, data governance, and Agile delivery methodologies
Excellent communication skills with the ability to explain technical concepts to non-technical audiences
Bachelor's degree in a technical, scientific, mathematical, or business-related discipline (or equivalent experience)

Technical Skills

Advanced SQL and PySpark
Azure Databricks and Delta Lake
Data lakehouse architectures and Medallion Architecture (Silver & Gold layers)
Data modelling and transformation design
Power BI reporting and dashboard development
Databricks Dashboards
Data quality management and troubleshooting
Semantic layer and consumption layer development
Azure data platform technologies
Agile/Scrum delivery practices
Version control and modern development workflows
Strong understanding of data governance principles

Nice to Have

Insurance industry experience, particularly specialty insurance, delegated authority, or large-risk environments
Databricks Unity Catalog
Experience with AI, LLMs, and Retrieval-Augmented Generation (RAG)
Databricks Genie experience
Dimensional modelling, including Star Schemas and Slowly Changing Dimensions (SCDs)
Databricks Certified Data Engineer certification
Microsoft Azure Data Engineer Associate certification

Key Responsibilities

Design, develop, and maintain data products within an Azure Databricks lakehouse environment
Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
Contribute to data modelling and architecture discussions
Investigate and resolve data quality and platform issues
Develop reporting and analytics solutions using Power BI and Databricks
Partner with business and technical stakeholders to deliver high-quality data products
Support code reviews, modelling reviews, and engineering best practices
Ensure solutions are scalable, reusable, and aligned with governance standards
Communicate technical solutions, trade-offs, and recommendations to stakeholders

By applying for this role, you consent to SGI contacting you by telephone regarding recruitment services, market updates, and relevant business opportunities

We believe in equal opportunity for all and actively encourage applications from diverse backgrounds, experiences, and perspectives.
Source Group International Ltd is acting as an Employment Business in relation to this vacancy

Senior Data Engineer

Job Description

Similar Jobs.