Lead Data Engineer

Summary

Andersen is hiring a Lead Data Engineer for a project building a scalable enterprise data and analytics platform and modernizing financial reporting capabilities.

Our customer is an established financial services provider offering a range of solutions designed to support individuals and organizations with long-term financial planning and investment needs. The company combines industry expertise with modern technology to deliver reliable, customer-focused services and simplify complex financial processes. By continuously developing its digital capabilities and service offerings, the organization aims to improve customer experience, operational efficiency, and accessibility while supporting sustainable long-term financial outcomes.

The project is focused on modernizing retail technology and establishing a secure, scalable, and governed enterprise data and analytics platform. It aims to transform reporting capabilities, integrate key data sources, and support regulatory and operational reporting, advanced analytics, data migration, and future strategic data products.

Responsibilities

• Leading the design, development and operationalisation of scalable data engineering solutions for the Sunrise programme.
• Designing, developing and operationalise scalable data engineering solutions for the Sunrise programme.
• Contributing to the design and implementation of the new data platform supporting Sunrise, working directly with the client's architects and Principal Data Engineer.
• Designing and implementing robust data ingestion pipelines from Sapiens, IRIS and other enterprise source systems.
• Developing scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Microsoft Fabric.
• Building and maintaining data solutions across Azure Data Lake and modern cloud data platforms.
• Implementing medallion architecture and reusable data engineering patterns, using Data Vault modeling for Bronze/Silver and Kimball dimensional modeling (star schema, including fact-table variants and bridge tables) for Gold/reporting.
• Developing curated datasets, analytical data products and trusted business views.
• Implementing data transformation, cleansing, validation and reconciliation processes.
• Supporting source-to-target data integration as Sapiens replaces IRIS as the line-of-business system — this is new-build integration work, not a migration of the existing data engineering framework.
• Working closely with Business Analysts, Data Analysts, Data Architects, the client's Principal Data Engineer and other engineering teams to translate requirements into production-ready data solutions.
• Ensuring data pipelines and data products meet requirements for scalability, reliability, performance, security and data quality.
• Implementing automated data quality and validation checks across pipelines and datasets.
• Supporting regulatory and operational reporting capabilities (including reinsurance extracts and the valuation system feed) and ensure data is accurate, complete and traceable.
• Implementing monitoring, logging and operational controls for data pipelines and platform services.
• Contributing to CI/CD and DevOps practices using Azure DevOps (primarily a Lead Data Engineer responsibility — see below).
• Supporting engineering automation for pipelines and code generation where appropriate; infrastructure-as-code is owned by a dedicated Platform Engineer, not this role.
• Developing reusable frameworks, components and engineering standards to accelerate delivery across the programme — this is a core focus of the engagement, given the current framework needs a full redesign.
• Contributing to data governance, lineage, metadata and security requirements, including handling of PII within a secured/obfuscated access-controlled layer.
• Working with platform and architecture teams to ensure new data platform solutions align with enterprise architecture and governance standards.
• Exploring and implementing AI-enabled approaches to data engineering and SDLC automation.
• Supporting the development of data foundations required for future AI and agentic AI use cases (the client already runs a production LLM/data-agent on a separate dataset and wants a similar capability here).
• Participating in technical design, code reviews, troubleshooting and production support activities.
• Mentoring other engineers and contributing to engineering best practices within the Data Team.
• Setting engineering patterns and standards.
• Working directly with the client's architects and Principal Data Engineer.

Requirements

• Commercial experience in Data Engineering for 6+ years.
• Experience having designed a similar greenfield data-platform framework.
• Strong, hands-on Azure DevOps experience is required for this role specifically — YAML pipelines, CI/CD pipeline design.
• Strong hands-on experience designing and developing enterprise-scale data pipelines and data platforms.
• Strong experience with Microsoft Azure data services.
• Advanced hands-on experience with Azure Databricks and Apache Spark.
• Strong experience with Azure Data Factory.
• Practical experience with Microsoft Fabric and modern cloud analytics platforms.
• Experience working with Azure Data Lake / cloud data storage.
• Strong SQL skills and experience working with relational and analytical data.
• Experience with ETL/ELT development and data integration patterns.
• Strong understanding of medallion architecture and modern data platform design.
• Familiarity with Data Vault and Kimball dimensional modeling methodologies — not required to be a dedicated data modeler, but comfort working within both patterns is valued.
• Experience designing scalable, reusable and production-ready data engineering frameworks, ideally including greenfield (build-from-scratch) framework design, not only extending existing conventions.
• Experience with data quality, validation, reconciliation and monitoring.
• Experience with CI/CD and DevOps practices, preferably using Azure DevOps.
• Understanding of data governance, metadata, lineage, security and access control.
• Experience working in Agile delivery environments.
• Strong problem-solving and analytical skills.
• Ability to work effectively with Business Analysts, Architects, Data Analysts and other technical stakeholders.
• Associate certification strongly preferred — explicitly raises screening priority with this client.
• Level of English – from Intermediate+ and above.

Desired skills

• Experience with Microsoft Fabric Data Factory, Lakehouse and/or Fabric Data Engineering.
• Experience with Sapiens or similar core enterprise/business systems.
• Experience supporting migration from legacy reporting platforms to modern cloud data platforms.
• Experience in Retail, Financial Services, Insurance or other regulated industries.
• Experience with regulatory reporting and audit requirements.
• Experience with Data Mesh or enterprise data platform implementations.
• Experience with event-driven or real-time data integration.
• Experience with AI-assisted software engineering or agentic AI solutions.
• Experience integrating AI tooling into requirements, coding, testing, documentation or deployment processes.
• Experience with infrastructure-as-code and cloud automation.
• Experience with Power BI or other enterprise BI/semantic modelling technologies.

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 EUR per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• Private health insurance and sports compensation, depending on the type of employment.

Join us!

Lokalizacje

Albania, Austria, Belgium, Bosnia and Herzegovina, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Hungary, Italy, Kosovo, Latvia, Lithuania, Luxembourg, Norway, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, Switzerland, The Netherlands, The United Kingdom of Great Britain and Northern Ireland