Data Engineer

Summary

Andersen is hiring a Data Engineer for a project building scalable data platforms that support machine learning, AI solutions, and intelligent search technologies.

The customer is a technology company developing scalable software solutions for organizations across multiple industries. Its products help businesses improve operational efficiency, optimize workflows, and support digital transformation through modern technologies and data-driven approaches. The company focuses on delivering reliable, user-oriented solutions that enable customers to respond effectively to changing business and technology requirements.

The project is focused on developing machine learning solutions that power search ranking and personalized recommendations at scale. It includes building production-grade ML and LLM-based models, deploying them to production, and continuously optimizing performance through experimentation and data-driven evaluation.

Responsibilities

• Maintaining the data platform.
• Reviewing the overall architecture; rework data grains for efficiency; clear backlogged data tech debt.
• Reengineering the Redshift DWH — current 4-hour refresh cycle blocks customer-facing MCP/API access to quality intelligence.
• Rebuilding the central ingestion pipeline (today: manual SELECT statements pulled from a single Tests service).
• Updating DWH ingestion for the replacement of MariaDB SYSTEM VERSIONING with an app-level MySQL history schema (~75 versioned tables, 15 services).

Requirements

• Commercial experience in Data Engineering, 4+ years.
• Ability to work independently with minimal supervision in a single-owner environment.
• Experience re-architecting an existing production data warehouse with slow batch refresh cycles (not only greenfield projects).
• Experience identifying, assessing, and prioritizing technical debt in partially defined environments without a predefined backlog.
• Strong experience with Amazon Redshift, including schema design, distribution and sort keys, performance tuning, and refresh latency optimization.
• Expert-level SQL skills.
• Strong experience designing, rebuilding, and optimizing ETL pipelines.
• Experience working with MySQL as a source system.
• Hands-on experience with AWS services, including S3 and IAM.
• Level of English – from Upper-Intermediate and above.

Desired skills

• CDC / near-real-time ingestion.
• Pipeline orchestration tools (note: no orchestrator is named in client docs — Airflow from our table is unconfirmed).
• Understanding of MariaDB temporal tables (FOR SYSTEM_TIME queries — being retired).

Reasons to join us

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• Private health insurance and compensation for sports activities.

Join us!

Локації

Worldwide