Lead Data Engineer

Do you love working with new, cutting-edge technologies within Advanced Analytics, Big Data and Cloud?

Big data and machine learning already contribute to our operations and drive fact-based decision making along the value chain. The Lead Data Engineer will be a part of the H&M Advanced Analytics Landscape team, which works across business and IT developing a big data platform supporting AA projects, from proof-of-concept to production. We work in an autonomous and agile way, following a try-fail-fast approach, and using a variety of technologies, such as Hive, Spark and Airflow. We continuously develop the data platform, focusing on enabling business solutions using algorithms and on executing them at scale.

Your role
We offer you an inspiring and diversified job, in which your effort and your solutions will directly drive business results. Expect an exceptional learning opportunity and to be part of a high-paced team characterized by continuous improvement.

Your work tasks will include:
• Architect and implement data structures and big data workflows, required for fast delivery of AA projects
• Setup data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages etc.)
• Lead a team of data engineers by setting standards, providing guidance and shaping the roadmap for the data platform
• Coordination with other teams to design optimal patterns for data ingest and egress
• Pro-actively and continuously learn new technologies, assessing their maturity and fit to our roadmap
• Design and build solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations
• Collaborate with data scientists and provide (data engineering) expertise on both the design for new solutions and possible optimizations for existing solutions to reach industry scale
• Align with Infra & DevOps team regarding new releases and upgrading of cloud-based data platform
• Ensure best practices are followed across architecture, codebase and configuration

What we are looking for:
• You are a team player, solution-driven and open-minded, with a passion for continuous improvement and automation
• Experience building complex data pipelines using workflow management tools like Airflow or Luigi
• Solid track record in data engineering in BI or AA environments, including building data platforms on Hadoop and Spark
• Proficiency in at least Python, bash and SQL, and experience in a range of data management technologies, such as NoSQL and distributed systems. Knowledge of Java is a plus.
• Experience with version control workflows with Git and an advocate of Continuous Integration.
• Experience with designing and architecting cloud-based data solutions (Azure, AWS or GCP)
• You are comfortable managing releases to a production environment
• Solid software architecture skills, keen to leverage patterns to write code which is resilient, scalable, and maintainable
• See yourself as a technical leader, who can define and communicate best practices, and who does not shy away from providing guidance and constructive feedback

Vilka är vi på IT?
Vi är summan av det vi kan och de personligheter vi är. Vår varma värderingsstyrda kultur är kittet som håller oss samman. Vi gillar att jobba snabbfotat, tar beslut i farten och vår kreativitet hjälper oss lösa komplexa utmaningar.

Vi får möjlighet att driva på H&M-gruppens affär, jobba med den senaste IT-teknologin i spännande globala projekt, och vi är med och förändrar hela mode- och designbranschen till det bättre. Har du drivet, upptäckarglädjen och viljan att ta ansvar finns ingen gräns för vad vi kan uppnå tillsammans.