Описание:
As a Principal Data Engineer in our team, you will serve as the data architecture, data modeling, and engineering backbone that powers our analytics, statistical modeling, and data-driven products. You will transform complex, high-volume upstream datasets, including event tracking, into clean data layers utilized directly by Applied Scientists and Analysts. Your work will bridge the gap between raw data streams and production execution, translating complex upstream event signals into high-impact modeling inputs.
Задачи:
Identify relevant tracking events across complex streams, making intentional data modeling choices to build high-quality, standardized, and well-documented data products for downstream scientists and analysts. Partner directly with Applied Scientists to transform model prototypes (statistical or ML) into robust, maintainable, and low-latency production pipelines. Lead data modeling strategy across production datasets and model pipelines, making critical structural and schema decisions to ensure long-term performance, correctness, and maintainability. Design, build, and optimize pipelines, establishing rigorous standards for data quality, testability, monitoring, and pipeline health. Set engineering standards, mentor team members, and drive large-scale data architecture initiatives across multidisciplinary teams.
Требования:
You have a Bachelor's, Master's, or equivalent practical experience in Computer Science, Data Engineering, Software Engineering, or a related quantitative field with 6+ years of relevant industry experience. You have led the design of pipelines or data platforms that several teams use, and can show measurable gains in reliability or cost. You have proven experience operationalizing prototype models developed by Applied Scientists into production execution environments. Strong Pyspark, Python and SQL skills, including maintainable code, software design principles, unit testing, debugging, and code reviews. Proven experience building and operating data pipelines, covering batch processing and real-time or streaming workloads, using technologies such as Apache Airflow, Apache Spark, and Apache Flink or equivalent frameworks. Strong understanding of databases, data modeling, distributed processing, and query and storage performance optimization. Experience operating production data pipelines, including monitoring, alerting, incident management, root cause analysis, and reliability and cost optimization. Hands-on CI/CD and cloud infrastructure, ideally AWS. Experience with statistical data modeling
Условия:
- 27 days of holiday a year to start for full-time employees (+1 day for every calendar year up to 30 days)
- 40% off fashion and beauty products sold and shipped by Zalando
- 30% off Lounge by Zalando
- discounts from external partners Family support, including counselling and dedicated services for parents and carers
- Company pension scheme
- Employee shares programme
- Health and wellbeing options, including Wellhub Mental health support and coaching
- Development through our training platform and biannual peer-to-peer review
- 2 paid volunteering days a year
- Relocation assistance (subject to prior agreement)
#J-18808-Ljbffr
Data engineer in ranking and visibility in Berlin Arbeitgeber: Zalando
Zalando ist ein hervorragender Arbeitgeber, der seinen Mitarbeitern in Hamburg nicht nur ein modernes und inspirierendes Arbeitsumfeld bietet, sondern auch zahlreiche Vorteile wie 27 Urlaubstage, Rabatte auf Modeprodukte und eine Vielzahl an Weiterbildungsmöglichkeiten. Unsere offene und inklusive Unternehmenskultur fördert Teamarbeit und persönliche Entwicklung, während wir gemeinsam daran arbeiten, die Welt nachhaltiger zu gestalten. Werde Teil eines dynamischen Teams, das Kreativität und Innovation schätzt und erlebe, wie dein Beitrag direkt zum Erfolg unserer Outlet Stores führt.
