Data Engineer (m/f/d)

Job Responsibilities

1. Develop a Modern Azure Data Platform: Design, build, and optimize end-to-end data solutions with Azure Data Factory, Azure Data Lake Storage, Databricks, and Azure Synapse Analytics.
2. Create Data Pipelines: Conceptualize and manage scalable ETL/ELT processes in PySpark and Spark, focusing on data quality and reliability.
3. Real-Time Data Capture: Implement pipelines that capture source system changes in real time, handling Slowly Changing Dimensions to maintain accurate historical data.
4. Integrate New Technologies: Stay updated on the latest trends in Cloud Data Engineering, Big Data, and Analytics, integrating relevant tools for better performance, cost-efficiency, and scalability.
5. Efficient Reporting with Power BI: Collaborate with BI teams to optimally structure large data models and develop impactful dashboards.
6. Data Governance and Compliance: Ensure compliance with data protection regulations and internal security policies, establishing best practices for metadata management, data lineage, and access controls.

#J-18808-Ljbffr