Data Engineer (f / m / x) (EN)

Job Description: Data Engineer (Databricks)

We are seeking a skilled Data Engineer with experience in Databricks and Apache Spark to join our team. The ideal candidate will have a strong background in Python programming, data warehousing, and cloud platforms.

Minimum Requirements:

1. 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark
2. Proficiency in Python, including data manipulation libraries (e.g., PySpark, Spark SQL)
3. Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, Delta Live Tables
4. Understanding of data warehousing principles, ETL/ELT processes, data modeling, and database systems
5. Experience with at least one major cloud platform (Azure, AWS, or GCP)
6. Strong SQL skills for data querying and analysis
7. Excellent communication skills in English and German (min. B2 level)
8. Ability to work independently and collaboratively in an agile environment

Responsibilities:

1. Design, develop, and maintain scalable data pipelines using Databricks, Spark, and Python
2. Create efficient ETL processes to ingest and transform data from various sources into cloud data lakes and warehouses
3. Utilize Databricks tools (SQL, Delta Lake, Workflows, Unity Catalog) to ensure reliable data workflows
4. Integrate with cloud services such as Azure, AWS, or GCP to develop secure and cost-effective data solutions
5. Participate in data modeling and architecture decisions for long-term data landscape maintainability
6. Ensure data quality and compliance with governance policies
7. Collaborate with data scientists and analysts to deliver actionable insights
8. Stay updated with the latest in Databricks, data engineering, and cloud technologies

Technologies:

• Azure, CI/CD, Cloud, Databricks, DevOps, Support, Machine Learning, Power BI, Python, PySpark, Spark, Terraform, Unity

Additional Information:

NETCONOMY has grown from a startup to a 500-employee company across Europe, emphasizing agile, cross-functional collaboration and diversity to create innovative digital solutions.

#J-18808-Ljbffr