Senior Engineer, Data Engineering

Freelance Data Engineer – Hedge Fund Frankfurt – 18 Month Contract I am supporting a leading hedge fund based in Frankfurt that is strengthening its Data Engineering capabilities. They are seeking a Freelance Data Engineer with expertise in Azure, Databricks, and Kafka for an 18-month engagement. Key Responsibilities Architect, build, and maintain scalable data pipelines and ETL/ELT frameworks using Azure Data Services, Databricks, and Apache Kafka Ingest and process large volumes of real-time and batch data from trading systems, market feeds, and internal applications Work closely with Quant Analysts, Traders, and Risk teams to design reliable and low-latency data solutions Optimize Spark-based workflows on Databricks and ensure seamless data integration across Azure Data Lake and downstream systems Implement data quality checks, lineage tracking, and real-time alerting to support regulatory and operational reporting Required Skills & Experience Solid experience as a Data Engineer using Azure (Data Factory, Data Lake, Synapse) and Databricks in enterprise-grade environments Strong programming skills in PySpark and SQL; familiarity with Scala or Java is a plus Hands-on experience with Kafka for real-time data ingestion and stream processing Deep understanding of distributed computing, data modeling, and data warehousing concepts Experience with CI/CD pipelines and infrastructure-as-code (e.g. Terraform, Azure DevOps) Logistics Location: Frankfurt am Main (Hybrid – 2–3 days onsite per week) Contract Length: 18 Months Start Date: Immediate availability preferred Hours: 40 hours/week (standard business hours) To Apply either drop me a DM on here or send you CV to will.childs@aifutures.group