Null
About Distillery
Distillery is a software development partner that helps organizations design, build, and scale modern technology solutions. Leading companies work with us to accelerate digital initiatives, solve complex technical challenges, and bring innovative products to market faster. Working as an extension of our clients' teams, we deliver lasting business value. Distillery is committed to diversity and inclusion. We embrace a dynamic and inclusive culture where you have the opportunity to continuously learn and grow.
About the Position
We are seeking a business-oriented Data Engineer with strong data modeling and Databricks expertise to embed within our client's data team. In this role, you will accelerate the migration of business logic from Power BI and Excel into a governed Databricks Lakehouse, working directly with business users to understand and reverse-engineer their existing reports. The ideal candidate combines hands-on engineering skills with the business fluency needed to rebuild, validate, and document critical metrics, while progressively transferring knowledge to the internal team.
Responsibilities
- Partner with business SMEs across the data team, finance, and other functions to understand existing reporting processes and the metrics that must be exactly correct.
- Reverse-engineer logic embedded in Power BI (DAX, semantic model relationships) and Excel-based workflows, tracing it back to silver and source layers.
- Design and build clean, well-modeled silver and gold/reporting layers in Databricks, applying medallion architecture and coding best practices.
- Pre-calculate and materialize logic in the data layer so the visualization layer serves small, fast, pre-validated datasets.
- Contribute to data governance using Unity Catalog, including access control and PII protection, and support GDPR/CCPA-aligned data handling.
- Build and maintain a data dictionary and semantic layer to support self-service and Genie/AI-assisted querying.
- Develop and optimize incremental pipelines, adding validation and reconciliation consistent with the team's existing practices.
- Support the onboarding of new data sources (e.g., Magento, CRM) into the platform.
- Pair with and upskill the client's internal engineers and analysts, documenting work to enable ongoing internal support.
Requirements
- Strong data modeling expertise, with the ability to assess whether an existing model reflects the single source of truth and to design the right model for performance and scale.
- Hands-on Databricks experience, including PySpark and SQL, notebooks, Delta Lake, medallion architecture, incremental processing, and Unity Catalog.
- Ability to reverse-engineer Power BI solutions, including reading DAX and semantic model relationships.
- Working knowledge of Power Query.
- Experience with the Azure data ecosystem (ADLS Gen2, Azure Synapse, Azure SQL / SQL Server).
- Demonstrated business fluency, with comfort working alongside non-technical users, eliciting requirements, and translating business needs into technical implementation.
- Experience implementing data governance and handling sensitive/PII data.
- Strong communication skills and a self-directed, ownership mindset suited to an embedded staff-augmentation role.
Nice to Have
- Experience building semantic layers and enabling natural language/LLM-based querying (e.g., Databricks Genie).
- Familiarity with AI-assisted development workflows (e.g., Claude, ChatGPT) for interpreting and rebuilding legacy logic.
- Exposure to Dynamics 365 F&O data structures and/or Synapse Link.
- Experience integrating ecommerce (Magento) and CRM data sources.
- Familiarity with GDPR/CCPA data handling requirements.
- Experience with data in retail, ecommerce, or consumer goods environments.
Why You'll Like Working Here
Join a global team committed to Distillery's core values: Unyielding Commitment, Relentless Pursuit, Courageous Ambition, and Authentic Connection.
- 100% Remote Work: Enjoy the freedom to work from anywhere while collaborating with a diverse, multinational team.
- Competitive Compensation: Generous and competitive package in USD, along with a comprehensive benefits plan.
- Flexible Hours: Create a schedule that aligns with your life and priorities.
- Home Office Setup: Receive all the hardware and software needed to succeed from home.
- Innovative Workplace: Collaborate with the global Top 1% of talent in a multicultural and dynamic environment.
- Focus on Growth: Pursue professional and personal development while contributing your unique talents to a team where you can truly shine!
#J-18808-Ljbffr
Data Engineer (Azure & Databricks) – LATAM in Hamm Arbeitgeber: Distillery
ITPS One ist ein hervorragender Arbeitgeber, der seinen Mitarbeitern die Möglichkeit bietet, an spannenden und innovativen Projekten zu arbeiten. Mit einer erstklassigen Gesundheitsversorgung, einem flexiblen Home-Office-Modell und umfangreichen Programmen zur persönlichen und beruflichen Weiterentwicklung fördert das Unternehmen eine positive Arbeitskultur, die auf Teamarbeit und individuellem Wachstum basiert. Die attraktive Vergütung und die exklusiven Mitarbeiterbenefits machen ITPS One zu einem idealen Ort für Fachkräfte, die eine sinnvolle und lohnende Karriere im SAP-Bereich anstreben.