Machine Learning Engineer — Distillation

This position is listed on behalf of a partner company, who manages all applications and next steps.

Our partner is looking for a Machine Learning Engineer — Distillation based in Germany.

This role offers the opportunity to advance the efficiency and scalability of next-generation machine learning systems.

You will work at the intersection of research and production, transforming cutting-edge model optimization techniques into real-world solutions.

The position focuses on building smaller, faster, and more cost-effective AI models while maintaining high-quality performance.

You will design advanced distillation pipelines, run large-scale experiments, and contribute directly to production systems.

This is an opportunity for an ML engineer who enjoys deep technical challenges, experimentation, and practical innovation.

You will join a collaborative environment where your work directly influences model quality, performance, and product impact.

Accountabilities

As a Machine Learning Engineer focused on Distillation, you will design, develop, and optimize machine learning systems that improve model efficiency without compromising performance.

You will combine research expertise with engineering execution to build scalable AI solutions.

• Design and implement advanced knowledge distillation pipelines, including teacher-student approaches, self-distillation, and multi-teacher architectures.
• Distill large foundation models into smaller, faster, and more efficient models optimized for production inference.
• Run large-scale machine learning experiments to evaluate model quality, latency, efficiency, and cost tradeoffs.
• Analyze experimental results and use insights to improve model performance and optimization strategies.
• Collaborate with research teams to transform emerging distillation techniques into reliable production-ready implementations.
• Optimize training and inference performance, including memory usage, throughput, latency, and computational efficiency.
• Develop and improve internal tools, evaluation frameworks, and experiment tracking systems.
• Contribute to improving machine learning workflows and engineering best practices.
• Explore opportunities to contribute to open-source models, research initiatives, or technical tooling.

Requirements

The ideal candidate is a machine learning engineer with strong experience in deep learning, model optimization, and production-oriented AI development.

You should have hands-on experience with distillation techniques and the ability to balance research innovation with practical engineering delivery.

• Strong background in machine learning, deep learning, and neural network architectures.
• Hands-on experience implementing model distillation techniques for large language models or other neural networks.
• Solid understanding of training dynamics, optimization methods, loss functions, and model evaluation.
• Experience working with Py Torch, JAX, or similar modern machine learning frameworks.
• Experience running experiments in multi-GPU or distributed training environments.
• Ability to evaluate and optimize tradeoffs between model quality, performance, latency, and cost.
• Strong programming and software engineering skills with the ability to build production-ready ML systems.
• Practical mindset focused on shipping impactful solutions rather than only theoretical research.
• Experience with inference optimization techniques such as quantization, pruning, or kernel optimization is a plus.
• Familiarity with language model evaluation methodologies is preferred.
• Open-source contributions, research publications, or experience in fast-moving startup environments are considered valuable.

Benefits

• Competitive compensation package with meaningful equity opportunities.
• Opportunity to work on core machine learning systems that directly impact product performance and efficiency.
• High ownership role with significant influence over technical direction and roadmap.
• Collaboration with a small, senior team combining research expertise and engineering excellence.
• Remote-friendly work environment with an async-first culture.
• Opportunity to solve challenging AI optimization problems at scale.
• Ability to contribute to advanced model development and emerging AI technologies.
• Fast-paced environment that encourages innovation, experimentation, and technical growth.

How Jobgether works

We use an

AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements.

Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company.

The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice

By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer.

This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR).

You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information.

These tools assist our recruitment team but do not replace human judgment.

Final hiring decisions are ultimately made by humans.

If you would like more information about how your data is processed, please contact us.