AI Researcher — Inference Optimization

This position is listed on behalf of a partner company, who manages all applications and next steps.

Our partner is looking for a AI Researcher — Inference Optimization based in Germany.

This role offers the opportunity to advance the performance of large-scale machine learning models through cutting-edge inference optimization research.

You will work at the intersection of AI research, model architecture, systems engineering, and hardware-aware optimization.

Your work will directly influence latency, throughput, memory efficiency, and the cost of running sophisticated AI workloads.

You will design and evaluate innovative optimization techniques and translate research findings into production-ready systems.

The role combines hands-on experimentation with close collaboration across research and engineering teams.

You will benchmark inference workloads across modern hardware accelerators and identify opportunities for measurable performance gains.

This is an impactful opportunity to help shape efficient, scalable AI infrastructure for real-world production environments.

Accountabilities

• Research and develop advanced techniques to improve inference performance for large neural networks and machine learning models.
• Optimize key performance dimensions including latency, throughput, memory efficiency, and cost per inference.
• Design and evaluate model-level optimization techniques such as quantization, pruning, KV-cache optimization, and architecture-aware simplification.
• Implement systems-level optimizations including dynamic batching, kernel fusion, multi-GPU inference, and prefill versus decode optimization.
• Benchmark and profile inference workloads across different hardware accelerators to identify performance bottlenecks and optimization opportunities.
• Collaborate closely with engineering teams to integrate optimized inference techniques into scalable production pipelines.
• Translate research findings and experimental results into reliable, production-ready improvements.
• Establish clear benchmarks, document findings, and communicate results to inform technical and product decisions.
• Explore emerging approaches such as long-context inference, speculative decoding, KV-cache compression and paging, efficient decoding strategies, and hardware-aware inference design.

Requirements

• Strong background in machine learning, deep learning, AI systems, or a closely related technical discipline.
• Hands-on experience optimizing inference workloads for large-scale machine learning or neural network models.
• Strong proficiency in Python and experience with modern machine learning frameworks such as Py Torch.
• Practical experience with inference and model-serving technologies such as Triton, Tensor RT, v LLM, or ONNX Runtime.
• Ability to design rigorous experiments, interpret performance results, and communicate technical findings clearly.
• Experience deploying production inference systems at scale is highly desirable.
• Familiarity with distributed inference and multi-GPU architectures is a plus.
• Experience contributing to open-source machine learning or inference frameworks is advantageous.
• Peer-reviewed research publications in machine learning, systems, or related fields are a strong plus.
• Experience working close to hardware through technologies such as CUDA, ROCm, or performance profiling tools is beneficial.
• Strong analytical and problem-solving skills, with the ability to translate research concepts into practical engineering improvements.
• Familiarity with advanced inference topics such as long-context optimization, speculative decoding, KV-cache compression, efficient decoding, or hardware-aware model design is advantageous.

Benefits

• Full-time opportunity within a research-focused AI environment.
• Fully remote work from India.
• Opportunity to work on large-scale machine learning models and high-performance inference systems.
• Exposure to advanced model optimization, systems engineering, and hardware-aware AI techniques.
• Opportunity to contribute to production systems where research can generate measurable improvements in latency, throughput, and cost efficiency.
• Hands-on experience with modern inference technologies and hardware acceleration.
• Opportunity to explore emerging research areas including speculative decoding, long-context inference, KV-cache optimization, and efficient decoding strategies.
• Collaboration with research and engineering teams working on challenging real-world AI performance problems.
• Opportunity to contribute to open-source machine learning or inference technologies where applicable.
• Direct impact on the reliability, scalability, and efficiency of production AI systems.

How Jobgether works

We use an

AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements.

Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company.

The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice

By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer.

This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR).

You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information.

These tools assist our recruitment team but do not replace human judgment.

Final hiring decisions are ultimately made by humans.

If you would like more information about how your data is processed, please contact us.