About the Role
As a TPU Kernel Engineer, you will be responsible for identifying and addressing performance issues across many different ML systems, including research, training, and inference. A significant portion of this work will involve designing and optimizing kernels for the TPU, and providing feedback to researchers about how model changes impact performance.
Responsibilities
- Identify and address performance issues across ML research, training, and inference systems.
- Design, implement, and optimize kernels for the TPU.
- Provide actionable feedback to researchers on model performance impacts.
- Debug kernel performance at the assembly level.
Qualities & Certifications
- Track record of solving large‑scale systems problems and low‑level optimization.
- Significant experience optimizing ML systems for TPUs, GPUs, or other accelerators.
- Results‑oriented with a bias toward flexibility and impact.
- Comfortable with pair programming.
- Curiosity about machine learning research.
- Concern for the societal impacts of your work.
Additional Experience
- High performance, large‑scale ML systems design.
- Designing and implementing kernels for TPUs or other ML accelerators.
- Deep understanding of accelerators, e.g., computer architecture.
- Knowledge of ML framework internals.
- Experience with language modeling using transformers.
Representative Projects
- Implement low‑latency, high‑throughput sampling for large language models.
- Adapt existing models for low‑precision inference.
- Build quantitative models of system performance.
- Design and implement custom collective communication algorithms.
- Debug kernel performance at the assembly level.
Compensation
Annual Salary: $280,000 — $850,000 USD
Location & Logistics
Minimum education: Bachelor’s degree or equivalent. Minimum years of experience: internal job level requirements. Hybrid policy: staff should be in the office at least 25% of the time.
Visa Sponsorship
We sponsor visas and will make reasonable efforts to obtain them when offering a position.
Equal Opportunity Statement
We are an equal opportunity employer and encourage all qualified individuals, regardless of race, gender, or background, to apply.
