Senior Technical Support Engineer – Slurm

• Own Slurm support cases from initial investigation through resolution for customers running production AI and HPC clusters
• Diagnose complex problems involving slurmctld, slurmd, slurmdbd, job scheduling, node management, resource allocation, accounting, authentication, and high availability
• Solve Slurm configuration and policy issues involving partitions, reservations, priorities, fair-share, quality of service, backfill, preemption, GRES/TRES, cgroups, and job constraints
• Investigate performance, reliability, and scalability issues using logs, diagnostic data, configuration analysis, reproductions, and source-level debugging when required
• Isolate problems across Slurm and dependencies including Linux, MUNGE, databases, networking, parallel storage, containers, GPUs, and cluster-management systems
• Advise customers on Slurm configuration, upgrades, operational practices, system-resource management, and safe recovery from production incidents
• Collaborate with engineering teams by producing technical descriptions, reproducible test cases, and defect reports
• Develop guides, knowledge-base articles, diagnostic tools, and internal training to strengthen Slurm expertise across the support organization

Requirements

• BS degree in Computer Science, Engineering, or a related field, or equivalent experience
• 5+ years of hands-on experience administering and supporting Slurm in production HPC or AI environments, including business-critical outage incidents
• Expert-level understanding of Slurm architecture, daemons, configuration, scheduling behavior, accounting, resource management, and failure modes
• Capacity to identify sophisticated Slurm incidents independently and guide them to a technically sound resolution
• In-depth Linux system-administration and troubleshooting experience, including systemd, cgroups, authentication, networking, and database-backed services
• Experience operating Slurm across multi-user clusters with complex scheduling policies and heterogeneous compute resources
• Strong analytical and research skills, including distinguishing Slurm defects from configuration, integration, infrastructure, and workload problems
• Excellent written and verbal communication skills
• Experience supporting large-scale Slurm environments containing thousands of nodes or GPUs
• Experience diagnosing scheduler performance, job-throughput, controller-load, and database-scaling issues
• Familiarity with Slurm source code, plugins, SPANK, Lua job-submit plugins, or upstream issue investigation
• Experience with containers and HPC integration technologies such as Pyxis, Enroot, Apptainer, or Singularity
• Previous experience integrating Slurm with NVIDIA Base Command Manager, Bright Cluster Manager, or another cluster-management platform

Core Competencies

Demonstrates expert-level understanding of Slurm architecture and administration in production HPC and AI environments, with strong analytical skills for diagnosing complex issues and guiding resolutions. Proficient in Linux system administration and troubleshooting, with the ability to collaborate effectively and produce technical documentation.

Highest-signal resume keywords

• Slurm Administration
• Linux System Administration
• Job Scheduling
• Performance Diagnosis
• Container Integration

Hard Skills

• Slurm Configuration
• Resource Management
• Job Constraints
• Systemd
• Cgroups
• Networking
• Database Troubleshooting
• HPC Integration
• Performance Analysis
• Source-Level Debugging

Soft Skills

• Analytical Skills
• Research Skills
• Written Communication
• Verbal Communication

Industry Keywords

• AI Clusters
• HPC Clusters
• Production Environments
• Multi-User Clusters
• High Availability

Tools & Technologies

• MUNGE
• NVIDIA Base Command Manager
• Bright Cluster Manager
• Pyxis
• Enroot
• Apptainer
• Singularity