HPC Operations Engineer

This position is ideally based out of our NJ Headquarter location, however, we are willing to look at remote candidates outside of the immediate NJ area.

CoreWeave is seeking a skilled HPC Operations Engineer with expertise in NVIDIA A100s to join our team. The successful candidate will be responsible for the onboarding, optimization, and maintenance of our GPU-based distributed training infrastructure. You will work closely with the engineering team to ensure that the infrastructure meets the needs of our research and development projects. You will also be responsible for troubleshooting hardware and software issues that arise, as well as ensuring that the workload orchestration software, such as Slurm and Kubernetes, is running smoothly.

Key Responsibilities:

• Install, configure, and maintain high-performance computing (HPC) systems with NVIDIA A100s and H100s and related software.
• Onboard and optimize distributed training infrastructure for machine learning models using GPUs.
• Collaborate with the engineering team to understand their needs and design and implement infrastructure solutions.
• Troubleshoot hardware and software issues that arise and perform regular system maintenance tasks.
• Monitor and analyze system performance and make recommendations for improvements.
• Create and maintain documentation related to the GPU infrastructure and workflows.
• Work with workload orchestration systems such as Slurm and Kubernetes to ensure efficient use of resources.
• Keep up-to-date with the latest technologies and industry trends related to HPC and GPU infrastructure.

Qualifications:

• Bachelor's degree in Computer Science, Electrical Engineering, or a related field.
• At least 2 years of experience in HPC operations with NVIDIA A100s or other GPUs.
• Experience with workload orchestration systems such as Slurm and Kubernetes.
• Strong understanding of system administration and networking concepts.
• Familiarity with software development and scripting languages such as Python.
• Ability to troubleshoot hardware and software issues and perform system maintenance tasks.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• If you are an experienced HPC Operations Engineer with a passion for GPU infrastructure and distributed training, we encourage you to apply for this exciting opportunity. Our company offers a competitive salary, excellent benefits, and a collaborative and dynamic work environment.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $65,000/year in our lowest geographic market up to $100,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.