Sr Software Engineer - HPC Clusters, SLURM, ML

Job Title : Sr Software Engineer - HPC Clusters, SLURM, ML
Location : 100% Remote
Duration : One year (possibility of extensions)
Pay rate : $75 (w2) plus benefits

Key Skills : HPC Clusters, Cluster Administrator, Cluster tech stack, SLURM, BeeGFS, M/L Training (GPU+CPU), AI centric, Simulation, 3D graphics.

Job Description :
The client is looking for an experienced cluster administrator to manage HPC clusters. The right candidate will have experience on SLURM and related technologies and will be familiar with workloads related to machine learning training and inference (GPU and CPU).

Job Responsibilities : • Serve as the primary contact for a GPU+CPU cluster • Collected team feedback and relayed to the support team (schedule downtimes/maintenance, propose changes to the cluster, etc.) • Perform capacity planning to help determine compute/storage needs for the team moving forward • Serve as the owner of the SLURM job scheduler, defining the configuration that better fits the team and developing/enabling advanced features • Serve as the team datasets owner (manage the datasets that live in the cluster and how people access them) • Help the team optimize/troubleshoot complex jobs/pipelines (AI centric, simulation, 3D graphics, etc.). • Educate the team on how to use the cluster (SLURM, BeeGFS, datasets, etc.), enabling a fast ramp up time of new scientists and engineers (via tutorials, presentations, wiki docs, etc.)

Required skills and experience : • Experience designing and managing large clusters with heterogeneous HW (CPUs, GPUs, etc.) • User-centric and results oriented. You can learn from data what the needs of our scientists/engineers will and can produce a cluster growth plan to fulfill these needs • Power user. You are willing to extensively test the different workflows that run in the cluster and help optimize them. • Cluster tech stack. You are an expert on cluster orchestration and management, familiar with technologies such as SLURM, BeeGFS, Docker, etc. (or you are willing to learn them quickly) • Good communication skills. You can effectively communicate with a variety of shareholders, including presenting plans to higher management and having technical discussions with engineers/scientists.

Minimum Educational Requirement : BS degree or higher

Website: www.mavensoft.com