Job Description
Senior engineers are area owners who lead designs raise engineering standards and deliver measurable improvements to latency throughput and reliability across multiple services. You’ll partner with product orchestration and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.
About the role:- Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.
- Define and own SLIs/SLOs; ensure post-incident actions land and reliability improves release-over-release.
- Implement advanced optimizations (e.g. micro-batch schedulers speculative decoding KV-cache reuse) and quantify impact.
- Strengthen incident posture: capacity planning autoscaling policy graceful degradation rollback/traffic-shift strategies.
- Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards.
- Own an area spanning multiple services and teams (e.g. request routing & adaptive scheduling cost-per-token analytics GPU resource isolation).
- ~ 5-8 years industry experience building distributed systems or cloud services.
- Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance.
- Optimize end-to-end ML system performance by developing and tuning CUDA kernels reducing model latency maximizing compute and memory bandwidth utilization and leveraging custom accelerators for high-efficiency workloads
- Hands-on experience with Kubernetes at production scale CI/CD and observability stacks (Prometheus Grafana OpenTelemetry).
- Practical knowledge of inference internals: batching caching mixed precision (BF16/FP8) streaming token delivery.
- Proven track record improving tail latency (P95/P99) and service reliability through metrics-driven work.
Preferred:
- Contributions to inference frameworks (vLLM Triton TensorRT-LLM Ray Serve TorchServe).
- Experience with CUDA kernels NCCL/SHARP RDMA/NUMA or GPU interconnect topologies.
- Leading multi-team initiatives or partnering with customers on mission-critical launches.
Wondering if you’re a good fit? We believe in investing in our people and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match.
Why CoreWeave?At CoreWeave we work hard have fun and move fast! We’re in an exciting stage of hyper-growth that you will not want to miss out on. We’re not afraid of a little chaos and we’re constantly learning. Our team cares deeply about how we build our product and how we work together which is represented through our core values:
- Be Curious at Your Core
- Act Like an Owner
- Empower Employees
- Deliver Best-in-Class Client Experiences
- Achieve More Together
We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for take off the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry who will want to learn from you too. Come join us!
The base salary range for this role is $165000 to $242000. The starting salary will be determined based on job-related knowledge skills experience and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary our total rewards package includes a discretionary bonus equity awards and a comprehensive benefits program (all based on eligibility).
What We Offer
The range we’ve posted represents the typical compensation range for this role. To determine actual compensation we review the market rate for each candidate which can include a variety of factors. These include qualifications experience interview performance and location.
In addition to a competitive salary we offer a variety of benefits to support your needs including:
- Medical dental and vision insurance - 100% paid for by CoreWeave
- Company-paid Life Insurance
- Voluntary supplemental life insurance
- Short and long-term disability insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Ability to Participate in Employee Stock Purchase Program (ESPP)
- Mental Wellness Benefits through Spring Health
- Family-Forming support provided by Carrot
- Paid Parental Leave
- Flexible full-service childcare support with Kinside
- 401(k) with a generous employer match
- Flexible PTO
- Catered lunch each day in our office and data center locations
- A casual work environment
- A work culture focused on innovative disruption
Our Workplace
While we prioritize a hybrid work environment remote work may be considered for candidates located more than 30 miles from an office based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration.
California Consumer Privacy Act - California applicants only
CoreWeave is an equal opportunity employer committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race color religion sex disability age sexual orientation gender identity national origin veteran status or genetic information.
As part of this commitment and consistent with the Americans with Disabilities Act (ADA) CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process unless such accommodation would cause an undue hardship. If reasonable accommodation is needed please contact: [email protected].
Export Control Compliance
This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information applicant must either be (A) a U.S. person defined as a (i) U.S. citizen or national (ii) U.S. lawful permanent resident (green card holder) (iii) refugee under 8 U.S.C. § 1157 or (iv) asylee under 8 U.S.C. § 1158 (B) eligible to access the export controlled information without a required export authorization or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may for legitimate business reasons decline to pursue any export licensing process.
Top Skills
What the Team is Saying
What We Do
CoreWeave the AI Hyperscaler™ delivers a cloud platform of cutting-edge software powering the next wave of AI. The company's technology provides enterprises and leading AI labs with cloud solutions for accelerated computing. Since 2017 CoreWeave has operated a growing footprint of data centers across the US and Europe. CoreWeave was ranked as one of the TIME100 most influential companies and featured on Forbes Cloud 100 ranking in 2024. Learn more at www.coreweave.com.
Why Work With Us
At CoreWeave we work hard have fun and move fast! Today we are a small growing team of intelligent genuine people that value different perspectives and approaches to solving complex problems. We foster an environment that champions collaboration and prioritizes innovative solutions. Here you are surrounded by the best.
Gallery
CoreWeave Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
Similar Jobs
CoreWeave
Senior Production Engineer Tooling & Frameworks
Explore More
Date Posted
04/19/2026
Views
0
Similar Jobs
Senior Product Manager - Ad Fraud and Identity Solutions -
Views in the last 30 days - 0
View Details