Principal DevOps Engineer

• Platform Architecture & Vision: Architect a Kubernetes-native platform that models broadcast infrastructure as custom resources. Lead the technical strategy leveraging Crossplane compositions and custom Go functions to automate provisioning across multi-account AWS environments and on-prem control rooms.
• Systems Engineering & Integrations: Design build and maintain production-grade Kubernetes operators controllers and internal platform APIs in Go. You will actively develop custom Crossplane providers to deeply integrate external enterprise platforms (such as NRCS Venafi and Infoblox) into our control plane managing resource lifecycles and approval workflows.
• Infrastructure & Networking Delivery: Lead the design of cloud networking DNS strategies and cross-account connectivity across hybrid environments automating VPC topology and dynamic network routing.
• Cross-Discipline Collaboration: Partner closely with broadcast systems engineers system integrators and external vendors to bridge the gap between broadcast hardware and automated infrastructure. You will lead efforts to "Puppet-ize" bare-metal compute configurations and integrate proprietary vendor solutions into our configuration-as-code ecosystem.
• Technical Leadership: Serve as a technical authority for the team. Write RFCs drive architectural decisions mentor engineers and establish high-confidence CI/CD pipelines testing strategies and GitHub Actions automation.
• Access & Security Strategy: Own the platform's authorization model designing hierarchical RBAC systems resource identifier schemes and identity integrations that enforce fine-grained access control.
• Operational Excellence: Drive GitOps-based continuous delivery (Flux Kustomize Helm) and manage configuration-as-code for compute fleets using Puppet. Ensure deep operational visibility by designing comprehensive observability and alerting stacks.
• VDI Integration: Oversee the integration of remote desktop/VDI connectivity solutions focusing on session authentication credential management and gateway routing.

• Experience: 10+ years of experience designing building and operating production infrastructure and cloud-native platforms at enterprise scale.
• Software Engineering: Strong proficiency in Go (systems-level programming API servers) and deep experience building Kubernetes controllers/operators using patterns like controller-runtime and kubebuilder.
• Kubernetes Internals: Expert-level knowledge of the Kubernetes ecosystem including CRD/XRD generation operators informers admission webhooks and RBAC.
• Crossplane & Control Planes: Deep production experience with Crossplane including composite resources composition functions and specifically developing custom Crossplane providers in Go to integrate external enterprise platforms.
• AWS & Networking: Extensive production experience with AWS multi-account architectures cross-account networking patterns and identity federation. Requires depth across EKS EC2 VPC IAM STS SSM Secrets Manager Route 53 and S3.
• GitOps Delivery: Production experience with GitOps tooling specifically Flux (HelmRelease Kustomization) or ArgoCD for continuous delivery on Kubernetes.
• Configuration Management: Hands-on experience with Puppet including module development PuppetDB Hiera and r10k.
• APIs & Security: Experience designing REST APIs with middleware patterns and modern authentication (OAuth/JWT). Keen eye for information security including cross-account IAM trust chains least-privilege policies JWT token lifecycles and secrets abstraction.
• Observability: Strong background in designing telemetry platforms using Grafana Prometheus/Mimir Loki OpenTelemetry and metrics collection agents (Alloy Prometheus Node Exporter).
• Databases: Working knowledge of PostgreSQL SQLite or similar relational databases encompassing schema design migrations and query optimization.
• Communication: Excellent problem-solving skills with a proven ability to present architectural decisions to executives engage with vendors and write clear technical documentation.

• Familiarity with broadcast/media production workflows and the strict operational constraints of live production environments.
• Experience with the Crossplane function SDK for building custom composition functions in Go and operating in Kubernetes disaster recovery situations (Velero cluster restoration backups).
• Familiarity with VDI Solutions (NICE DCV Leostream PCoIP etc) machine identity workflows and PKI certificate management (Venafi or similar).
• Networking & Gateway: Experience with hybrid DNS architectures (Infoblox) software-defined networking (VPC peering Transit Gateway Direct Connect CloudWan) and Envoy Gateway / Gateway API.
• Ecosystem Tooling: Familiarity with advanced testing frameworks (k6 KUTTL etc) SOPS for encrypted GitOps configurations and local development workflows (Air kind/colima).
• Scripting: Ability to script routine tasks in Bash and PowerShell.
• Open Source: Active contributions to open-source projects particularly within the CNCF / Kubernetes ecosystem.

• This position is eligible for company sponsored benefits including medical dental and vision insurance 401(k) paid leave tuition reimbursement and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $180000 - $230000 (bonus eligible)

What We Do

From film television news theme parks interactive media and streaming our people are at the center of it all. ​Here we solve complex and business-critical problems. That’s why we’re looking for people to help us continue our evolution imagining and delivering the most innovative and disruptive products and services through the latest tech advancements in the industry. ​ Here you can develop solutions. You’ll develop solutions that allow engineers to broadcast live TV from the comfort of their homes. These solutions will enable the use of our collection of hundreds of thousands of distinct intellectual properties across our film television and streaming brands. Here you can transform. You’ll make decisions and solve complex problems by leveraging insights that come from data building AI to help enable solutions to optimize every aspect of our content eco-system. Here you can build. You’ll build emerging immersive technologies that are used to power the broadcasts and streaming of global events like the Super Bowl and Olympics. You can create secure elastic cloud-based services connecting parts of our global platform ecosystem that effect tens of millions of viewers consumers and businesses that consume and love NBCUniversal’s content. And while you design build and architect your career we have the culture to make sure you’re supported. Here you can work and still live your best life! We’re leaders in our fields. We hire smart people and trust them to get the job done. We are never too busy to develop a fellow colleague. We understand our goals – or we ask. When we see something that needs doing – we do it. We make data-driven decisions. We fiercely believe in our talent and their growth. If you're ready to make an impact here you can.

Why Work With Us

For us it's more than just a work life. It's a daily passion. We take great pride in our legacy. We find fun in the challenge. We collaborate and inspire others. We're always creating always solving and always ahead of competition.

Gallery