Site Reliability Engineer

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

You will serve as the primary post-sales technical owner for our most strategic customers, ensuring smooth deployment, performance, and reliability of ML workloads in production. You’ll own the technical success and long-term outcome of our strategic and enterprise accounts by managing and resolving escalations, maintaining and improving our runbooks, and proactively surface patterns that drive product improvements. This role blends hands-on debugging, infrastructure expertise, AI model performance monitoring, and executive-level customer-facing ownership. You’re of course not alone in this endeavor — partnering closely with product, engineering, and forward-deployed teams to remove technical friction, drive adoption, and ensure long-term success for high-value accounts.

RESPONSIBILITIES

• Diagnose and resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.

• Debug infrastructure issues across Kubernetes (pods, controllers), networking, observability, and alerting systems.

• Lead incident response during outages or escalations, managing coordination between Product, FDE, Sales, and Engineering.

• Serve as the technical owner for top enterprise accounts with strict SLAs and high responsiveness expectations.

• Identify common failure modes and translate user feedback into roadmap signals, product improvements, our internal runbooks, knowledge bases, and diagnostic best practices.

• Own project coordination end-to-end: scoping, execution, communication, and stakeholder alignment across technical and non-technical teams ranging from feature requests, new deployments, and operational debugging issues.

REQUIREMENTS

• Deep Kubernetes troubleshooting expertise, including advanced resource debugging, pod/runtime analysis, and log-based diagnostics using observability tooling such as Grafana, Loki, and Prometheus.

• Strong infrastructure debugging ability across container orchestration, networking, and service dependencies, with hands-on experience supporting production-grade clusters.

• Experience managing high-severity incidents with major customers, including SLAs, post-incident reviews, and clear communication throughout escalations.

• Proven project management and organizational skills with an ownership mindset, able to manage multiple complex, multi-stakeholder initiatives in parallel — including issue resolution, root-cause analysis, and feature delivery.

• Ability to translate recurring technical pain points into roadmap-level insights, documentation improvements, or product enhancements.

• Strong communication skills and executive presence during high-visibility situations, ensuring technical clarity and customer confidence.

• 3+ years of experience in a fast-paced, high-growth, or customer-facing engineering environment.

BONUS

• Familiarity with running high-performance AI models and workloads, including troubleshooting ML pipelines from preprocessing through inference and serving.

• Experience implementing or managing ticketing and incident-response systems such as Zendesk or Pylon.

• Familiarity with Helm, Flux, CI/CD tooling, or scripting automations to improve deployment, release, or operational workflows.

BENEFITS

• Competitive compensation, including meaningful equity.

• 100% coverage of medical, dental, and vision insurance for employee and dependents

• Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)

• Paid parental leave

• Company-facilitated 401(k)

• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.