Technology

Member of Technical Staff, Inference Systems

Explore this opportunity from the hiring employer

Job typeOther PostedNov 17, 2026 Apply byDec 17, 2026

Applications open

You will first verify your request and provide contact information to RightJobsNow. You will then be redirected to the employer or recruitment partner’s application website. Providing information here does not submit a job application.Contact information is optional; after verification, you may skip directly to the application site.

Verify you are human

Complete this verification to continue to the contact form.

About this position

Member of Technical Staff, Inference Systems

Company: Confidential — founded by Stanford alumni with deep AI infrastructure experience
Location: Palo Alto, CA (on-site 5 days per week)
Compensation: $230,000 - $350,000 + competitive equity
Employment Type: Full-time
Visa Sponsorship: Visa transfers and new sponsorship (H-1B, TN)

About the Company

The client is building a next-generation AI inference platform from the ground up with a relentless focus on performance. It was founded by Stanford alumni with deep AI infrastructure experience, including early work at Together AI, and is engineering the entire inference stack with Rust at its core.

The client has raised a $10M seed from notable investors and is currently in stealth ahead of announcing its fundraise and product.

The Role

The client is hiring Members of Technical Staff (2+ years) to build a high-performance inference platform from scratch. You are a systems engineer who knows inference internals (attention, KV cache, batching, scheduling) and wants to own the whole stack rather than a narrow slice. You will join a small team building a new inference system in Rust, where you shape every design decision.

What You Will Do

  • Build a new inference runtime in Rust, owning batching, scheduling, request routing and the serving stack.
  • Design KV cache management, prefix caching and optimizations that reduce latency and cost per token.
  • Scale serving across GPUs and nodes.
  • Profile, benchmark and ship performance improvements across the inference pipeline.
  • Make core architecture decisions with the founding team.

What You Bring

  • 2+ years of systems engineering experience
  • Deep knowledge of inference internals: attention, KV cache, batching and scheduling
  • Experience inside inference engines such as vLLM, SGLang or TensorRT-LLM
  • Strong systems programming (Rust, C++ or similar)
  • Ability to work on-site in Palo Alto 5 days a week

Tech Stack

Rust, Python, PyTorch, C++, Go, vLLM, SGLang, TensorRT-LLM, CUDA, Triton, NCCL

Before you apply: get a free recruiter-readiness score for your resume at CareerStanding — about a minute, no signup, and your resume stays in your browser.

Location and commute

Palo Alto, CA .

Plan your route with Google Maps. Travel times and transportation options vary; confirm the work location with the employer before commuting.

How to apply

Review the vacancy and complete the application on the employer or recruitment partner’s website. Requisition ID: WJ-3291792633.