Dashboard
Checked on their board 16 Nov

Luminal Hiring now

Cloud Inference Engineer

AI compiler and serving stack that makes models faster. You'd tune GPU inference and build the scheduler.

$150K–$250K a yearSan Francisco, CAFull-timePosted 10 days ago

About the role

From Luminal's posting on Ashby, as they wrote it

Qualifications

  • CUDA + GPU inference optimization
  • vLLM, SGLang, or TensorRT-LLM experience
  • KV caching, paged attention, batching, token streaming, etc.
  • Distributed compute (with GPUs is a super plus)
  • No degree required

Company

Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line.

Role

Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud.

Day to day responsibilities

  • Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
  • Conducting model performance reviews
  • Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
  • Sometimes write kernels and, yes, occasional tasteful shitposting

Location and compensation

San Francisco, CA, US · Full-time · On-site. Annual base salary: $150,000–$250,000 USD. Equity: 0.15%–0.75%. Visa: US citizen/visa only.

Live on Luminal's board as of 16 Nov. We check it every day.

Apply on Ashby ↗

Usually 3 stages over about 7 days at B2B companies with under 50 people. The hiring manager is the one to reach first.

  1. Stage 1Founder or hiring managerIntro Call · 30 min
  2. Stage 2Technical founder or leadTechnical Deep Dive · 60 min
  3. Stage 3Founding teamFinal Round · 45 min

More roles at Luminal

The company

About Luminal

Making AI run fast on any hardware.

Luminal writes email addresses like jane@luminal.com (a made-up name). How we know

Similar roles