Senior Software Engineer - Model Performance

Help us make inference blazingly fast. We're looking for a Senior Software Engineer to optimize our inference stack, spanning from implementing known techniques to experimenting with novel approaches. You'll work across the full inference stack to find and eliminate bottlenecks and have the autonomy to push the limits of what's possible in model serving.

Requirements

• 2+ years of experience in ML systems, inference optimization, or GPU programming
• Strong proficiency in Python and familiarity with C++
• Hands-on experience with LLM inference frameworks (vLLM, SGLang, TensorRT-LLM, or similar)
• Deep understanding of GPU architecture and experience profiling GPU workloads
• Familiarity with LLM optimization techniques (quantization, speculative decoding, continuous batching, KV cache management)
• Experience with PyTorch and understanding of how models execute on hardware
• Track record of measurably improving system performance

Benefits

• Competitive compensation
• Equity in a high-growth startup
• Comprehensive benefits