Senior Software Developer: Models Team (Token Factory)
Nebius
About the position
Join a team focused on building a full-stack AI cloud platform, enabling seamless integration of AI into products and workflows.
Tech stack
- python
- go
- kubernetes
- ai
Requirements
Required:
- Experience serving LLMs in production
- Strong Python and/or Go programming skills
- Experience designing and operating highly scalable, highly available distributed services
Nice to have:
- Contributions to vLLM, SGLang, TRT-LLM, or NVIDIA ecosystem open-source projects
- Deep understanding of KV cache management, speculative decoding, and quantization
- Experience with LLM evaluation frameworks
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture