Senior AI Application Engineer - LLM & VLM Enablement
Axelera
SeniorAbout the position
Join a dynamic team as a Senior AI Application Engineer, focusing on LLM and VLM support for advanced AI platforms.
Tech stack
- python
- pytorch
- ml-inference
- llm
- vlm
- quantization
Requirements
Required:
- 5+ years of software engineering experience, with at least 2 years on ML inference, ML systems or ML tooling
- Solid understanding of transformer inference: attention variants, KV caching, prefill versus decode, sampling, tokenization
- Working knowledge of LLM quantization and the ability to tell a quantization loss from an implementation bug
- Strong Python and PyTorch, and experience shipping production-quality software
Nice to have:
- Experience with inference engines or serving stacks such as llama.cpp, vLLM, ONNX Runtime GenAI
- Experience with kernel development or a tensor compiler like Triton, TVM or MLIR
- Experience with speech (ASR, TTS) or agentic applications on embedded devices
Responsibilities
- Study new LLM and VLM families and architectures, prototype and profile them on Metis and Europa
- Turn results into supported Voyager SDK features, with stable APIs, tests, documentation and release gates
- Own the PyTorch reference with quantization baked in for each LLM/VLM building block
- Bring LLM and VLM serving into the Voyager SDK pipeline builder
Benefits
- Attractive compensation package, including a pension plan and extensive employee insurances
- Option to get company shares
- Open culture that supports creativity and continual innovation
- Collaborative ownership and freedom with responsibility