Software Engineer AI Gateway

Ovii's Interpretation of the Role

Join Kong's AI Gateway team to design and operate core API‑management software that powers AI and LLM workloads. You’ll build scalable routing, caching, and integration features while collaborating with a distributed engineering group.

Role Snapshot

• Build AI gateway API platform
• Implement multi‑LLM routing & load balancing
• Optimize performance & low‑level systems
• Integrate third‑party deployment tools
• Document features and write clear specs

Must-Have Requirements

• 3+ years server‑side programming
• Golang or Rust
• Linux systems troubleshooting
• Distributed systems experience
• Building highly scalable, reliable applications
• server‑side application development
• distributed systems

Nice-to-Have Signals

• Familiarity with AI/LLM concepts
• NGINX/OpenResty/Kong/LuaJIT
• Envoy or Istio
• AI/LLM familiarity

Work Setup

• Location: Milan, Italy
• Work mode: HYBRID
• Remote scope: UNSPECIFIED
• Employment type: Full-Time

Not Specified in JD

• Visa sponsorship
• Salary range
• Remote eligibility
• Relocation
• Notice period
• Travel
• Security clearance
• Coding test
• Portfolio
• GitHub
• Writing sample
• Cover letter

What You'll Likely Work On

• Develop and maintain the core API‑management stack for AI and LLM services
• Create new capabilities such as proxying, load balancing, and database connectors
• Diagnose bugs, tune performance, and apply low‑level optimizations
• Bridge Kong with external deployment platforms and tooling
• Collaborate with a globally distributed team and produce product documentation

Good Fit If You Have

• Hands‑on experience with NGINX/OpenResty/Kong/LuaJIT
• Experience with Envoy or Istio service meshes
• Strong interest in AI/LLM technologies
• Comfortable working in a hybrid remote environment