Ovii Job Board

Senior Software Engineer - AI Gateway

Kong

Shanghai, China • Onsite - Shanghai, China • Full-Time • 5+ years

Posted 2026-07-23 Tech & Engg

Apply on employer site

Job Description

Ovii's Interpretation of the Role

Senior Software Engineer focused on building and evolving Kong's AI‑enabled API gateway. You will design, implement, and optimize core proxy, load‑balancing, and database features while collaborating with the open‑source community. The role demands strong Linux systems expertise and familiarity with AI LLM concepts.

Role Snapshot

  • Design & build API gateway core features
  • Implement proxying, load‑balancing, and database support
  • Optimize performance and low‑level Linux systems
  • Engage with open‑source community
  • Integrate AI LLM capabilities
  • Own end‑to‑end feature delivery

Must-Have Requirements

  • Server‑side programming
  • Distributed systems design
  • Linux systems troubleshooting
  • API management & proxying
  • Load balancing
  • Performance tuning & optimization
  • Technical documentation & communication
  • AI LLM concepts
  • server‑side development
  • distributed systems
  • Linux systems

Nice-to-Have Signals

  • NGINX/OpenResty/Kong/LuaJIT
  • Envoy or Istio
  • Rust
  • NGINX/OpenResty/LuaJIT
  • Envoy/Istio

Work Setup

  • Location: Shanghai, China
  • Work mode: ONSITE
  • Employment type: Full-Time

Not Specified in JD

  • Visa sponsorship
  • Salary range
  • Remote eligibility
  • Education requirement
  • Certifications
  • Relocation
  • Notice period
  • Travel
  • Security clearance
  • Coding test
  • Portfolio
  • GitHub
  • Writing sample
  • Cover letter

What You'll Likely Work On

  • Design, develop, and maintain the core API management platform and its underlying stack.
  • Architect and implement new features such as advanced proxying, load‑balancing, and database integrations.
  • Troubleshoot bugs, conduct performance tuning, and apply low‑level optimizations on Linux.
  • Collaborate with the open‑source community to incorporate emerging industry trends.
  • Bridge Kong with third‑party deployment platforms and tooling.
  • Handle additional tasks as directed by the manager.

Good Fit If You Have

  • Hands‑on experience with NGINX, OpenResty, Kong, or LuaJIT.
  • Familiarity with service‑mesh technologies like Envoy or Istio.
  • Rust programming background.
  • Passion for contributing to open‑source projects.
  • Interest in AI gateway innovations.

Skills

  • Server‑side programming
  • Distributed systems design
  • Linux systems troubleshooting
  • API management & proxying
  • Load balancing
  • Performance tuning & optimization
  • AI LLM concepts
  • Technical documentation & communication
  • Remote team collaboration