Software Engineer, AI Gateway

Kong Inc.(1 month ago)

RemoteFull TimeSenior$147,978 - $199,359 (estimated)All Cost Center

About this role

As a Software Engineer on the AI Gateway Team at Kong, you will develop and maintain core features of the Kong AI Gateway, which includes multi-LLM routing, load balancing, and API management for AI applications. This role focuses on building scalable, reliable software, troubleshooting performance issues, and extending the functionality of the gateway through innovative features. The ideal candidate has over three years of experience in server-side application development, a strong understanding of distributed systems, Linux networking, and familiarity with AI/LLM concepts, while also demonstrating solid communication skills and the ability to work in a distributed team environment.

View Original Listing

Required Skills

API Management
Multi-LLM Routing
Load Balancing
Performance Tuning
Bug Troubleshooting
Linux Systems
Distributed Systems
Communication Skills
AI LLM Concepts
Rust

+4 more

About Kong Inc.

konghq.com

Kong Inc. is a leading API gateway and service mesh provider, designed to enhance developer productivity, security, and performance across modern architectures. The company's unified platform, Kong Konnect, provides tools for API management, AI gateway integration, and event streaming, enabling seamless connectivity and governance for organizations. With features tailored for API producers and consumers, Kong empowers businesses to build, run, discover, and govern APIs efficiently while supporting AI modernization efforts. Trusted by top companies, Kong is recognized for its ability to accelerate digital transformation and foster innovation in the API ecosystem.