Kong is internet hosting its API Summit 2024 occasion, and has made bulletins about a number of enhancements to its platforms. Key highlights are updates to Kong Konnect, its API administration platform, which additionally consists of new variations of Kong Insomnia, Kong Gateway, and Kong AI Gateway.
The newest updates to Kong Konnect assist firms additional put together their API infrastructure to deal with AI use instances.
“There isn’t a AI with out APIs, and the newest model of Kong Konnect delivers the important infrastructure for each. We purpose to present companies the instruments to handle and scale their API visitors securely, serving to drive innovation sooner than ever earlier than,” stated Augusto Marietti, CEO and co-founder of Kong Inc. “Kong Konnect supplies a unified API platform for constructing, working and governing GenAI purposes.”
This replace consists of Konnect Service Catalog, which supplies a single supply of fact for APIs and companies, which helps firms handle shadow APIs by permitting them to do away with undiscovered or unused APIs. The Service Catalog additionally contains a Scorecard that assesses how compliance a service is with outlined standards.
Konnect Devoted Cloud Gateways are additionally now obtainable on Azure and new AWS areas. In line with the corporate, this added availability allows organizations to deploy and handle their APIs throughout a number of clouds and preserve enterprise-grade SLAs.
Kong Insomnia 10, which is an API design and testing instrument, provides limitless assortment runs, AI Runner for growing GenAI apps, and Invite Management, which ensures that API belongings can solely be accessed by approved customers.
Different options on this launch of Kong Konnect embody Serverless Gateways, a centralized and cloud-based repository for managing API configurations, and superior API and AI analytics.
The replace additionally introduces variations 3.8 of each Kong Gateway and Kong AI Gateway. Kong Gateway 3.8 provides Incremental Configuration Updates, which considerably reduces reminiscence and CPU utilization, and enhanced OpenTelemetry help.
Kong AI Gateway 3.8 provides a number of semantic reasoning capabilities, together with Semantic Caching, which acknowledges when completely different prompts symbolize the identical query, leading to sooner response occasions. As an example, “how lengthy does it take to prepare dinner pasta?” and “how lengthy does it take to prepare dinner spaghetti?” could be responded to with the identical cached response.
In line with the corporate, the flexibility to answer with cached responses cuts down on processing occasions and reduces computational overhead.
One other new function on this replace is Semantic Immediate Guard, which allows AI Gateway to know the “essence” of a request and block inappropriate prompts. Usually, these prompts are sorted out by figuring out particular key phrases, and this function eliminates the necessity for that.
The three.8 launch additionally introduces Semantic Routing, which selects essentially the most related LLM primarily based on a developer’s necessities.
“Kong AI Gateway 3.8 is a major step ahead in enabling organizations to completely harness the facility of AI,” stated Marco Palladino, co-founder and CTO of Kong. “By introducing Semantic Intelligence into our AI Gateway, we’re addressing essentially the most urgent challenges confronted by enterprises leveraging GenAI at the moment — velocity, price and safety — whereas dramatically enhancing the developer expertise.”