Please add details of the client interface for AI Gateway

[crondab]

Where is the problem?

https://docs.konghq.com/gateway/latest/get-started/ai-gateway/

What happened?

I've been evaluating your product for use as an LLM Proxy.

It is really difficult to see from the documentation what the client interface with the AI Gateway is. Is it OpenAI API or is it not? Statements such as "The request and response formats are loosely based on OpenAI" are not helpful when there is no documentation explicitly specifying what the interface is and what client SDKs are available.

What did you expect to happen?

I expect to be able to understand very quickly how my application will interact with the AI Gateway.

Code of Conduct and Community Expectations

• I agree to follow this project's Code of Conduct
• I agree to abide by the Community Expectations

[oowl]

Thanks for your reporting the issues. @crondab

Is it OpenAI API or is it not?

We can say yes, the llm/v1/completions and llm/v1/chat route types are only valid for part of the OpenAI API format right now.

Statements such as "The request and response formats are loosely based on OpenAI" are not helpful when there is no documentation explicitly specifying what the interface is and what client SDKs are available.

I think we have https://github.com/kong/kong/blob/master/spec/fixtures/ai-proxy/oas.yaml specifications was enough for developer understanding, but yes, I agree with your viewpoint, we can add more detailed information for the API interface, and client SDK support doc.