Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
This might end up as a product idea if it is not already, but is there currently a way e.g. via plugins to incorporate an internal foundation model with its associated API endpoints? Essentially, we are wanting to create a new LLM connection.
Operating system used: Ubuntu 20
Hi
Do you finally find a way to implement this method?
I only see an explanation from their knowledge base, but no any idea to realize it.
Users who have developed their own LLMs with API endpoints can integrate these custom services into Dataiku via the Custom LLM connection. Setting up a Custom LLM connection requires developing a specific plugin using the Java LLM component to map the endpointโs behavior.
Here is the original web page.