Feature request · Integrations · Annoyance
Allow open-source or self-hosted LLMs such as Ollama for Windmill AI
2 source threads · first seen 2024-04 · last seen 2024-08
Summary
A user wants more operator choice for AI features and asks whether a tool like Ollama could be supported instead of a proprietary provider.
Evidence
Excerpts are copied word for word from the source; follow the link to read it in full.
“However many other LLM providers are using the same openAI API structure, just with different api url (like openrouter)”
“Could a wrapper/tool such as Ollma be supported?”