#1678: Connecting a local LLM / third-party AI provider compatible with OpenAI API

Отредактирована: сегодня

Symptoms

Is it possible to connect our own LLM to Swarmica as an AI provider?

Solution

Yes, if your LLM is accessible via OpenAI-compatible API and can be used via OpenAI Python SDK, then it can be connected as an AI provider. To do this, follow these steps:

You need to get the API address, token, and model name, which will be specified in the openai API client for those employees who have access to setting up the LLM
In the section Settings > Integrations > AI providers > OpenAI-compatible, fill out the form:

Important! The specified base URL address must be accessible from the host where Swarmica is installed
Enable the Active switch and click Save

Now Swarmica will use this LLM for AI functions.

By default, Swarmica assumes that the LLM supports all ChatGPT features, but some models do not support all ChatGPT features. For example, Neural Search, Duplicate Article Search, AI Support are not available for Deepseek, although it formally supports the OpenAI API. If you have any problems with your LLM, please contact our support service and provide technical details