Downloading AI models

The Models section allows you to download and load AI models for text embedding, image embedding, and text generation. Multiple models of each type may be downloaded, but only one of each type may be loaded into memory for use at any given time.

Important  You must first enable the model server before the Models section will be available. Some models require you to include a Hugging Face token in the Model Server section to download the model. See Enabling the AI model server.

To add a model:

1. Click the AI Services > Models tab.

2. Click the Add Model button.

3. In the Add a Model dialog, enter the following information:

   • Model Name: The exact name of the model as it appears on the Hugging Face website.

   • Model Type: Select Text Embedding, Image Embedding, or Text Generation.

   • Select Yes if you would like to give permission to download the model from Hugging Face.

4. Click the Add Model button.

To download a model:

1. Click the AI Services > Models tab.

2. Click the Download button next to the model you want to download.

3. If the model has not been confirmed for downloading, select Yes in the Add Model dialog, then click the Add Model button.

Note  Model downloads will fail if they require a Hugging Face Token and you have not yet entered one in the Model Server section.

To load a model:

1. Click the AI Services > Models tab.

2. Click the Load button next to the model you want to download.

3. Click the OK button in the Load Model dialog.

Note  Models cannot be loaded until they have been downloaded.