Solel//dev docs

Picking a model

An admin picks the model every Sol on your server thinks with, in Settings › Models. This page covers how suggests one, how to switch, and how to free the space an old one takes.

What suggests

Settings › Models looks at your server's graphics card and suggests the model that suits it best, under Best for this server:

  • Seraphim 1 with a card of 20 GB or more
  • Dominion 1 from 8 GB
  • Angel 1 on a smaller card, or on the processor alone.

When it can't read how much memory the card has, it suggests Dominion 1 and says a bigger model may fit too. See Using your graphics card. The section isn't there when you already use the suggested model.

Switch to another model

  1. Open Settings › Models.
  2. Find the model under The Aether Series, and choose Download. You can choose Cancel while it downloads.
  3. When it's downloaded, choose Use.

Every Sol switches to it at once, and the same model turns chats into memories. The top of the page shows the model starting, then Running, or Starts when it's needed.

If a model didn't start, it may need more memory than your server has. Choose Restart to try starting it again, or choose a smaller model.

Free up space

The model you switched from stays on your server, so switching back is quick. To free its space:

  1. In Settings › Models, under Downloaded, choose Remove beside the model.
  2. Confirm with Remove.

You can download it again any time. The model in use can't be removed.

Start a new server on another model

The one-line installer picks a new server's first model to suit its graphics card; see Install with one line. To start on another, change the SOLEL_MODEL line in the .env file next to compose.yaml (/opt/solel/.env after the one-line install) before the first start:

SOLEL_MODEL=Solel-io/Angel-1:IQ4_XS

After the first start, this line is ignored. Change the model in Settings › Models instead.