Graphics cards · Solel//dev docs

Jethro and the other Sols run on the Aether Series models, on your server. A graphics card makes them quick. Without one they run on the processor, which works but is much slower.

Cards that work

Card	Through	Needs on the server
AMD Radeon	Vulkan, with `compose.amd.yaml`	The usual Mesa drivers, with /dev/dri present
Intel Arc	Vulkan, with `compose.amd.yaml`	The usual Mesa drivers, with /dev/dri present
NVIDIA	CUDA, with `compose.nvidia.yaml`	NVIDIA's driver and the NVIDIA Container Toolkit

The model puts as much of itself on the card as fits. A model too big for the card spills onto the processor instead of failing.

Apps you allow to use the graphics card share it too. See Apps and what they can reach.

At install time

The installer looks for a card:

With an AMD card, it uses compose.amd.yaml.
With an NVIDIA card and the NVIDIA Container Toolkit, it uses compose.nvidia.yaml.
With an NVIDIA card but no toolkit, it says so and runs the model on the processor.

It doesn't look for Intel cards, so add an Intel Arc card by hand, as below. It also picks the first model to suit the card's memory; see Install with one line.

Adding a card later

For an NVIDIA card, install NVIDIA's driver and the NVIDIA Container Toolkit first, following NVIDIA's instructions for your Linux distribution.
Open /opt/solel/.env as root and change the COMPOSE_FILE line. For AMD Radeon or Intel Arc:
```
COMPOSE_FILE=compose.yaml:compose.amd.yaml
```
For NVIDIA:
```
COMPOSE_FILE=compose.yaml:compose.nvidia.yaml
```
Start again:
```
cd /opt/solel
sudo docker compose up -d
```

Updates leave this line alone, so you only do it once.

Choosing a model

Settings › Models suggests the model that suits your card, and admins can download another and switch to it there. See Using your graphics card and Picking a model.