🖥️System Requirements

To ensure the best possible experience with large language models, your system should meet the following minimum requirements:

Chip: Any Apple Silicon
Note: Sanctum can run on selected Intel Macs but we are not prolonging support for it
Operating System: MacOS 12 or newer
Memory: 16GB RAM or higher recommended

Note: You may be able to use Sanctum with 8GB RAM. Use smaller models and modest context sizes to avoid performance issues.

CPU: Should support the AVX2 instruction set.
Memory: 16GB RAM or higher recommended
GPU (optional): Dedicated GPU with at least 6GB VRAM, supporting CUDA version 11 or newer (CUDA v12 recommended)

Note: Ensure you have the latest NVIDIA drivers installed to take full advantage of GPU acceleration.

We are actively working on Linux support. Stay tuned for future updates.

Last updated 11 days ago