✨Overview
Welcome to Sanctum
Sanctum is a powerful desktop application that brings the capabilities of open-source large language models (LLMs) directly to your device. Run and interact with advanced AI models directly from your computer—no cloud services or third-party data access required.
Core Features
Run GGUF models locally on your device.
Access a wide range of the most advanced models on HuggingFace.
Use AI to analyze throughout documents you upload.
Run local API server for AI models.
Simple, intuitive user experience.
Getting Started
How to Install Sanctum
Sanctum is available on:
For optimal performance, we recommend a device with at least 16GB of memory. Linux support is coming soon. For more details, read System Requirements here.
Creating an Account
Setting up an account is quick—no email required, just a username and password. For more on why an account is needed, visit the Architecture and Privacy page.
Generate and Save Recovery Phrase: This will allow you to recover your account if you forget your password.
Set Up Password: Choose a secure password for your account.
Pick a Username: Personalize your Sanctum experience.
Downloading Models
During onboarding, you can download a model from the list of recommended models. If you skip this step, you can later download models on a Models page. Here's how:
Visit Models > Featured to see the top picks from our team.
Or go to Models > Explore to browse all GGUF models available through Hugging Face integration.
The app helps you decide by automatically marking models your computer can run with a green checkmark. You'll also see key details like RAM requirements, disk space, and popularity metrics (downloads and likes). This makes it easy to choose the best model for your needs.
Learn more about model management here.
Privacy and Data Storage
Sanctum uses AES-256 encryption to safeguard your information. This encryption standard is trusted worldwide, even for classified government data, ensuring your personal information stays private and secure. Since all data is stored locally, your information never leaves your device.
Offline Functionality
Sanctum is designed to work fully offline. The only part that requires an internet connection is when you're downloading new models—all other features work seamlessly without being connected.
Ready to get started? Install Sanctum, set up your account, and begin exploring the power of open-source LLMs on your own terms.
For further assistance, check out our detailed guides and support resources.
Last updated
