Sanctum

Sanctum is a desktop application that allows users to run and interact with full-featured open-source large language models (LLMs) locally on their device. It emphasizes privacy and security by encrypting data with AES-256 and keeping it on-device, never requiring an internet connection after setup. Key features include easy setup, integration with HuggingFace for accessing thousands of GGUF models, and the ability to chat with PDFs. Supported on macOS 12+ and Windows 10+, with Linux support coming soon.