LM Studio is a desktop application that allows users to run open-source large language models (LLMs) on their own computer, entirely offline. It provides an intuitive interface to explore, download, and run various AI models from Hugging Face repositories without requiring programming skills. Users can interact with models through a built-in chat UI or set up an OpenAI-compatible local server. The app also features a home page to discover new and noteworthy LLMs.
Key Features
- Local Execution: Run LLMs on a laptop, completely offline.
- Model Discovery & Download: Browse and download compatible model files from Hugging Face repositories.
- Chat Interface: Interact with models via an in-app chat UI.
- Local Server: Use models through an OpenAI-compatible local server.
- Multi-Model Support: Run multiple AI models simultaneously using the "Playground" mode.
- Compatibility Check: Estimate whether a model will fit on your computer based on your hardware specs.
Who It’s For
LM Studio is designed for both technical and non-technical users who want to experiment with or use LLMs locally. It is particularly useful for individuals concerned about privacy or who need offline access to AI models.
Requirements
- Apple Silicon Mac (M1/M2/M3): macOS 13.6 or newer.
- Windows/Linux PC: Processor with AVX2 support, 16GB+ RAM recommended, 6GB+ VRAM recommended for PCs. NVIDIA/AMD GPUs supported.