G9v3-3B by AI9Stars is a dense causal language model for local use. Features 131K context, Think/No Think modes, targeting coding, tool-use, and reasoning.
Capabilities, design details, and architectural traits
G9v3-3B is a dense causal language model from AI9Stars, built specifically for local deployment and resource-constrained scenarios. It uses a standard LlamaForCausalLM architecture and targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact footprint matters.
A defining feature is its Think / No Think toggle, controlled via the enable_thinking parameter in the chat template. In Think mode, recommended sampling uses temperature=0.9, top_p=0.95. In No Think mode, recommended sampling shifts to temperature=0.7, top_p=0.95. This lets users trade between extended reasoning and faster direct responses within the same model.
| Trait | Detail |
|---|---|
| Architecture | Standard LlamaForCausalLM, dense (non-MoE) |
| Context length | 131,072 tokens |
| Think / No Think toggle | enable_thinking parameter switches between reasoning and direct-response modes |
| Deployment focus | Local and resource-constrained environments |
| Target workloads | Coding, tool-use workflows, reasoning, everyday assistant use |
| Precision | BF16 |
| License | Apache-2.0 |
The model card provides quickstart guides for vLLM, SGLang, and Transformers, reinforcing its local-first positioning. Quantized versions are available for llama.cpp, LM Studio, Jan, and Ollama, and the model tree includes community adapters and finetunes.
Independent evaluations · Artificial Analysis
Evaluate specifications, pricing, and independent benchmark indices
| Model Details | |||
|---|---|---|---|
| General Info | |||
| Provider | AI9Stars | Anthropic | Anthropic |
| Release Date | July 23, 2026 | July 24, 2026 | June 9, 2026 |
| Knowledge Cutoff | - | May 2026 | - |
| Context & Limits | |||
| Context Window | 131K | 1M Best Context Window | 1M Best Context Window |
| Pricing (per 1M tokens) | |||
| Input Pricing | Free Best Input Pricing | $5 | $10 |
| Output Pricing | Free Best Output Pricing | $25 | $50 |
| Modalities | |||
| Inputs | text | textimage | textimagefile |
| Outputs | text | text | text |
| Benchmarks (0-100) | |||
| Intelligence Index | 16.2 | 63.1 Best Intelligence Index | 62.1 |
| Coding Index | 9.9 | 78.0 Best Coding Index | 76.5 |
| Agentic Index | 14.0 | 59.2 Best Agentic Index | 56.6 |
Graduate-level reasoning and expert Q&A evaluation.
Extremely difficult logical reasoning and knowledge.
Logical reasoning over long context windows.
Independent evaluation data provided by Artificial Analysis. To view the latest benchmarks and full details, visit their official site.
