Find The Best LLM for your hardware
Select your GPU and system RAM to see models ranked by VRAM fit. Get deployment-ready configurations optimized for your infrastructure.
Hardware Configuration
Model Filters
1B 1026B
4K 10M
| Model | Organization | Quant | Parameters | Context | Capabilities | Fit |
|---|---|---|---|---|---|---|
| DeepSeek Coder V2 Lite Instruct | DeepSeek | Q3_K_L | 15.71B | 160K | Code Multilingual | — |
| DeepSeek Coder V2 Lite Instruct | DeepSeek | Q4_K_M | 15.71B | 160K | Code Multilingual | — |
| DeepSeek Coder V2 Lite Instruct | DeepSeek | Q5_K_M | 15.71B | 160K | Code Multilingual | — |
| DeepSeek Coder V2 Lite Instruct | DeepSeek | Q6_K | 15.71B | 160K | Code Multilingual | — |
| DeepSeek Coder V2 Lite Instruct | DeepSeek | Q8_0 | 15.71B | 160K | Code Multilingual | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q2_K | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q2_K_L | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q2_K_XL | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q3_K_M | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q3_K_S | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q3_K_XL | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q4_0 | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q4_1 | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q4_K_M | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q4_K_S | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q4_K_XL | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q5_K_M | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q5_K_S | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q5_K_XL | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q6_K | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q6_K_XL | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q8_0 | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | Q8_K_XL | 8.19B | 128K | Code Multilingual Thinking Tool Calls | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | FP16 | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q2_K | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q2_K_L | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q2_K_XL | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q3_K_M | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q3_K_S | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q3_K_XL | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q4_0 | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q4_1 | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q4_K_M | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q4_K_S | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q4_K_XL | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q5_K_M | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q5_K_S | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q5_K_XL | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q6_K | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q6_K_XL | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q8_0 | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Llama 70B | DeepSeek | Q8_K_XL | 70.55B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | FP16 | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q2_K | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q2_K_L | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q3_K_M | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q4_K_M | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q5_K_M | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q6_K | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Q8_0 | 14.77B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | FP16 | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q2_K | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q2_K_L | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q3_K_M | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q4_K_M | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q5_K_M | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q6_K | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Q8_0 | 32.76B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | FP16 | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q2_K | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q2_K_L | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q3_K_M | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q4_K_M | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q5_K_M | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q6_K | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek R1 Distill Qwen 7B | DeepSeek | Q8_0 | 7.62B | 128K | Code Multilingual Thinking | — |
| DeepSeek V3.1 | DeepSeek | Q2_K | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q2_K_L | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q2_K_XL | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q3_K_M | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q3_K_S | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q3_K_XL | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q4_0 | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q4_1 | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q4_K_M | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q4_K_S | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q4_K_XL | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q5_K_M | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q5_K_S | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q5_K_XL | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q6_K | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q6_K_XL | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q8_0 | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.1 | DeepSeek | Q8_K_XL | 684.53B | 160K | Code Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q2_K | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q2_K_L | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q2_K_XL | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q3_K_M | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q3_K_S | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q3_K_XL | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q4_0 | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q4_1 | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q4_K_M | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q4_K_S | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q4_K_XL | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q5_K_M | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q5_K_S | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q5_K_XL | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q6_K | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q6_K_XL | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q8_0 | 685.4B | 160K | Multilingual Tool Calls | — |
| DeepSeek V3.2 | DeepSeek | Q8_K_XL | 685.4B | 160K | Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q2_K | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q2_K_L | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q2_K_XL | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q3_K_M | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q3_K_S | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q3_K_XL | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q4_0 | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q4_1 | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q4_K_M | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q4_K_S | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q4_K_XL | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q5_K_M | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q5_K_S | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q5_K_XL | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q6_K | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q6_K_XL | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q8_0 | 125.03B | 256K | Code Multilingual Tool Calls | — |
| Devstral 2 123B Instruct 2512 | Mistral AI | Q8_K_XL | 125.03B | 256K | Code Multilingual Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q2_K_XL | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q3_K_M | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q3_K_S | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q3_K_XL | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q4_0 | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q4_1 | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q4_K_M | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q4_K_S | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q4_K_XL | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q5_K_M | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q5_K_S | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q5_K_XL | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q6_K | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q6_K_XL | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q8_0 | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 Flash | Zai Org | Q8_K_XL | 31.22B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q2_K | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q2_K_L | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q2_K_XL | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q3_K_M | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q3_K_S | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q3_K_XL | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q4_0 | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q4_1 | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q4_K_M | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q4_K_S | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q4_K_XL | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q5_K_M | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q5_K_S | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q5_K_XL | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q6_K | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q6_K_XL | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q8_0 | 358.34B | 198K | Code Thinking Tool Calls | — |
| GLM 4.7 | Zai Org | Q8_K_XL | 358.34B | 198K | Code Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | MXFP4 | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | FP16 | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q8_0 | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q8_K_XL | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q6_K | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q6_K_XL | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q5_K_M | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q5_K_S | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q4_K_M | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q4_K_S | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q4_K_XL | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q4_0 | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q4_1 | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q3_K_M | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q3_K_S | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q2_K | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 120B | OpenAI | Q2_K_L | 120.41B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | MXFP4 | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | FP16 | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q8_0 | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q8_K_XL | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q6_K | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q6_K_XL | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q5_K_M | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q5_K_S | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q4_K_M | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q4_K_S | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q4_K_XL | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q4_0 | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q4_1 | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q3_K_M | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q3_K_S | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q2_K | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| GPT OSS 20B | OpenAI | Q2_K_L | 21.51B | 128K | Multilingual Thinking Tool Calls | — |
| Granite 4.0 Tiny Base Preview | IBM | FP16 | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q2_K | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q3_K_L | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q3_K_M | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q3_K_S | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q4_0 | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q4_1 | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q4_K_M | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q4_K_S | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q5_0 | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q5_1 | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q5_K_M | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q5_K_S | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q6_K | 6.67B | 128K | Code Multilingual | — |
| Granite 4.0 Tiny Base Preview | IBM | Q8_0 | 6.67B | 128K | Code Multilingual | — |
| Kimi K2.5 | Moonshot AI | Q2_K | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q2_K_L | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q2_K_XL | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q3_K_M | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q3_K_S | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q3_K_XL | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q4_0 | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q4_1 | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q4_K_M | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q4_K_S | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q4_K_XL | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q5_K_M | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q5_K_S | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q5_K_XL | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q6_K | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q6_K_XL | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q8_0 | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2.5 | Moonshot AI | Q8_K_XL | 1016.23B | 256K | Code Thinking Tool Calls Vision | — |
| Kimi K2 Instruct | Moonshot AI | Q2_K | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q2_K_L | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q2_K_XL | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q3_K_M | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q3_K_S | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q3_K_XL | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q4_0 | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q4_1 | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q4_K_M | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q4_K_S | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q4_K_XL | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q5_K_M | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q5_K_S | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q5_K_XL | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q6_K | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q6_K_XL | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q8_0 | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Instruct | Moonshot AI | Q8_K_XL | 1026.47B | 128K | Code Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q2_K | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q2_K_L | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q2_K_XL | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q3_K_M | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q3_K_S | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q3_K_XL | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q4_0 | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q4_1 | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q4_K_M | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q4_K_S | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q4_K_XL | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q5_K_M | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q5_K_S | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q5_K_XL | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q6_K | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q6_K_XL | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q8_0 | 170.27B | 256K | Code Thinking Tool Calls | — |
| Kimi K2 Thinking | Moonshot AI | Q8_K_XL | 170.27B | 256K | Code Thinking Tool Calls | — |
| LFM2.5 1.2B Thinking | Liquid AI | FP16 | 1.17B | 125K | Multilingual Thinking Tool Calls | — |
| LFM2.5 1.2B Thinking | Liquid AI | Q4_0 | 1.17B | 125K | Multilingual Thinking Tool Calls | — |
| LFM2.5 1.2B Thinking | Liquid AI | Q4_K_M | 1.17B | 125K | Multilingual Thinking Tool Calls | — |
| LFM2.5 1.2B Thinking | Liquid AI | Q5_K_M | 1.17B | 125K | Multilingual Thinking Tool Calls | — |
| LFM2.5 1.2B Thinking | Liquid AI | Q6_K | 1.17B | 125K | Multilingual Thinking Tool Calls | — |
| LFM2.5 1.2B Thinking | Liquid AI | Q8_0 | 1.17B | 125K | Multilingual Thinking Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | FP16 | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q2_K | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q2_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q3_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q3_K_M | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q3_K_S | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q3_K_XL | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_0 | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_0_4_4 | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_0_4_8 | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_0_8_8 | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_K_M | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q4_K_S | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q5_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q5_K_M | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q5_K_S | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q6_K | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q6_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 3.3 70B Instruct | Meta | Q8_0 | 70B | 128K | Code Multilingual Tool Calls | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | FP16 | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q2_K | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q2_K_L | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q2_K_XL | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q3_K_M | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q3_K_S | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q3_K_XL | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q4_0 | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q4_1 | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q4_K_M | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q4_K_S | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q4_K_XL | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q5_K_M | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q5_K_S | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q5_K_XL | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q6_K | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q6_K_XL | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q8_0 | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Maverick 17B 128E Instruct | Meta | Q8_K_XL | 396.58B | 1M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | FP16 | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q2_K | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q2_K_L | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q2_K_XL | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q3_K_M | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q3_K_S | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q3_K_XL | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q4_0 | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q4_1 | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q4_K_M | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q4_K_S | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q4_K_XL | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q5_K_M | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q5_K_S | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q5_K_XL | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q6_K | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q6_K_XL | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q8_0 | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Llama 4 Scout 17B 16E Instruct | Meta | Q8_K_XL | 17B | 10M | Code Multilingual Tool Calls Vision | — |
| Meta Llama 3.1 70B Instruct | Meta | Q2_K | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q2_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q3_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q3_K_M | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q3_K_S | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q3_K_XL | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q4_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q4_K_M | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q4_K_S | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q5_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q5_K_M | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q5_K_S | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q6_K | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q6_K_L | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 70B Instruct | Meta | Q8_0 | 70B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | FP32 | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q2_K | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q2_K_L | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q3_K_L | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q3_K_M | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q3_K_S | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q3_K_XL | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q4_0_4_4 | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q4_0_4_8 | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q4_0_8_8 | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q4_K_L | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q4_K_M | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q4_K_S | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q5_K_L | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q5_K_M | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q5_K_S | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q6_K | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q6_K_L | 8B | 128K | Code Multilingual Tool Calls | — |
| Meta Llama 3.1 8B Instruct | Meta | Q8_0 | 8B | 128K | Code Multilingual Tool Calls | — |
| MiniMax M2 | MiniMax | Q2_K | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q2_K_L | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q2_K_XL | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q3_K_M | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q3_K_S | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q3_K_XL | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q4_0 | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q4_1 | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q4_K_M | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q4_K_S | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q4_K_XL | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q5_K_M | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q5_K_S | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q5_K_XL | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q6_K | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q6_K_XL | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q8_0 | 228.7B | 192K | Code Thinking Tool Calls | — |
| MiniMax M2 | MiniMax | Q8_K_XL | 228.7B | 192K | Code Thinking Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | FP16 | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | FP32 | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q2_K | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q2_K_L | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q2_K_XL | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q3_K_M | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q3_K_S | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q3_K_XL | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q4_0 | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q4_1 | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q4_K_M | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q4_K_S | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q4_K_XL | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q5_K_M | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q5_K_S | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q5_K_XL | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q6_K | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q6_K_XL | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q8_0 | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large 3 675B Instruct 2512 | Mistral AI | Q8_K_XL | 675B | 288K | Code Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q2_K | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q2_K_L | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q3_K_L | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q3_K_M | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q3_K_S | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q3_K_XL | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q4_0 | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q4_0_8_8 | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q4_K_M | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q4_K_S | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q5_K_M | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q5_K_S | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q6_K | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Large Instruct 2411 | Mistral AI | Q8_0 | 122.61B | 128K | Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | FP16 | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | FP32 | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q2_K | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q2_K_L | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q3_K_L | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q3_K_M | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q3_K_S | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q3_K_XL | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q4_0 | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q4_1 | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q4_K_L | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q4_K_M | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q4_K_S | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q5_K_L | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q5_K_M | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q5_K_S | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q6_K | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q6_K_L | 23.57B | 32K | Code Multilingual Tool Calls | — |
| Mistral Small 24B Instruct 2501 | Mistral AI | Q8_0 | 23.57B | 32K | Code Multilingual Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q2_K_L | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q2_K_XL | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q3_K_M | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q3_K_S | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q3_K_XL | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q4_0 | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q4_1 | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q4_K_M | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q4_K_S | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q4_K_XL | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q5_K_M | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q5_K_S | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q5_K_XL | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q6_K | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q6_K_XL | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q8_0 | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| NVIDIA Nemotron 3 Nano 30B A3B | NVIDIA | Q8_K_XL | 31.58B | 256K | Code Multilingual Thinking Tool Calls | — |
| Phi 3 mini 4k instruct | Microsoft | FP16 | 3.82B | 4K | Code | — |
| Phi 3 mini 4k instruct | Microsoft | Q4 | 3.82B | 4K | Code | — |
| Phi 4 | Microsoft | Q2_K | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q3_K | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q3_K_L | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q3_K_S | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q4_0 | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q4_1 | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q4_K | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q4_K_S | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q5_0 | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q5_1 | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q5_K | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q5_K_S | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q6_K | 14.66B | 16K | Code | — |
| Phi 4 | Microsoft | Q8_0 | 14.66B | 16K | Code | — |
| Qwen2.5 14B Instruct | Qwen | FP16 | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q2_K | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q3_K_M | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q4_0 | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q4_K_M | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q5_0 | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q5_K_M | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q6_K | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 14B Instruct | Qwen | Q8_0 | 14.77B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | FP16 | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q2_K | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q3_K_M | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q4_0 | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q4_K_M | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q5_0 | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q5_K_M | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q6_K | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 72B Instruct | Qwen | Q8_0 | 72.71B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | FP16 | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q2_K | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q3_K_M | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q4_0 | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q4_K_M | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q5_0 | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q5_K_M | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q6_K | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen2.5 7B Instruct | Qwen | Q8_0 | 7.62B | 32K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q2_K | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q2_K_L | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q2_K_XL | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q3_K_M | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q3_K_S | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q3_K_XL | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q4_1 | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q4_K_M | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q4_K_S | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q4_K_XL | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q5_K_M | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q5_K_S | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q5_K_XL | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q6_K | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q6_K_XL | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q8_0 | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 235B A22B | Qwen | Q8_K_XL | 235.09B | 40K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q2_K | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q2_K_L | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q2_K_XL | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q3_K_M | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q3_K_S | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q3_K_XL | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q4_0 | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q4_1 | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q4_K_M | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q4_K_S | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q4_K_XL | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q5_K_M | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q5_K_S | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q5_K_XL | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q6_K | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q6_K_XL | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q8_0 | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Coder Next | Qwen | Q8_K_XL | 79.67B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q2_K | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q2_K_L | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q2_K_XL | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q3_K_M | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q3_K_S | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q3_K_XL | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q4_0 | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q4_1 | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q4_K_M | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q4_K_S | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q4_K_XL | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q5_K_M | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q5_K_S | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q5_K_XL | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q6_K | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q6_K_XL | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q8_0 | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Instruct | Qwen | Q8_K_XL | 81.32B | 256K | Code Multilingual Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q2_K | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q2_K_L | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q2_K_XL | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q3_K_M | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q3_K_S | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q3_K_XL | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q4_0 | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q4_1 | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q4_K_M | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q4_K_S | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q4_K_XL | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q5_K_M | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q5_K_S | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q5_K_XL | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q6_K | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q6_K_XL | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q8_0 | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
| Qwen3 Next 80B A3B Thinking | Qwen | Q8_K_XL | 81.32B | 256K | Code Multilingual Thinking Tool Calls | — |
No models match your filters.