Mistral Small 24B Instruct 2501

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization FP16 (43.92GB)FP32 (87.82GB)Q2_K (8.28GB)Q2_K_L (8.89GB)Q3_K_L (11.55GB)Q3_K_M (10.69GB)Q3_K_S (9.69GB)Q3_K_XL (12.1GB)Q4_0 (12.57GB)Q4_1 (13.85GB)Q4_K_L (13.81GB)Q4_K_M (13.35GB)Q4_K_S (12.62GB)Q5_K_L (16GB)Q5_K_M (15.61GB)Q5_K_S (15.18GB)Q6_K (18.02GB)Q6_K_L (18.32GB)Q8_0 (23.33GB)

Deploy