Qwen2.5 7B Instruct

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization FP16 (14.19GB)Q2_K (2.81GB)Q3_K_M (3.55GB)Q4_0 (4.13GB)Q4_K_M (4.36GB)Q5_0 (4.95GB)Q5_K_M (5.08GB)Q6_K (5.83GB)Q8_0 (7.54GB)

Deploy