Qwen2.5 72B Instruct

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization FP16 (135.84GB)Q2_K (25.45GB)Q3_K_M (33.02GB)Q4_0 (38.51GB)Q4_K_M (40.97GB)Q5_0 (46.89GB)Q5_K_M (48.1GB)Q6_K (55.76GB)Q8_0 (72.27GB)

Deploy