GPT OSS 20B

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization ★ MXFP4 (11.28GB) - nativeFP16 (12.85GB)Q8_0 (11.28GB)Q8_K_XL (12.29GB)Q6_K (11.21GB)Q6_K_XL (11.21GB)Q5_K_M (10.91GB)Q5_K_S (10.91GB)Q4_K_M (10.83GB)Q4_K_S (10.82GB)Q4_K_XL (11.06GB)Q4_0 (10.71GB)Q4_1 (10.78GB)Q3_K_M (10.72GB)Q3_K_S (10.68GB)Q2_K (10.68GB)Q2_K_L (10.95GB)

Deploy