GPT OSS 120B

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization ★ MXFP4 (59.03GB) - nativeFP16 (60.88GB)Q8_0 (59.03GB)Q8_K_XL (60.04GB)Q6_K (58.93GB)Q6_K_XL (58.93GB)Q5_K_M (58.57GB)Q5_K_S (58.56GB)Q4_K_M (58.46GB)Q4_K_S (58.45GB)Q4_K_XL (58.69GB)Q4_0 (58.32GB)Q4_1 (58.41GB)Q3_K_M (58.32GB)Q3_K_S (58.27GB)Q2_K (58.27GB)Q2_K_L (58.54GB)

Deploy