Phi 4

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization Q2_K (5.17GB)Q3_K (6.86GB)Q3_K_L (7.39GB)Q3_K_S (6.06GB)Q4_0 (7.81GB)Q4_1 (8.63GB)Q4_K (8.43GB)Q4_K_S (7.86GB)Q5_0 (9.45GB)Q5_1 (10.28GB)Q5_K (9.88GB)Q5_K_S (9.45GB)Q6_K (11.2GB)Q8_0 (14.51GB)

Deploy