Llama 3.3 70B Instruct

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization FP16 (131.43GB)Q2_K (24.56GB)Q2_K_L (25.52GB)Q3_K_L (34.59GB)Q3_K_M (31.91GB)Q3_K_S (28.79GB)Q3_K_XL (35.45GB)Q4_0 (37.36GB)Q4_0_4_4 (37.22GB)Q4_0_4_8 (37.22GB)Q4_0_8_8 (37.22GB)Q4_K_L (40.33GB)Q4_K_M (39.6GB)Q4_K_S (37.58GB)Q5_K_L (47.13GB)Q5_K_M (46.52GB)Q5_K_S (45.32GB)Q6_K (53.91GB)Q6_K_L (54.39GB)Q8_0 (69.82GB)

Deploy