Meta Llama 3.1 8B Instruct

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization FP32 (29.92GB)Q2_K (2.96GB)Q2_K_L (3.44GB)Q3_K_L (4.03GB)Q3_K_M (3.74GB)Q3_K_S (3.41GB)Q3_K_XL (4.45GB)Q4_0_4_4 (4.34GB)Q4_0_4_8 (4.34GB)Q4_0_8_8 (4.34GB)Q4_K_L (4.95GB)Q4_K_M (4.58GB)Q4_K_S (4.37GB)Q5_K_L (5.64GB)Q5_K_M (5.34GB)Q5_K_S (5.21GB)Q6_K (6.14GB)Q6_K_L (6.38GB)Q8_0 (7.95GB)

Deploy