DeepSeek R1 Distill Llama 70B

Hardware Configuration

Vendor Select vendor... Other FrameworkHetznerMinisforumNVIDIAOVHScaleway

Product —

Platform Select platform... AMDApple SiliconCPU OnlyNVIDIA

Family —

Model —

VRAM —

System RAM —

Clear Configuration

Model Configuration

Quantization FP16 (131.43GB)Q2_K (24.56GB)Q2_K_L (24.79GB)Q2_K_XL (25.11GB)Q3_K_M (31.91GB)Q3_K_S (28.79GB)Q3_K_XL (32.48GB)Q4_0 (37.36GB)Q4_1 (41.27GB)Q4_K_M (39.6GB)Q4_K_S (37.58GB)Q4_K_XL (39.73GB)Q5_K_M (46.52GB)Q5_K_S (45.32GB)Q5_K_XL (46.54GB)Q6_K (107.82GB)Q6_K_XL (56.96GB)Q8_0 (69.82GB)Q8_K_XL (75.66GB)

Deploy