Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Name: Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Author: hugging-quants

by hugging-quants

169Kdl/month

109likes

HuggingFace Use in Pipeline

Identifier

Model ID

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Use Meta-Llama-3.1-70B-Instruct-AWQ-INT4 on Mixpeek

Build multimodal processing pipelines with this model and others. Extract features, run inference, and set up retrieval, all through the Mixpeek pipeline builder.

Open Pipeline Builder

Specification

Organizationhugging-quants

TaskText Generation

Librarytransformers

Licensellama3.1

Downloads/mo169K

Likes109

View on HuggingFace

See model card, files, and community discussion

Related Text Generation Models

Qwen/Qwen3-0.6B

18.1M

openai-community/gpt2

14.8M

Qwen/Qwen2.5-7B-Instruct

12.2M

deepseek-ai/DeepSeek-V3.2

11.0M

Qwen/Qwen2.5-1.5B-Instruct

10.0M

Qwen/Qwen3-4B-Instruct-2507

9.8M

meta-llama/Llama-3.1-8B-Instruct

9.2M

Qwen/Qwen2.5-3B-Instruct