NEWVectors or files. Pick a path.Start →
    Models/Text Generation/RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
    Text Generationtransformersllama3.1

    Meta-Llama-3.1-70B-Instruct-quantized.w4a16

    by RedHatAI

    116Kdl/month
    33likes
    Identifier
    Model ID
    RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

    Tags

    transformerssafetensorsllamatext-generationint4vllmconversationalendefritpthiestharxiv:2210.17323base_model:meta-llama/Llama-3.1-70B-Instructbase_model:quantized:meta-llama/Llama-3.1-70B-Instructlicense:llama3.1text-generation-inferenceendpoints_compatible4-bitgptqregion:us

    Use Meta-Llama-3.1-70B-Instruct-quantized.w4a16 on Mixpeek

    Build multimodal processing pipelines with this model and others. Extract features, run inference, and set up retrieval in Mixpeek Studio.

    Open Studio