[Models](/models)/[Reranking](/models?category=reranking)/nvidia/llama-nemotron-rerank-1b-v2

HFRerankingother

# llama-nemotron-rerank-1b-v2

by nvidia

Lightweight 1B text reranker for production retrieval pipelines

815Kdl/month

61likes

1.2Bparams

[HuggingFace](https://huggingface.co/nvidia/llama-nemotron-rerank-1b-v2)[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

Identifiers

Model ID

`nvidia/llama-nemotron-rerank-1b-v2`

## Deploy llama-nemotron-rerank-1b-v2

Single-tenant

Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

[Read the customer-hosted guide](https://mixpeek.com/docs/customer-hosted/overview) [Talk to us about single-tenant](/demo)

## Overview

Llama-Nemotron Rerank 1B is NVIDIA's lightweight cross-encoder reranker based on Llama-3.2-1B. At 1B parameters, it is 3.5x smaller than mistral-based rerankers while delivering competitive quality across 26 languages and 8192-token context. It supports true/false relevance scoring: the model outputs the probability that a document is relevant to a query.

On Mixpeek, this reranker slots into the second stage of retrieval pipelines: after a fast embedding-based first stage returns top-K candidates, the reranker rescores each candidate with full cross-attention between query and document, significantly improving precision.

## Architecture

Cross-encoder based on Llama-3.2-1B. Outputs relevance probability via true/false token logits. 8192-token max context. 26-language support. Trained with progressive curriculum on diverse relevance data.

## Mixpeek SDK Integration

IngestRetrieve

// Reranking is a retriever STAGE in Mixpeek, not an ingest-time extractor.
// The rerank stage runs a cross-encoder inference service; the shipped default
// is BAAI/bge-reranker-v2-m3. Pointing it at llama-nemotron-rerank-1b-v2 means registering that
// model as a custom reranker plugin and naming it in feature\_uri, which is an
// Enterprise path. Stage contract read from GET /v1/discovery/stages.
const retriever = await mx.retrievers.create({
  namespace\_id: "my-namespace",
  retriever\_name: "search-then-rerank",
  stages: \[
    {
      stage\_name: "candidates",
      stage\_id: "feature\_search",
      parameters: { limit: 100 },
    },
    {
      stage\_name: "rerank\_results",
      stage\_id: "rerank",
      parameters: {
        inference\_name: "BAAI\_\_bge\_reranker\_v2\_m3",
        query: "{{INPUT.query}}",
        document\_field: "content",
        top\_k: 10,
      },
    },
  \],
});

## Capabilities

*   1B parameters: 3.5x smaller than 4B rerankers
*   26-language support including CJK and European languages
*   8192-token context for long document reranking
*   Cross-lingual reranking (86.83% on MLQA)
*   Production-grade latency on modest hardware

## Use Cases on Mixpeek

Two-stage retrieval: rerank embedding search results for higher precision

Multilingual search: rerank across 26 languages with one model

Long document reranking: handle full documents up to 8K tokens

RAG pipelines: improve context quality before LLM generation

## Benchmarks

Dataset

Metric

Score

Source

NQ + HotpotQA + FiQA + TechQA

Recall@5

73.64%

NVIDIA, 2026: Model Card

MLQA (cross-lingual, 7 langs)

Recall@5

86.83%

NVIDIA, 2026: Model Card

MLDR (long docs, 13 langs)

Recall@5

70.69%

NVIDIA, 2026: Model Card

## Performance

Input SizeText (up to 8192 tokens)

GPU Latency~5ms / pair (A100)

GPU Throughput~200 pairs/sec (A100)

GPU Memory~2.5 GB

## Common Pipeline Companions

[

BAAI/bge-large-en-v1.5

First-stage embedding retrieval

](/model/BAAI/bge-large-en-v1.5)[

nvidia/omni-embed-nemotron-3b

Omnimodal first-stage retrieval

](/model/nvidia/omni-embed-nemotron-3b)

## Explore on Mixpeek

[

More Reranking models

Compare alternatives in this category

](/models?category=reranking)[

Best Hybrid Search Engines

Hand-picked tools & platforms compared

](/curated-lists/best-hybrid-search-engines)[

Cross-Encoder Reranking

Deep-dive technical guide

](/guides/cross-encoder-reranking)[

Feature Extractors

See how Mixpeek runs models as extractors

](/extractors)[

Mixpeek Vector Store

Store & search embeddings at scale

](/mvs)[

Pricing

Usage-based pricing for pipelines

](/pricing)[

All Curated Lists

Compare models, APIs & infrastructure

](/curated-lists)

### Specification

FrameworkHF

Organizationnvidia

FeatureReranking

OutputRelevance score per candidate

Modalities

RetrieverCross-Modal Reranker

Parameters1.2B

Licenseother

Downloads/mo815K

Likes61

[

### Research Paper

NVIDIA NeMo Retriever Reranking

arxiv.org](https://huggingface.co/nvidia/llama-nemotron-rerank-1b-v2)

### Build a pipeline with llama-nemotron-rerank-1b-v2

Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

### Alternative Models

[

Qwen/Qwen3-VL-Reranker-2B

Reranking

](/model/Qwen/Qwen3-VL-Reranker-2B)[

Qwen/Qwen3-VL-Reranker-8B

Reranking

](/model/Qwen/Qwen3-VL-Reranker-8B)[

nvidia/llama-nemotron-rerank-vl-1b-v2

Reranking

](/model/nvidia/llama-nemotron-rerank-vl-1b-v2)[

jinaai/jina-reranker-m0

Reranking

](/model/jinaai/jina-reranker-m0)