[Models](/models)/[Fill Mask](/models/fill-mask)/FacebookAI/roberta-large

[Fill Mask](/models/fill-mask)transformersmit

# roberta-large

by FacebookAI

5.4Mdl/month

346likes

[HuggingFace](https://huggingface.co/FacebookAI/roberta-large)[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

Identifier

Model ID

`FacebookAI/roberta-large`

## Deploy roberta-large

Single-tenant

Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

[Read the customer-hosted guide](https://mixpeek.com/docs/customer-hosted/overview) [Talk to us about single-tenant](/demo)

## Tags

transformerspytorchtfjaxonnxsafetensorsrobertafill-maskexbertendataset:bookcorpusdataset:wikipediaarxiv:1907.11692arxiv:1806.02847license:mitendpoints\_compatibledeploy:sagemakerregion:usdeploy:azure

## Use roberta-large on Mixpeek

Build multimodal processing pipelines with this model and others. Extract features, run inference, and set up retrieval in Mixpeek Studio.

[Open Studio](/start)

## How It Runs on Mixpeek

On Mixpeek, roberta-large runs as a managed extractor inside a processing pipeline. Point a bucket of fill mask data at it, and Mixpeek handles GPU provisioning, batching, retries, and writing the outputs into a vector store you can query.

Extractor outputs land in the Mixpeek Vector Store (MVS), where you can combine them with retrieval, reranking, and filter stages to build end-to-end search and agent-perception pipelines, no model-serving infrastructure to maintain.

## Explore on Mixpeek

[

More Fill Mask models

Compare alternatives in this category

](/models/fill-mask)[

Best Self-Hosted Embedding Models

Hand-picked tools & platforms compared

](/curated-lists/best-self-hosted-embedding-models)[

Instruction-Tuned Embeddings

Deep-dive technical guide

](/guides/instruction-tuned-embeddings)[

Feature Extractors

See how Mixpeek runs models as extractors

](/extractors)[

Mixpeek Vector Store

Store & search embeddings at scale

](/mvs)[

Pricing

Usage-based pricing for pipelines

](/pricing)[

All Curated Lists

Compare models, APIs & infrastructure

](/curated-lists)

### Specification

OrganizationFacebookAI

TaskFill Mask

Librarytransformers

Licensemit

Downloads/mo5.4M

Likes346

[

### View on HuggingFace

See model card, files, and community discussion

](https://huggingface.co/FacebookAI/roberta-large)

### Related Fill Mask Models

[

google-bert/bert-base-uncased

31.5M

](/model/google-bert/bert-base-uncased)[

FacebookAI/xlm-roberta-base

8.6M

](/model/FacebookAI/xlm-roberta-base)[

FacebookAI/roberta-base

6.0M

](/model/FacebookAI/roberta-base)[

distilbert/distilbert-base-uncased

5.5M

](/model/distilbert/distilbert-base-uncased)[

microsoft/mdeberta-v3-base

5.2M

](/model/microsoft/mdeberta-v3-base)[

facebook/esm2\_t33\_650M\_UR50D

3.7M

](/model/facebook/esm2_t33_650M_UR50D)[

google-bert/bert-base-cased

3.1M

](/model/google-bert/bert-base-cased)[

FacebookAI/xlm-roberta-large

3.0M

](/model/FacebookAI/xlm-roberta-large)