RoBERTa Large

MetaRoBERTaStatus: legacy

RoBERTa Large is a encoder, foundation, research AI model developed by Meta, part of the RoBERTa family. It was released on 2019-07-26. Its tracked lifecycle status is legacy. It supports a context window of 512 tokens. It has 355M parameters.

Specifications

Organization
Meta
Model family
RoBERTa
Generation
Large
Status
legacy
Released
2019-07-26
Model type
Encoder, Foundation, Research
Input modalities
text
Output modalities
text
Context window
512 tokens
Parameters
355M
License
MIT
Weights
open weights
Official API
No
Self-hostable
Yes
Last verified
2026-08-01

Official sources

arXivOfficial site

Related models in the RoBERTa family

Interactive filtering and search on this page need JavaScript; every fact above is part of the page itself.