BERT Large
BERT Large is released 2018-10-11 in the BERT family with open-source; evaluate it while provider pricing coverage matures.
- Family
- BERT
- Released
- 2018-10-11
- Context
- 512
- Parameters
- 340M
- Architecture
- Decoder Only
- Specialization
- general
- Openness
- Open source
- License
- Apache 2.0OSI-approvedCommercial use: permitted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
No tracked provider pricing is available yet.
About
BERT, or Bidirectional Encoder Representations from Transformers, is a sophisticated large language model developed by Google AI in 2018. It utilizes a transformer architecture based on self-attention mechanisms, enabling it to process text bidirectionally by considering context from both preceding and succeeding words. This capability allows BERT to capture complex language structures and word relationships more effectively than its predecessors. BERT's architecture primarily comprises encoder layers that convert input text into contextualized representations for various tasks. Pre-trained on extensive datasets including BooksCorpus and English Wikipedia, it leverages masked language modeling and next sentence prediction during training.
Providers
No active provider routes are tracked for this model yet.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
No task-mapped benchmark peers are available for this model yet.
Migration checks
No linked migration route is available for this model yet.
No tracked provider pricing is available yet.