ELYZA Japanese CodeLlama Models by ELYZA
About
The ELYZA Japanese CodeLlama family of large language models (LLMs) is designed for Japanese language processing, particularly excelling in code generation and completion tasks. Derived from the Meta Code Llama architecture, these models, developed by ELYZA, Inc., enhance Japanese language understanding through significant improvements and capabilities. The family includes the base model ELYZA-japanese-CodeLlama-7b and its instruction-tuned counterpart ELYZA-japanese-CodeLlama-7b-instruct, each with distinct performance characteristics. Boasting a vocabulary size of 32,016 and 6.27 billion parameters, these models underwent additional pre-training with 18 billion tokens from Japanese datasets like OSCAR and Wikipedia. Furthermore, the instruction-tuned model is fine-tuned to better follow instructions across various tasks. Both models are accessible under the Llama 2 Community License, permitting research and commercial use as per the Acceptable Use Policy 1256.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 100k context and 7B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| ELYZA Japanese CodeLlama 7B | Use when the workload needs 100k context and 7B parameters. | 2023-09 | 100k context7B parameters | Current |
Release Timeline
1 release groupSpecifications(1 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| ELYZA Japanese CodeLlama 7B | 2023-09 | 100k | 7B |
Frequently Asked Questions
- What is ELYZA Japanese CodeLlama used for?
- ELYZA Japanese CodeLlama is used for coding. The family description and listed model capabilities point to those workloads as the best fit.
- How does ELYZA Japanese CodeLlama compare to StarCoder?
- ELYZA Japanese CodeLlama by ELYZA is strongest where you need coding, while StarCoder by ServiceNow Research is the closest related family to check for coding. ELYZA Japanese CodeLlama has 1 listed variant and reaches up to 100k context, while StarCoder reaches up to 8k context, so compare the specs and pricing tables before choosing a production model.
- Which ELYZA Japanese CodeLlama model should I use?
- If price is the main constraint, use the pricing table first because ELYZA Japanese CodeLlama does not have complete provider pricing in the local data. For the most capable/latest local choice, evaluate ELYZA Japanese CodeLlama 7B with 100k context.
