Codestral
About
Codestral is Mistral AI's family of large language models crafted for code generation tasks. The flagship model, Codestral-22B-v0.1, is equipped with 22 billion parameters and has been trained on a diverse dataset encompassing over 80 programming languages, from widely used ones like Python, Java, C++, JavaScript, and Bash to more niche languages such as Swift and Fortran 13. This versatility supports developers in various coding environments, enhancing tasks such as code completion, generation, and testing by using instruction-following and fill-in-the-middle (FIM) techniques. Available under Mistral AI's Non-Production License for research and testing, Codestral also offers commercial licensing options. Additionally, the Codestral Mamba variant employs a state space model (SSM) for linear time inference, accommodating longer coding sequences efficiently 13.