Deci AI
Automating neural architecture design
About
Deci AI, founded in Tel Aviv in 2019, is a leading force in the realm of AI and deep learning acceleration. The company focuses on developing innovative solutions that empower developers by enhancing, optimizing, and expediting the deployment of AI models across various platforms, including cloud, edge, and mobile devices. A hallmark of Deci AI's approach is its emphasis on efficiency and cost-effectiveness, aiming to alleviate the computational and financial demands typical of AI model development and deployment 15. At the heart of Deci AI's technological advancements is their Automated Neural Architecture Construction (AutoNAC) engine. This cutting-edge NAS-based technology automatically configures and refines deep learning model architectures, focusing on achieving an optimal blend of accuracy and processing speed. By customizing models according to the unique demands of specific data sets, tasks, and performance goals, AutoNAC advances computer vision and natural language processing (NLP) technologies, evident in models like YOLO-NAS, DeciBERT, and DeciSeg 6. Deci AI's impact on generative AI and large language models (LLMs) is significant. The company has crafted a plethora of proprietary, fine-tunable LLMs and introduced Infery LLM, a novel inference engine complemented with an AI inference cluster management solution. Their flagship model, Deci-Nano, showcases leading-edge language and reasoning proficiency, surpassing rival models from giants like Google and Mistral regarding speed and cost-efficiency. Infery LLM notably advances Deci-Nano's real-time latency while minimizing expenses, enhancing the overall efficiency of the model 7. Additionally, Deci AI's portfolio includes noteworthy generative AI models such as the open-source DeciLM-7B, DeciCoder in various scales, and DeciDiffusion 2.0. These models focus on efficiency and are readily accessible via Deci's platform. The company ensures robust data security and control for enterprises, offering deployment options through a Virtual Private Cloud (VPC), directly within data centers, or via their API 3. Deci AI's remarkable journey includes collaborations with industry titans like Intel, AWS, NVIDIA, and HP, earning recognition from institutions like Gartner and MLPerf. In a notable development, Deci AI was acquired by NVIDIA in April 2024. This acquisition emphasizes Deci's substantial influence on the AI sector and its potential to further bolster NVIDIA's AI innovations. The company's commitment to open-source development, evidenced by models like DeciCoder, further illustrates its dedication to advancing innovation and accessibility within the AI community 5.
