JAIS is an open-source large language model developed in the United Arab Emirates, specifically designed to understand and generate text in both Arabic and English. It is named after Jebel Jais, the highest mountain in the UAE, and is intended to bring the benefits of generative AI to the Arabic-speaking world.
JAIS is a transformer-based large language model with 13 billion parameters, and a larger 30 billion parameter version is also in development. It was created through a collaboration between Inception, a subsidiary of G42, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), and Cerebras Systems. The model was trained on a massive dataset of 395 billion tokens, including 116 billion Arabic tokens and 279 billion English tokens, to capture the complexity and nuances of both languages.
Handle Arabic dialects and its competitive performance with English models of similar size, despite being trained on significantly less English data. The model incorporates advanced features such as ALiBi position embeddings, SwiGLU, and maximal update parameterization to enhance its training efficiency and accuracy.
Serverless Inference API Hub in Promptitude:
Connect with AI providers by adding custom endpoints and API keys for your models. Enjoy secure, scalable inference without any server management, all while maintaining full control over your data and models.
Microsoft Azure Support:
Manage, test, and deploy all your prompts & providers in one place. All your devs need to do is copy&paste one API call. Make your app stand out from the crowd - with Promptitude.