Offers fast, precise processing for interactive applications, ensuring high-quality, fact-based responses ideal for dynamic environments requiring online timely information.

This 8-billion parameter online model supports up to 128K tokens for detailed interactions, excelling in speed and response quality for chatbots and virtual assistants.

‍

Note: that the search subsystem of the Online LLMs do not attend to the system prompt. You can use the system prompt to provide instructions related to style, tone, and language of the response.