The Platform

Mistral AI brings the strongest open generative models to the developers, along with efficient ways to deploy and customize them for production.
The Platform

The Platform Mistral AI has launched its platform, providing beta access to three chat endpoints (mistral-tiny, mistral-small, mistral-medium) and an embedding endpoint. These services utilize various open and prototype models, offering different performance-price tradeoffs and supporting multiple languages and code generation. The platform aims to provide developers with efficient tools for deploying and customizing these models.

  • Mistral AI’s new platform offers beta access to generative text and embedding endpoints.
  • Three chat endpoints (mistral-tiny, mistral-small, mistral-medium) vary in performance, price, and supported models.
  • Mistral-tiny uses Mistral 7B Instruct v0.2 (English only), Mistral-small uses Mixtral 8x7B (multilingual), and Mistral-medium uses a prototype model (multilingual).
  • An embedding endpoint, Mistral-embed, is available with a 1024 embedding dimension.
  • The API specifications follow a popular chat interface, with Python and Javascript client libraries available.
  • Users can provide system prompts for higher moderation levels.
  • NVIDIA is acknowledged for their support in integrating TensorRT-LLM and Triton. Continue reading https://foxvector.com/articles/3a4d10e9-5b76-4dde-bb57-bc9887831d41
Write a comment
No comments yet.