Mistral AI’s Mixtral 8x7B: Upstart new open source offering rivals or surpasses results of larger models

Mistral AI, a Paris-based startup, is shaking up the AI industry with its Mixtral 8x7B model, outperforming giants like ChatGPT and Llama with speed and efficiency.

Mistral AI steps into the competitive field with Mixtral 8x7B, an open-source model leveraging Sparse Mixture of Experts architecture for efficient pre-training and scalability. The model and its “Mixture of Experts” approach achieves the performance of larger models with far less compute and far less time required for training.

Demonstrating impressive performance, Mixtral 8x7B matched ChatGPT 3.5 in testing and outdid Llama 2 70B on benchmarks, with six times faster inference.

With significant funding secured, Mistral AI introduces ‘La Plateforme’ for model API endpoints, offering Mistral Tiny and Small, and monetizing the forthcoming Mistral Medium. This dual-revenue strategy boosts Mistral’s open-source venture, propelling its valuation potentially over two billion dollars.

Sources include: Analytics India

IT World Canada Staff
IT World Canada Staff
The online resource for Canadian Information Technology professionals.

Would you recommend this article?


Thanks for taking the time to let us know what you think of this article!
We'd love to hear your opinion about this or any other story you read in our publication.

Jim Love, Chief Content Officer, IT World Canada

Featured Download

ITW in your inbox

Our experienced team of journalists and bloggers bring you engaging in-depth interviews, videos and content targeted to IT professionals and line-of-business executives.

More Best of The Web