Blog_dumb

Mixture of Experts (MoE) architectures for large language models (LLMs) have recently gained popularity due to their ability to increase model capacity and computational efficiency compared to fully dense models. By utilizing sparse expert subnetworks that process different subsets of tokens, MoE models can effectively increase the number of parameters while requiring less computation per …

Accelerate Mixtral 8x7B pre-training with expert parallelism on Amazon SageMaker Read More »

Learn how new Google AI on Android features can boost employee productivity, help developers to build smarter tools and improve business workflows.

In the world of online retail, creating high-quality product descriptions for millions of products is a crucial, but time-consuming task. Using machine learning (ML) and natural language processing (NLP) to automate product description generation has the potential to save manual effort and transform the way ecommerce platforms operate. One of the main advantages of high-quality …

Generating fashion product descriptions by fine-tuning a vision-language model with SageMaker and Amazon Bedrock Read More »

Retrieval Augmented Generation (RAG) models have emerged as a promising approach to enhance the capabilities of language models by incorporating external knowledge from large text corpora. However, despite their impressive performance in various natural language processing tasks, RAG models still face several limitations that need to be addressed. Naive RAG models face limitations such as …

Create a multimodal assistant with advanced RAG and Amazon Bedrock Read More »

This post is co-written with Aurélien Capdecomme and Bertrand d’Aure from 20 Minutes. With 19 million monthly readers, 20 Minutes is a major player in the French media landscape. The media organization delivers useful, relevant, and accessible information to an audience that consists primarily of young and active urban readers. Every month, nearly 8.3 million 25–49-year-olds choose …

How 20 Minutes empowers journalists and boosts audience engagement with generative AI on Amazon Bedrock Read More »

In the rapidly evolving landscape of artificial intelligence (AI), the rise of generative AI models has ushered in a new era of personalized and intelligent experiences. Organizations are increasingly using the power of these language models to drive innovation and enhance their services, from natural language processing to content generation and beyond. Using generative AI …

Efficient and cost-effective multi-tenant LoRA serving with Amazon SageMaker Read More »

Read more announcements from Azure at Microsoft Build 2024: New ways Azure helps you build transformational AI experiences and The new era of compute powering Azure AI solutions. At Microsoft Build 2024, we are excited to add new models to the Phi-3 family of small, open models developed by Microsoft. We are introducing Phi-3-vision, a …

New models added to the Phi-3 family, available on Microsoft Azure Read More »

Today, we are excited to announce the Mixtral-8x22B large language model (LLM), developed by Mistral AI, is available for customers through Amazon SageMaker JumpStart to deploy with one click for running inference. You can try out this model with SageMaker JumpStart, a machine learning (ML) hub that provides access to algorithms and models so you …

Mixtral 8x22B is now available in Amazon SageMaker JumpStart Read More »

Generative AI is a type of artificial intelligence (AI) that can be used to create new content, including conversations, stories, images, videos, and music. Like all AI, generative AI works by using machine learning models—very large models that are pretrained on vast amounts of data called foundation models (FMs). FMs are trained on a broad …

Building Generative AI prompt chaining workflows with human in the loop Read More »

Google invests $2 million in INSAIT, the Institute for Computer Science, Artificial Intelligence and Technology in Sofia, Bulgaria.