Five ways Victoria’s Secret & Co. is using AI to make shopping more personalized and inclusive
A new partnership between Victoria’s Secret & Company and Google Cloud uses AI and generative AI to make online shopping more personalized and inclusive.
Build an Amazon SageMaker Model Registry approval and promotion workflow with human intervention
This post is co-written with Jayadeep Pabbisetty, Sr. Specialist Data Engineering at Merck, and Prabakaran Mathaiyan, Sr. ML Engineer at Tiger Analytics. The large machine learning (ML) model development lifecycle requires a scalable model release process similar to that of software development. Model developers often work together in developing ML models and require a robust …
Inference Llama 2 models with real-time response streaming using Amazon SageMaker
With the rapid adoption of generative AI applications, there is a need for these applications to respond in time to reduce the perceived latency with higher throughput. Foundation models (FMs) are often pre-trained on vast corpora of data with parameters ranging in scale of millions to billions and beyond. Large language models (LLMs) are a …
Inference Llama 2 models with real-time response streaming using Amazon SageMaker Read More »
Deploy a Slack gateway for Amazon Q, your business expert
Amazon Q is a new generative AI-powered application that helps users get work done. Amazon Q can become your tailored business expert and let you discover content, brainstorm ideas, or create summaries using your company’s data safely and securely. You can use Amazon Q to have conversations, solve problems, generate content, gain insights, and take …
Deploy a Slack gateway for Amazon Q, your business expert Read More »
Create a document lake using large-scale text extraction from documents with Amazon Textract
AWS customers in healthcare, financial services, the public sector, and other industries store billions of documents as images or PDFs in Amazon Simple Storage Service (Amazon S3). However, they’re unable to gain insights such as using the information locked in the documents for large language models (LLMs) or search until they extract the text, forms, …
Modernizing data science lifecycle management with AWS and Wipro
This post was written in collaboration with Bhajandeep Singh and Ajay Vishwakarma from Wipro’s AWS AI/ML Practice. Many organizations have been using a combination of on-premises and open source data science solutions to create and manage machine learning (ML) models. Data science and DevOps teams may face challenges managing these isolated tool stacks and systems. …
Modernizing data science lifecycle management with AWS and Wipro Read More »
Generating value from enterprise data: Best practices for Text2SQL and generative AI
Generative AI has opened up a lot of potential in the field of AI. We are seeing numerous uses, including text generation, code generation, summarization, translation, chatbots, and more. One such area that is evolving is using natural language processing (NLP) to unlock new opportunities for accessing data through intuitive SQL queries. Instead of dealing …
Generating value from enterprise data: Best practices for Text2SQL and generative AI Read More »
Amazon SageMaker model parallel library now accelerates PyTorch FSDP workloads by up to 20%
Large language model (LLM) training has surged in popularity over the last year with the release of several popular models such as Llama 2, Falcon, and Mistral. Customers are now pre-training and fine-tuning LLMs ranging from 1 billion to over 175 billion parameters to optimize model performance for applications across industries, from healthcare to finance …
Mixtral-8x7B is now available in Amazon SageMaker JumpStart
Today, we are excited to announce that the Mixtral-8x7B large language model (LLM), developed by Mistral AI, is available for customers through Amazon SageMaker JumpStart to deploy with one click for running inference. The Mixtral-8x7B LLM is a pre-trained sparse mixture of expert model, based on a 7-billion parameter backbone with eight experts per feed-forward …
Mixtral-8x7B is now available in Amazon SageMaker JumpStart Read More »
Deploy foundation models with Amazon SageMaker, iterate and monitor with TruEra
This blog is co-written with Josh Reini, Shayak Sen and Anupam Datta from TruEra Amazon SageMaker JumpStart provides a variety of pretrained foundation models such as Llama-2 and Mistal 7B that can be quickly deployed to an endpoint. These foundation models perform well with generative tasks, from crafting text and summaries, answering questions, to producing …
Deploy foundation models with Amazon SageMaker, iterate and monitor with TruEra Read More »