Blog_dumb

Develop a RAG-based application using Amazon Aurora with Amazon Kendra

Develop a RAG-based application using Amazon Aurora with Amazon Kendra

Generative AI and large language models (LLMs) are revolutionizing organizations across diverse sectors to enhance customer experience, which traditionally would take years to make progress. Every organization has data stored in data stores, either on premises or in cloud providers. You can embrace generative AI and enhance customer experience by converting your existing data into …

Develop a RAG-based application using Amazon Aurora with Amazon Kendra Read More »

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

In production generative AI applications, responsiveness is just as important as the intelligence behind the model. Whether it’s customer service teams handling time-sensitive inquiries or developers needing instant code suggestions, every second of delay, known as latency, can have a significant impact. As businesses increasingly use large language models (LLMs) for these critical tasks and …

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference Read More »

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval

Evaluating large language models (LLMs) is crucial as LLM-based systems become increasingly powerful and relevant in our society. Rigorous testing allows us to understand an LLM’s capabilities, limitations, and potential biases, and provide actionable feedback to identify and mitigate risk. Furthermore, evaluation processes are important not only for LLMs, but are becoming essential for assessing …

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval Read More »

Introducing Leading the Shift, a new Microsoft Azure podcast

Introducing Leading the Shift, a new Microsoft Azure podcast

The AI platform shift brings immense opportunity, but the road to success isn’t always easy or clear. That’s why we’ve asked customers, partners, Microsoft experts, and other leaders to share their journeys and insights in our new podcast, Leading the Shift. In each episode, we’ll explore how our guests are using data, AI, and cloud …

Introducing Leading the Shift, a new Microsoft Azure podcast Read More »

Create a SageMaker inference endpoint with custom model & extended container

Create a SageMaker inference endpoint with custom model & extended container

Amazon SageMaker provides a seamless experience for building, training, and deploying machine learning (ML) models at scale. Although SageMaker offers a wide range of built-in algorithms and pre-trained models through Amazon SageMaker JumpStart, there are scenarios where you might need to bring your own custom model or use specific software dependencies not available in SageMaker …

Create a SageMaker inference endpoint with custom model & extended container Read More »

Image and video prompt engineering for Amazon Nova Canvas and Amazon Nova Reel

Image and video prompt engineering for Amazon Nova Canvas and Amazon Nova Reel

Amazon has introduced two new creative content generation models on Amazon Bedrock: Amazon Nova Canvas for image generation and Amazon Nova Reel for video creation. These models transform text and image inputs into custom visuals, opening up creative opportunities for both professional and personal projects. Nova Canvas, a state-of-the-art image generation model, creates professional-grade images …

Image and video prompt engineering for Amazon Nova Canvas and Amazon Nova Reel Read More »

Security best practices to consider while fine-tuning models in Amazon Bedrock

Security best practices to consider while fine-tuning models in Amazon Bedrock

Amazon Bedrock has emerged as the preferred choice for tens of thousands of customers seeking to build their generative AI strategy. It offers a straightforward, fast, and secure way to develop advanced generative AI applications and experiences to drive innovation. With the comprehensive capabilities of Amazon Bedrock, you have access to a diverse range of …

Security best practices to consider while fine-tuning models in Amazon Bedrock Read More »

Secure a generative AI assistant with OWASP Top 10 mitigation

Secure a generative AI assistant with OWASP Top 10 mitigation

A common use case with generative AI that we usually see customers evaluate for a production use case is a generative AI-powered assistant. However, before it can be deployed, there is the typical production readiness assessment that includes concerns such as understanding the security posture, monitoring and logging, cost tracking, resilience, and more. The highest …

Secure a generative AI assistant with OWASP Top 10 mitigation Read More »

Scroll to Top