Blog_dumb

Optimizing cost and latency with Amazon Bedrock prompt caching

Optimizing cost and latency with Amazon Bedrock prompt caching

Prompt caching in Amazon Bedrock can reduce your input token costs by up to 90 percent when you repeatedly send the same context to foundation models, based on Amazon Bedrock prompt caching pricing. Without caching, a 10,000-token contract sent alongside 50 user questions means 500,000 input tokens billed at full price for content the model […]

Optimizing cost and latency with Amazon Bedrock prompt caching Read More »

Build an AI-powered product tagging system with Amazon SageMaker serverless model customization

Build an AI-powered product tagging system with Amazon SageMaker serverless model customization

Retail catalogs rarely arrive as clean, structured attributes. Product names, descriptions, and category paths come from many sources and change continuously. Search, recommendations, and catalog navigation depend on consistent tags, but manually applying those tags across thousands of stock keeping units (SKUs) is slow and difficult to keep consistent. A general-purpose frontier model can generate

Build an AI-powered product tagging system with Amazon SageMaker serverless model customization Read More »

Announcing instance preference lists for Amazon SageMaker AI training jobs

Announcing instance preference lists for Amazon SageMaker AI training jobs

Getting access to the right GPUs when you need them is one of the biggest challenges in training or customizing AI models at scale. During peak demand periods, your preferred GPU may not be immediately available – and when your job is tied to one specific GPU configuration, the only option is to wait or

Announcing instance preference lists for Amazon SageMaker AI training jobs Read More »

Abnormal AI: Amazon Bedrock AgentCore for agentic email security at scale

Abnormal AI: Amazon Bedrock AgentCore for agentic email security at scale

AI agents now run in production at a scale of billions of operations a day, and a recurring architectural pattern has surfaced: agents need a compute scratch pad. Not only for coding tasks, but for data aggregation, analysis, verification, and any workflow where semantic reasoning alone isn’t enough. Abnormal AI, a behavioral security service that

Abnormal AI: Amazon Bedrock AgentCore for agentic email security at scale Read More »

Manage end-user OAuth consent for AI agents with Amazon Bedrock AgentCore

Manage end-user OAuth consent for AI agents with Amazon Bedrock AgentCore

AI agents often need to access services such as GitHub and Slack on a user’s behalf. Before an agent can act, the user must authenticate with the provider and explicitly approve the requested access. The application must then securely associate the resulting OAuth grant with the user who authorized it. This process is called session

Manage end-user OAuth consent for AI agents with Amazon Bedrock AgentCore Read More »

Scroll to Top