Reducing hallucinations in large language models with custom intervention using Amazon Bedrock Agents

• Amazon Bedrock Guardrails offers hallucination detection and grounding checks (existing functionality)
• You can develop a custom hallucination score using RAGAS to reject generated responses (requires SNS)

Amazon Bedrock Flows is now generally available

• Prompt Flows are named to Amazon Bedrock Flows (Microsoft also uses the name Prompt Flows)
• You can now filter harmful content using Prompt node and Knowledge base node
• Improved traceability - you can now quickly debug workflows with traceability of input and outputs

Prompt Optimization on Amazon Bedrock

• This is exactly what it sounds like, you provide a prompt and your prompt is optimized for use with a specific model, which can result in significant improvements for Gen AI tasks