New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for Amazon Bedrock prompt caching #4472

Open

Henderson11 opened this issue Jan 22, 2025 · 0 comments

Labels

ai/provider enhancement

Henderson11 commented Jan 22, 2025

Feature Description

Was just added to Amazon Bedrock on December 4th. Please add this feature. Relevent website is linked.
I see that anthropopic has implemented this feature, but bedrock has not yet
https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-bedrock-preview-prompt-caching/
https://aws.amazon.com/blogs/aws/reduce-costs-and-latency-with-amazon-bedrock-intelligent-prompt-routing-and-prompt-caching-preview/

Use Cases

No response

Additional context

No response

Henderson11 added the enhancement label

lgrammel added the ai/provider label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment