Skip to content

Conversation

@stevensu1977
Copy link

Add Amazon Bedrock support

BEDROCK_MODEL_IDS = {
"claude-3.5-haiku": "anthropic.claude-3-5-haiku-20241022-v1:0",
"claude-3.5-sonnet": "anthropic.claude-3-5-sonnet-20241022-v2:0",
"nova-lite":"amazon.nova-lite-v1:0",
"nova-pro":"amazon.nova-pro-v1:0",
}

@felixbuenemann
Copy link
Contributor

I would remove the BEDROCK_MODEL_IDS mapping, it prevents the usage with new model versions and it also doesn't work for all regions, eg. in eu-central-1 there is only anthropic.claude-3-haiku-20240307-v1:0 and the anthropic.claude-3-5-sonnet-20241022-v2:0 is not yet available. You could use the anthropic.claude-3-5-sonnet-20240620-v1:0 it should be available in most regions.

@felixbuenemann
Copy link
Contributor

I tested this code and it is currently completely broken…

@chrishayuk
Copy link
Owner

@felixbuenemann @stevensu1977 thanks for the contribution. i've migrated to the chuk-llm library, i've not added bedrock to chuk_llm yet, so if you fancy adding then that would be great. here is the link https://github.com/chrishayuk/chuk-llm , otherwise i should add it in the next few days

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants