Skip to content

Conversation

@Anajrim01
Copy link
Contributor

@Anajrim01 Anajrim01 commented Oct 13, 2024

This PR introduces several new AI models to the project, enhancing its functionality and providing additional options for AI service users.

Changes

  1. New AI Models Added in AiModel Enum:

    • Meta
      • Llama31_70b
      • Llama32_11b_TextPreview
      • Llama31_8b_Instant
      • Llama32_3b_Preview
      • LlamaGuard38b
      • Llama32_90b_TextPreview
      • Llama32_1b_Preview
      • Llama32_11b_VisionPreview
    • Google
      • Gemma2_9b
      • Gemma7b
  2. Updated models Object with Configuration and Pricing Details:

    • Added maxTokens, contextWindow, costInput, costOutput, and middlewareDeploymentName for each model.
  3. Documentation and Comments:

    • Updated documentation and inline comments to reflect changes and provide clear usage guidelines for new models and functions.

image

@vercel
Copy link

vercel bot commented Oct 13, 2024

@Anajrim01 is attempting to deploy a commit to the ShipBit Team on Vercel.

A member of the Team first needs to authorize it.

@vercel
Copy link

vercel bot commented Oct 13, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
slickgpt ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 13, 2024 4:40pm

@Shackless
Copy link
Contributor

Shackless commented Oct 13, 2024

@Anajrim01 I still want to implement the /models endpoints of our providers at some point so that we won't have to update the models manually anymore but I'll merge your PR as temporary solution when it's ready. Thanks!

@Anajrim01
Copy link
Contributor Author

Anajrim01 commented Oct 13, 2024

@Anajrim01 I still want to implement the /models endpoints of our providers at some point so that we won't have to update the models manually anymore but I'll merge your PR as temporary solution when it's ready. Thanks!

Yep, I was looking into it, and agree that /models endpoint should be used. This PR I added for the file uploads as the 8k tokens limit of Llama3 is too small for files to be parsed correctly and then ask questions about files.

@Anajrim01 Anajrim01 marked this pull request as ready for review October 13, 2024 16:04
@Anajrim01

This comment was marked as outdated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants