-
Notifications
You must be signed in to change notification settings - Fork 5.4k
Add BYOK blogpost #8985
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add BYOK blogpost #8985
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@olguzzar Just a few minor changes. LGTM!
Co-authored-by: Nick Trogh <ntrogh@hotmail.com>
Co-authored-by: Nick Trogh <ntrogh@hotmail.com>
Co-authored-by: Nick Trogh <ntrogh@hotmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall this looks good. Some high level feedback:
a) I would reduce the marketing tone a bit, so it is more down to earch (the experience is far from perfect)
b) Try to make it a bit more concise. I think we can save on one paragraph
c) I would embrace some of the shortcomings and clearly state that we are investing in this and looking for feedback. For example BYOK currently does not work with Completions or with NES.
|
|
||
| The Language Model Chat Provider API is just the beginning of bringing more model choice to you. As this model ecosystem grows, we expect to see: | ||
|
|
||
| * More specialized models for specific programming languages and domains |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The what's next bullet list needs work. Currently all 3 items are fuzzy and I am not sure what they actually mean. I suggest to instead mention:
- Model management UI that allows you to learn about model capabilities and manage models
- Smoother flow for installing extensions that contribute language models
- Improvements to the built-in language model providers - using latest provider APIs, having specialised prompts depending on the model
You can also check with @dineshc-msft as members of his team are taking over some of the built-in BYOK experiences and he might have feedback on what's coming.
No description provided.