You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Theres almost no official documentation I can find for mlx_lm.server. Per this discussion, this project is intended to rival other solutions like llama.cpp. However the lack of documentation and the cascading effect to poor results from AI search engines and no presence in tech forums like reddit, means despite using solely Apple hardware I am just relying on llama.cpp.
Request to please create a robust documentation site.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Theres almost no official documentation I can find for mlx_lm.server. Per this discussion, this project is intended to rival other solutions like llama.cpp. However the lack of documentation and the cascading effect to poor results from AI search engines and no presence in tech forums like reddit, means despite using solely Apple hardware I am just relying on llama.cpp.
Request to please create a robust documentation site.
Beta Was this translation helpful? Give feedback.
All reactions