You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am new to using the MLIR compiler and would like to ask some questions?
While searching for some information, I found that some communities have IREE based compilers that are modified to support LLM compilation, such as the shark turbine for AMD GPUs or Sifive's MLIR based compiler.
I would like to ask if it is possible to support LLM compilation if we only git clone IREE's source code in this community.
For example, compiling an LLM7-b model in hugging face format.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Dear authors and developers:
I am new to using the MLIR compiler and would like to ask some questions?
While searching for some information, I found that some communities have IREE based compilers that are modified to support LLM compilation, such as the shark turbine for AMD GPUs or Sifive's MLIR based compiler.
I would like to ask if it is possible to support LLM compilation if we only git clone IREE's source code in this community.
For example, compiling an LLM7-b model in hugging face format.
Best regards,
User
Beta Was this translation helpful? Give feedback.
All reactions