[Bugfix] Forward quantize better wrapping #521

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

kylesayrs wants to merge 1 commit into main from kylesayrs/forward-better-wrap

Collaborator

kylesayrs commented Nov 18, 2025

Purpose

Support wrapping modules after wrap_module_forward_quantized has been called (ie using torch offloader)

Changes

Instead of passing the original module as "self", use the self which is input to the wrapper function
- If self is changed (via wrapping, ect), those changes will now be reflected in the wrapper function

Testing

Tested e2e with torch offloader


          wrap better

7465d60

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet