Please ignore this PR.
Will be fixed in AutoGPTQ instead https://github.com/PanQiWei/AutoGPTQ/pull/491
ยท Sign up or log in to comment