Will there be int 4 ONNX DirectML versions in the future?
#5
by
PaulTheHuman
- opened
Hi, I have used the phi-3 int4 DirectML onnx versions and am hoping there will also be a 3.5 version in the future for the mini and also the vision models :)
Thank you most sincerely. 🙂
Hi, I have used the phi-3 int4 DirectML onnx versions and am hoping there will also be a 3.5 version in the future for the mini and also the vision models :)
Thank you most sincerely. 🙂
We are working on the Int4 DML ONNX version for both Phi-3.5 mini and vision. The models are coming shortly. Please stay tuned :)
Is there any progress or information you can provide us with? 😊