BnB Deprecation warning

#2
by Sciumo - opened

The load_in_4bit and load_in_8bit arguments are deprecated and will be removed in the future versions. Please, pass a BitsAndBytesConfig object in quantization_config argument instead.

Owner

The code example has been updated to using BitsAndBytesConfig. Thanks!

yifeihu changed discussion status to closed

Sign up or log in to comment