Value Error when trying to run
#4
by
itaytricks
- opened
when using the code snippet to run the pipeline, I get:
ValueError: rope_scaling must be a dictionary with two fields, type and factor, got {'factor': 8.0, 'low_freq_factor': 1.0, 'high_freq_factor': 4.0, 'original_max_position_embeddings': 8192, 'rope_type': 'llama3'
These new settings are only supported by transformers 4.43 and later. Did you update transformers?
Exactly. You need at leat transformers 4.43.1 because there was a bug in 4.43.0 that was fixed shortly afterwards.