runtime error
of-00007.bin: 4%|▍ | 73.4M/1.66G [00:10<02:46, 9.51MB/s][A pytorch_model-00007-of-00007.bin: 64%|██████▍ | 1.06G/1.66G [00:11<00:03, 163MB/s] [A pytorch_model-00007-of-00007.bin: 89%|████████▊ | 1.47G/1.66G [00:12<00:00, 208MB/s][A pytorch_model-00007-of-00007.bin: 100%|█████████▉| 1.66G/1.66G [00:12<00:00, 134MB/s] Downloading shards: 100%|██████████| 7/7 [01:12<00:00, 12.22s/it][A Downloading shards: 100%|██████████| 7/7 [01:12<00:00, 10.32s/it] Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s][A Loading checkpoint shards: 0%| | 0/7 [00:20<?, ?it/s] Traceback (most recent call last): File "/home/user/app/app.py", line 5, in <module> model = AutoModelForCausalLM.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 566, in from_pretrained return model_class.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3480, in from_pretrained ) = cls._load_pretrained_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3870, in _load_pretrained_model new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 743, in _load_state_dict_into_meta_model set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs) File "/home/user/.local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 317, in set_module_tensor_to_device new_value = value.to(device) File "/home/user/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 298, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...