Runtime error on the Leaderboard

#45
by ahmadsy - opened

runtime error
Exit code: 1. Reason: n(*self.args, **self.kwargs)
File "/home/user/app/app.py", line 207, in process_model
meta = get_metadata(model_id)
File "/home/user/app/app.py", line 158, in get_metadata
readme_path = hf_hub_download(model_id, filename="README.md", etag_timeout=180)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py", line 101, in inner_f
return f(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1240, in hf_hub_download
return _hf_hub_download_to_cache_dir(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1389, in _hf_hub_download_to_cache_dir
_download_to_tmp_and_move(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1915, in _download_to_tmp_and_move
http_get(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 463, in http_get
r = _request_wrapper(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 399, in _request_wrapper
response = get_session().request(method=method, url=url, **params)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 66, in send
return super().send(request, *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 713, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: (ReadTimeoutError("HTTPSConnectionPool(host='huggingface.co', port=443): Read timed out. (read timeout=60)"), '(Request ID: c63a1bb9-def0-4920-a699-9c06cd9ae731)')

Container logs:

===== Application Startup at 2024-10-08 16:02:09 =====

Processing models: 0%| | 0/10532 [00:00<?, ?it/s]

Processing models: 1%| | 95/10532 [00:01<02:24, 72.06it/s]

Processing models: 2%|โ– | 251/10532 [00:02<01:32, 110.96it/s]

Processing models: 4%|โ– | 408/10532 [00:03<01:18, 129.15it/s]

Processing models: 5%|โ–Œ | 541/10532 [00:09<03:36, 46.24it/s]

Processing models: 12%|โ–ˆโ– | 1269/10532 [00:10<01:00, 153.57it/s]

Processing models: 15%|โ–ˆโ–Œ | 1585/10532 [00:12<01:03, 140.78it/s]

Processing models: 17%|โ–ˆโ–‹ | 1834/10532 [00:15<01:05, 133.36it/s]

Processing models: 19%|โ–ˆโ–‰ | 2040/10532 [00:16<01:03, 134.72it/s]

Processing models: 21%|โ–ˆโ–ˆ | 2225/10532 [00:18<01:02, 132.84it/s]

Processing models: 23%|โ–ˆโ–ˆโ–Ž | 2392/10532 [00:19<01:01, 132.63it/s]

Processing models: 24%|โ–ˆโ–ˆโ– | 2548/10532 [00:21<01:07, 118.75it/s]

Processing models: 26%|โ–ˆโ–ˆโ–Œ | 2698/10532 [00:22<01:09, 112.06it/s]

Processing models: 28%|โ–ˆโ–ˆโ–Š | 2925/10532 [00:23<00:58, 129.82it/s]

Processing models: 29%|โ–ˆโ–ˆโ–‰ | 3067/10532 [00:25<01:02, 120.36it/s]

Processing models: 31%|โ–ˆโ–ˆโ–ˆ | 3247/10532 [00:27<01:04, 112.17it/s]

Processing models: 32%|โ–ˆโ–ˆโ–ˆโ– | 3366/10532 [00:31<01:40, 71.24it/s]

Processing models: 38%|โ–ˆโ–ˆโ–ˆโ–Š | 3957/10532 [00:32<00:44, 147.15it/s]

Processing models: 40%|โ–ˆโ–ˆโ–ˆโ–‰ | 4161/10532 [00:33<00:41, 151.92it/s]

Processing models: 41%|โ–ˆโ–ˆโ–ˆโ–ˆโ– | 4355/10532 [00:37<01:01, 100.95it/s]

Processing models: 43%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 4558/10532 [00:38<00:51, 115.85it/s]

Processing models: 45%|โ–ˆโ–ˆโ–ˆโ–ˆโ– | 4723/10532 [00:41<00:59, 97.60it/s]

Processing models: 46%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 4858/10532 [00:42<00:55, 102.47it/s]

Processing models: 47%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 4990/10532 [00:44<00:59, 93.14it/s]

Processing models: 49%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 5119/10532 [00:45<00:54, 98.63it/s]

Processing models: 50%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 5253/10532 [00:46<00:50, 103.97it/s]

Processing models: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 5396/10532 [00:47<00:46, 110.91it/s]

Processing models: 52%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 5526/10532 [00:48<00:43, 115.20it/s]

Processing models: 54%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 5651/10532 [00:49<00:41, 117.53it/s]

Processing models: 55%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 5776/10532 [00:50<00:46, 101.30it/s]

Processing models: 57%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 5981/10532 [00:51<00:36, 125.29it/s]

Processing models: 58%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 6117/10532 [00:53<00:36, 122.10it/s]

Processing models: 59%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 6258/10532 [00:54<00:33, 126.78it/s]

Processing models: 61%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 6391/10532 [00:55<00:32, 126.24it/s]

Processing models: 62%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 6522/10532 [00:56<00:36, 110.94it/s]

Processing models: 64%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 6716/10532 [00:57<00:29, 129.92it/s]

Processing models: 65%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 6853/10532 [00:58<00:28, 130.88it/s]

Processing models: 66%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 6989/10532 [00:59<00:27, 129.48it/s]

Processing models: 68%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 7122/10532 [01:01<00:33, 103.10it/s]

Processing models: 69%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 7236/10532 [01:07<01:08, 48.18it/s]

Processing models: 74%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 7743/10532 [01:08<00:25, 109.21it/s]

Processing models: 75%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 7951/10532 [01:10<00:22, 115.01it/s]

Processing models: 77%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 8137/10532 [01:12<00:20, 114.64it/s]

Processing models: 79%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 8302/10532 [01:14<00:20, 107.17it/s]

Processing models: 80%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 8459/10532 [01:15<00:19, 107.25it/s]

Processing models: 82%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 8658/10532 [01:16<00:15, 121.60it/s]

Processing models: 84%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 8834/10532 [01:17<00:12, 130.91it/s]

Processing models: 85%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 8984/10532 [01:18<00:11, 130.40it/s]

Processing models: 87%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 9128/10532 [01:26<00:26, 53.28it/s]

Processing models: 93%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 9836/10532 [01:27<00:05, 127.11it/s]

Processing models: 96%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ| 10070/10532 [01:29<00:03, 126.41it/s]

Processing models: 98%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 10271/10532 [01:31<00:02, 117.54it/s]

Processing models: 99%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 10440/10532 [01:33<00:00, 108.59it/s]
Processing models: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 10532/10532 [01:33<00:00, 112.21it/s]

Processing models: 0%| | 0/3533 [00:00<?, ?it/s]

Processing models: 3%|โ–Ž | 97/3533 [00:02<01:38, 34.77it/s]

Processing models: 13%|โ–ˆโ–Ž | 465/3533 [00:04<00:25, 120.15it/s]

Processing models: 18%|โ–ˆโ–Š | 632/3533 [00:05<00:23, 123.51it/s]

Processing models: 22%|โ–ˆโ–ˆโ– | 777/3533 [00:07<00:24, 112.43it/s]

Processing models: 27%|โ–ˆโ–ˆโ–‹ | 949/3533 [00:08<00:22, 113.47it/s]

Processing models: 34%|โ–ˆโ–ˆโ–ˆโ– | 1200/3533 [00:10<00:17, 135.22it/s]

Processing models: 38%|โ–ˆโ–ˆโ–ˆโ–Š | 1342/3533 [00:11<00:17, 128.70it/s]

Processing models: 43%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 1531/3533 [00:12<00:14, 140.41it/s]

Processing models: 47%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 1677/3533 [00:13<00:13, 136.66it/s]

Processing models: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 1817/3533 [00:14<00:12, 136.76it/s]

Processing models: 55%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 1956/3533 [00:15<00:12, 128.94it/s]

Processing models: 59%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 2087/3533 [00:17<00:13, 107.22it/s]

Processing models: 62%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 2201/3533 [00:20<00:18, 73.92it/s]

Processing models: 67%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 2380/3533 [00:26<00:23, 49.05it/s]

Processing models: 86%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 3055/3533 [00:27<00:03, 126.18it/s]

Processing models: 94%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 3308/3533 [00:29<00:01, 123.82it/s]

Processing models: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 3520/3533 [00:31<00:00, 120.29it/s]
Processing models: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3533/3533 [00:31<00:00, 111.65it/s]

Processing models: 0%| | 0/4658 [00:00<?, ?it/s]

Processing models: 2%|โ– | 110/4658 [00:01<00:43, 105.11it/s]

Processing models: 5%|โ– | 216/4658 [00:02<00:44, 99.59it/s]

Processing models: 7%|โ–‹ | 333/4658 [00:03<00:42, 100.61it/s]

Processing models: 9%|โ–‰ | 438/4658 [00:04<00:42, 100.09it/s]

Processing models: 12%|โ–ˆโ– | 539/4658 [00:09<01:33, 43.87it/s]

Processing models: 21%|โ–ˆโ–ˆ | 977/4658 [00:10<00:32, 112.37it/s]

Processing models: 25%|โ–ˆโ–ˆโ–Œ | 1169/4658 [00:16<00:56, 61.64it/s]

Processing models: 37%|โ–ˆโ–ˆโ–ˆโ–‹ | 1741/4658 [00:17<00:24, 117.68it/s]

Processing models: 42%|โ–ˆโ–ˆโ–ˆโ–ˆโ– | 1968/4658 [00:19<00:22, 120.18it/s]

Processing models: 46%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 2164/4658 [00:21<00:21, 113.39it/s]

Processing models: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 2371/4658 [00:23<00:18, 122.29it/s]

Processing models: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 2371/4658 [00:39<00:18, 122.29it/s]
Processing models: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 2382/4658 [01:22<01:18, 28.87it/s]
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 536, in _make_request
response = conn.getresponse()
File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 464, in getresponse
httplib_response = super().getresponse()
File "/usr/local/lib/python3.10/http/client.py", line 1375, in getresponse
response.begin()
File "/usr/local/lib/python3.10/http/client.py", line 318, in begin
version, status, reason = self._read_status()
File "/usr/local/lib/python3.10/http/client.py", line 279, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/local/lib/python3.10/socket.py", line 705, in readinto
return self._sock.recv_into(b)
File "/usr/local/lib/python3.10/ssl.py", line 1307, in recv_into
return self.read(nbytes, buffer)
File "/usr/local/lib/python3.10/ssl.py", line 1163, in read
return self._sslobj.read(len, buffer)
TimeoutError: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 843, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.10/site-packages/urllib3/util/retry.py", line 474, in increment
raise reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.10/site-packages/urllib3/util/util.py", line 39, in reraise
raise value
File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 789, in urlopen
response = self._make_request(
File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 538, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 369, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='huggingface.co', port=443): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/user/app/app.py", line 335, in
run_update_dataset()
File "/home/user/app/app.py", line 313, in run_update_dataset
update_leaderboard_dataset_parallel(rl_env["rl_env"], path_)
File "/home/user/app/app.py", line 224, in update_leaderboard_dataset_parallel
data = list(thread_map(process_model, model_ids, desc="Processing models"))
File "/usr/local/lib/python3.10/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map
return _executor_map(ThreadPoolExecutor, fn, *iterables, **tqdm_kwargs)
File "/usr/local/lib/python3.10/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map
return list(tqdm_class(ex.map(fn, *iterables, chunksize=chunksize), **kwargs))
File "/usr/local/lib/python3.10/site-packages/tqdm/std.py", line 1181, in iter
for obj in iterable:
File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 621, in result_iterator
yield _result_or_cancel(fs.pop())
File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 319, in _result_or_cancel
return fut.result(timeout)
File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 458, in result
return self.__get_result()
File "/usr/local/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
raise self._exception
File "/usr/local/lib/python3.10/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/user/app/app.py", line 207, in process_model
meta = get_metadata(model_id)
File "/home/user/app/app.py", line 158, in get_metadata
readme_path = hf_hub_download(model_id, filename="README.md", etag_timeout=180)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py", line 101, in inner_f
return f(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1240, in hf_hub_download
return _hf_hub_download_to_cache_dir(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1389, in _hf_hub_download_to_cache_dir
_download_to_tmp_and_move(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1915, in _download_to_tmp_and_move
http_get(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 463, in http_get
r = _request_wrapper(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 399, in _request_wrapper
response = get_session().request(method=method, url=url, **params)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 66, in send
return super().send(request, *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 713, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: (ReadTimeoutError("HTTPSConnectionPool(host='huggingface.co', port=443): Read timed out. (read timeout=60)"), '(Request ID: c63a1bb9-def0-4920-a699-9c06cd9ae731)')

Processing models: 0%| | 0/10532 [00:00<?, ?it/s]

Processing models: 1%| | 84/10532 [00:01<03:12, 54.37it/s]

Processing models: 3%|โ–Ž | 276/10532 [00:03<02:01, 84.67it/s]

Hi, I made a mirror that shows our result until the main site is up again, see https://huggingface.co/spaces/pkalkman/Deep-Reinforcement-Learning-Leaderboard

Huggingface Projects org

Hey there :wave,

Thanks for noticing it, I relaunched the leaderboard.

Sign up or log in to comment