2024-07-18 18:13:42,186 INFO    StreamThr :135 [internal.py:wandb_internal():85] W&B internal server running at pid: 135, started at: 2024-07-18 18:13:42.185636
2024-07-18 18:13:42,188 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status
2024-07-18 18:13:42,387 INFO    WriterThread:135 [datastore.py:open_for_write():87] open: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/run-rjg0wbzd.wandb
2024-07-18 18:13:42,389 DEBUG   SenderThread:135 [sender.py:send():379] send: header
2024-07-18 18:13:42,391 DEBUG   SenderThread:135 [sender.py:send():379] send: run
2024-07-18 18:13:42,567 INFO    SenderThread:135 [dir_watcher.py:__init__():211] watching files in: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files
2024-07-18 18:13:42,567 INFO    SenderThread:135 [sender.py:_start_run_threads():1188] run started: rjg0wbzd with start time 1721326422.186913
2024-07-18 18:13:42,579 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: check_version
2024-07-18 18:13:42,579 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: check_version
2024-07-18 18:13:42,668 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: run_start
2024-07-18 18:13:42,682 DEBUG   HandlerThread:135 [system_info.py:__init__():26] System info init
2024-07-18 18:13:42,682 DEBUG   HandlerThread:135 [system_info.py:__init__():41] System info init done
2024-07-18 18:13:42,682 INFO    HandlerThread:135 [system_monitor.py:start():194] Starting system monitor
2024-07-18 18:13:42,682 INFO    SystemMonitor:135 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-07-18 18:13:42,683 INFO    HandlerThread:135 [system_monitor.py:probe():214] Collecting system info
2024-07-18 18:13:42,683 INFO    SystemMonitor:135 [interfaces.py:start():188] Started cpu monitoring
2024-07-18 18:13:42,685 INFO    SystemMonitor:135 [interfaces.py:start():188] Started disk monitoring
2024-07-18 18:13:42,686 INFO    SystemMonitor:135 [interfaces.py:start():188] Started gpu monitoring
2024-07-18 18:13:42,687 INFO    SystemMonitor:135 [interfaces.py:start():188] Started memory monitoring
2024-07-18 18:13:42,688 INFO    SystemMonitor:135 [interfaces.py:start():188] Started network monitoring
2024-07-18 18:13:42,697 DEBUG   HandlerThread:135 [system_info.py:probe():152] Probing system
2024-07-18 18:13:42,699 DEBUG   HandlerThread:135 [gitlib.py:_init_repo():56] git repository is invalid
2024-07-18 18:13:42,699 DEBUG   HandlerThread:135 [system_info.py:probe():200] Probing system done
2024-07-18 18:13:42,699 DEBUG   HandlerThread:135 [system_monitor.py:probe():223] {'os': 'Linux-5.15.154+-x86_64-with-glibc2.31', 'python': '3.10.13', 'heartbeatAt': '2024-07-18T18:13:42.697267', 'startedAt': '2024-07-18T18:13:42.178848', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'kaggle.ipynb', 'codePathLocal': None, 'root': '/kaggle/working', 'host': 'd088590da4e7', 'username': 'root', 'executable': '/opt/conda/bin/python3.10', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 2000.134, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2000.134, 'min': 0.0, 'max': 0.0}, {'current': 2000.134, 'min': 0.0, 'max': 0.0}, {'current': 2000.134, 'min': 0.0, 'max': 0.0}, {'current': 2000.134, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 8062.387607574463, 'used': 5772.089488983154}}, 'gpu': 'Tesla P100-PCIE-16GB', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla P100-PCIE-16GB', 'memory_total': 17179869184}], 'memory': {'total': 31.357574462890625}}
2024-07-18 18:13:42,699 INFO    HandlerThread:135 [system_monitor.py:probe():224] Finished collecting system info
2024-07-18 18:13:42,699 INFO    HandlerThread:135 [system_monitor.py:probe():227] Publishing system info
2024-07-18 18:13:42,699 DEBUG   HandlerThread:135 [system_info.py:_save_conda():209] Saving list of conda packages installed into the current environment
2024-07-18 18:13:43,569 INFO    Thread-12 :135 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files/conda-environment.yaml
2024-07-18 18:13:57,714 ERROR   HandlerThread:135 [system_info.py:_save_conda():223] Error saving conda packages: Command '['conda', 'env', 'export']' timed out after 15 seconds
Traceback (most recent call last):
  File "/opt/conda/lib/python3.10/site-packages/wandb/sdk/internal/system/system_info.py", line 216, in _save_conda
    subprocess.call(
  File "/opt/conda/lib/python3.10/subprocess.py", line 347, in call
    return p.wait(timeout=timeout)
  File "/opt/conda/lib/python3.10/subprocess.py", line 1209, in wait
    return self._wait(timeout=timeout)
  File "/opt/conda/lib/python3.10/subprocess.py", line 1951, in _wait
    raise TimeoutExpired(self.args, timeout)
subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after 15 seconds
2024-07-18 18:13:57,717 DEBUG   HandlerThread:135 [system_info.py:_save_conda():224] Saving conda packages done
2024-07-18 18:13:57,718 INFO    HandlerThread:135 [system_monitor.py:probe():229] Finished publishing system info
2024-07-18 18:13:57,727 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:13:57,727 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: keepalive
2024-07-18 18:13:57,727 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:13:57,727 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: keepalive
2024-07-18 18:13:57,727 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:13:57,727 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: keepalive
2024-07-18 18:13:57,728 DEBUG   SenderThread:135 [sender.py:send():379] send: files
2024-07-18 18:13:57,728 INFO    SenderThread:135 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now
2024-07-18 18:13:58,151 INFO    wandb-upload_0:135 [upload_job.py:push():130] Uploaded file /tmp/tmpbis4zlo0wandb/h7958e9o-wandb-metadata.json
2024-07-18 18:13:58,573 INFO    Thread-12 :135 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files/wandb-metadata.json
2024-07-18 18:13:58,775 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: python_packages
2024-07-18 18:13:58,775 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: python_packages
2024-07-18 18:13:58,778 DEBUG   SenderThread:135 [sender.py:send():379] send: telemetry
2024-07-18 18:13:58,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:13:58,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:13:58,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:13:58,884 DEBUG   SenderThread:135 [sender.py:send():379] send: config
2024-07-18 18:13:58,887 DEBUG   SenderThread:135 [sender.py:send():379] send: telemetry
2024-07-18 18:13:58,887 DEBUG   SenderThread:135 [sender.py:send():379] send: metric
2024-07-18 18:13:58,887 DEBUG   SenderThread:135 [sender.py:send():379] send: telemetry
2024-07-18 18:13:58,887 DEBUG   SenderThread:135 [sender.py:send():379] send: metric
2024-07-18 18:13:58,887 WARNING SenderThread:135 [sender.py:send_metric():1405] Seen metric with glob (shouldn't happen)
2024-07-18 18:13:58,887 DEBUG   SenderThread:135 [sender.py:send():379] send: telemetry
2024-07-18 18:13:58,888 DEBUG   SenderThread:135 [sender.py:send():379] send: telemetry
2024-07-18 18:13:58,888 DEBUG   SenderThread:135 [sender.py:send():379] send: config
2024-07-18 18:13:58,986 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: log_artifact
2024-07-18 18:13:58,987 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: log_artifact
2024-07-18 18:13:59,573 INFO    Thread-12 :135 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files/requirements.txt
2024-07-18 18:13:59,776 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:00,129 INFO    wandb-upload_0:135 [upload_job.py:push():88] Uploaded file /tmp/tmpyy6kqc8_/model_architecture.txt
2024-07-18 18:14:00,751 INFO    SenderThread:135 [sender.py:send_request_log_artifact():1518] logged artifact model-rjg0wbzd - {'id': 'QXJ0aWZhY3Q6OTk3NDM5NzY5', 'state': 'PENDING', 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjI4NzMyMzE0OQ==', 'latestArtifact': None}}
2024-07-18 18:14:00,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:01,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:02,752 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:02,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:03,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:04,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:05,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:06,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:07,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:07,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:08,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:09,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:10,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:11,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:12,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:13,776 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:14:13,776 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:14:13,817 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:13,861 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:14,579 INFO    Thread-12 :135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files/config.yaml
2024-07-18 18:14:14,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:15,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:16,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:17,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:18,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:19,777 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:19,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:20,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:21,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:22,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:23,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:24,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:25,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:25,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:26,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:27,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:28,776 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:14:28,776 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:14:28,817 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:29,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:30,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:30,889 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:31,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:32,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:33,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:34,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:35,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:36,778 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:36,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:37,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:38,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:39,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:40,783 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:41,783 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:42,688 DEBUG   SystemMonitor:135 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-07-18 18:14:42,690 DEBUG   SenderThread:135 [sender.py:send():379] send: stats
2024-07-18 18:14:42,690 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:42,783 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:43,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:14:43,780 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:14:43,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:44,783 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:45,783 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:46,783 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:47,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:47,861 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:48,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:49,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:50,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:51,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:52,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:53,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:53,784 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:54,785 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:55,785 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:56,785 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:57,785 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:58,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:14:58,780 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:14:58,820 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:14:58,842 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:14:59,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:00,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:01,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:02,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:03,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:04,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:04,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:05,786 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:06,787 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:07,787 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:08,787 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:09,787 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:10,782 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:10,787 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:11,788 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:12,690 DEBUG   SenderThread:135 [sender.py:send():379] send: stats
2024-07-18 18:15:12,788 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:13,779 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:15:13,780 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:15:13,820 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:14,788 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:15,788 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:15,895 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:16,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:17,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:18,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:19,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:20,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:21,785 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:21,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:22,789 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:23,801 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:24,800 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:25,800 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:26,800 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:26,802 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:27,800 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:28,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:15:28,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:15:28,822 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:29,808 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:30,809 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:31,809 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:31,866 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:32,809 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:33,809 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:34,809 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:35,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:36,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:37,794 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:37,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:38,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:39,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:40,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:41,810 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:42,692 DEBUG   SenderThread:135 [sender.py:send():379] send: stats
2024-07-18 18:15:42,811 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:43,693 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:43,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:15:43,780 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:15:43,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:44,811 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:45,811 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:46,811 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:47,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:48,794 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:48,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:49,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:50,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:51,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:52,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:53,794 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:53,812 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:54,813 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:55,813 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:56,813 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:57,813 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:58,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:15:58,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:15:58,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:15:58,860 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:15:59,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:00,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:01,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:02,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:03,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:04,795 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:04,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:05,815 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:06,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:07,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:08,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:09,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:10,795 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:10,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:11,822 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:12,693 DEBUG   SenderThread:135 [sender.py:send():379] send: stats
2024-07-18 18:16:12,821 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:13,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:16:13,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:16:13,822 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:14,822 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:15,822 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:15,844 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:16,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:17,823 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:18,823 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:19,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:20,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:21,795 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:21,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:22,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:23,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:24,824 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:25,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:26,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:27,796 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:27,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:28,780 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:16:28,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:16:28,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:29,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:30,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:31,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:32,825 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:32,921 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:33,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:34,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:35,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:36,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:37,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:38,796 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:38,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:39,826 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:40,827 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:41,827 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:42,693 DEBUG   SenderThread:135 [sender.py:send():379] send: stats
2024-07-18 18:16:42,827 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:43,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:16:43,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:16:43,840 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:43,925 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:44,839 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:45,839 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:46,839 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:47,839 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:48,855 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:49,807 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:49,848 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:50,848 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:51,848 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:52,848 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:53,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:54,807 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:16:54,849 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:55,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:56,849 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:57,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:58,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:16:58,781 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:16:58,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:59,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:16:59,918 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:17:00,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:01,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:02,850 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:03,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:04,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:05,808 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:17:05,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:06,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:07,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:08,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:09,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:10,820 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:17:10,851 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:11,852 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:12,694 DEBUG   SenderThread:135 [sender.py:send():379] send: stats
2024-07-18 18:17:12,852 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:13,781 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: stop_status
2024-07-18 18:17:13,782 DEBUG   SenderThread:135 [sender.py:send_request():406] send_request: stop_status
2024-07-18 18:17:13,852 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:14,653 INFO    Thread-12 :135 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files/output.log
2024-07-18 18:17:14,873 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:15,906 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:16,294 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:17:16,654 INFO    Thread-12 :135 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240718_181342-rjg0wbzd/files/output.log
2024-07-18 18:17:16,863 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:17,863 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:18,864 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:19,863 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:20,863 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:21,814 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: status_report
2024-07-18 18:17:21,864 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages
2024-07-18 18:17:22,864 DEBUG   HandlerThread:135 [handler.py:handle_request():158] handle_request: internal_messages