runtime error

Exit code: 1. Reason: RCE_EXHAUSTED: Out of memory while trying to allocate 132120576 bytes. single_blocks.5.linear1.weight 2024-09-22 08:39:50.102914: W external/xla/xla/tsl/framework/bfc_allocator.cc:497] Allocator (GPU_0_bfc) ran out of memory trying to allocate 90.00MiB (rounded to 94371840)requested by op 2024-09-22 08:39:50.103652: W external/xla/xla/tsl/framework/bfc_allocator.cc:508] **************************************************************************************************** RESOURCE_EXHAUSTED: Out of memory while trying to allocate 94371840 bytes. single_blocks.5.linear2.weight 2024-09-22 08:40:00.116858: W external/xla/xla/tsl/framework/bfc_allocator.cc:497] Allocator (GPU_0_bfc) ran out of memory trying to allocate 54.00MiB (rounded to 56623104)requested by op 2024-09-22 08:40:00.117563: W external/xla/xla/tsl/framework/bfc_allocator.cc:508] **************************************************************************************************** E0922 08:40:00.117585 240 pjrt_stream_executor_client.cc:3067] Execution of replica 0 failed: RESOURCE_EXHAUSTED: Out of memory while trying to allocate 56623104 bytes. RESOURCE_EXHAUSTED: Out of memory while trying to allocate 56623104 bytes. single_blocks.5.modulation.lin.weight 2024-09-22 08:40:10.119022: W external/xla/xla/tsl/framework/bfc_allocator.cc:497] Allocator (GPU_0_bfc) ran out of memory trying to allocate 126.00MiB (rounded to 132120576)requested by op 2024-09-22 08:40:10.119825: W external/xla/xla/tsl/framework/bfc_allocator.cc:508] **************************************************************************************************** RESOURCE_EXHAUSTED: Out of memory while trying to allocate 132120576 bytes. single_blocks.6.linear1.weight Traceback (most recent call last): File "/home/user/app/app.py", line 269, in <module> demo = create_demo("flux-schnell", None, False) File "/usr/local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 211, in gradio_handler raise gr.Error("GPU task aborted") gradio.exceptions.Error: 'GPU task aborted'

Container logs: