Spaces:

li-qing
/

FIRE

Runtime error

App Files Files Community

li-qing commited on Jul 10

Commit

517b6c2

•

1 Parent(s): 682d6db

feat: update

Browse files

Files changed (14) hide show

gradio_web_server.log +563 -0
gradio_web_server_multi.log +0 -0
src/__pycache__/conversation.cpython-310.pyc +0 -0
src/__pycache__/utils.cpython-310.pyc +0 -0
src/conversation.py +26 -3
src/model/__pycache__/model_adapter.cpython-310.pyc +0 -0
src/model/model_adapter.py +9 -0
src/model/model_llava.py +24 -0
src/serve/__pycache__/gradio_block_arena_vision_named.cpython-310.pyc +0 -0
src/serve/__pycache__/gradio_web_server.cpython-310.pyc +0 -0
src/serve/gradio_block_arena_vision_named.py +1 -0
src/serve/gradio_web_server.py +15 -6
src/utils.py +2 -0
vision-tmp-2024-07-10-conv.json +2 -0

gradio_web_server.log CHANGED Viewed

@@ -439,3 +439,566 @@
 2024-07-10 07:24:48 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
 2024-07-10 07:24:48 | INFO | stdout |
 2024-07-10 07:24:48 | INFO | stdout | To create a public link, set `share=True` in `launch()`.

 2024-07-10 07:24:48 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
 2024-07-10 07:24:48 | INFO | stdout |
 2024-07-10 07:24:48 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:26:20 | INFO | gradio_web_server | bot_response. ip: 46.3.240.105
+2024-07-10 07:26:20 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=llava-fire&user_id=46.3.240.105 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb91047d1b0>: Failed to establish a new connection: [Errno 111] Connection refused'))
+2024-07-10 07:26:20 | INFO | gradio_web_server | model_name: llava-fire;model_api_dict: None
+2024-07-10 07:26:20 | INFO | gradio_web_server | bot_response. ip: 46.3.240.105
+2024-07-10 07:26:20 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=llava-original&user_id=46.3.240.105 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb91047d870>: Failed to establish a new connection: [Errno 111] Connection refused'))
+2024-07-10 07:26:20 | INFO | gradio_web_server | model_name: llava-original;model_api_dict: None
+2024-07-10 07:26:28 | INFO | stdout | torch.Size([1, 58]) torch.Size([1, 5, 3, 336, 336])
+2024-07-10 07:26:29 | ERROR | stderr | /usr/local/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:392: UserWarning: `do_sample` is set to `False`. However, `temperature` is set to `0` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `temperature`.
+2024-07-10 07:26:29 | ERROR | stderr |   warnings.warn(
+2024-07-10 07:26:29 | ERROR | stderr | /usr/local/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `0.9` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`.
+2024-07-10 07:26:29 | ERROR | stderr |   warnings.warn(
+2024-07-10 07:26:34 | INFO | stdout | ["The figure in the image is a can of Södra Almighy, which is a beer. Södra is a Swedish brewery known for its lager beers. The can's design is modern and minimalist, with a color scheme that includes black and white, and the text is in English. The label indicates that it is a dry-hopped beer, which means it has been flavored with hops that have not been steeped in the brewing process, giving it a unique taste profile. The can's design suggests a contemporary and possibly craft beer, which is often associated with a more complex flavor profile than traditional lagers."]
+2024-07-10 07:27:01 | INFO | gradio_web_server | bot_response. ip: 46.3.240.106
+2024-07-10 07:27:01 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=llava-fire&user_id=46.3.240.106 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb91047fd90>: Failed to establish a new connection: [Errno 111] Connection refused'))
+2024-07-10 07:27:01 | INFO | gradio_web_server | model_name: llava-fire;model_api_dict: None
+2024-07-10 07:27:01 | INFO | gradio_web_server | bot_response. ip: 46.3.240.106
+2024-07-10 07:27:01 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=llava-original&user_id=46.3.240.106 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb91047ded0>: Failed to establish a new connection: [Errno 111] Connection refused'))
+2024-07-10 07:27:01 | INFO | gradio_web_server | model_name: llava-original;model_api_dict: None
+2024-07-10 07:27:14 | INFO | stdout | torch.Size([1, 58]) torch.Size([1, 5, 3, 336, 336])
+2024-07-10 07:27:15 | ERROR | stderr | /usr/local/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:392: UserWarning: `do_sample` is set to `False`. However, `temperature` is set to `0` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `temperature`.
+2024-07-10 07:27:15 | ERROR | stderr |   warnings.warn(
+2024-07-10 07:27:15 | ERROR | stderr | /usr/local/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:397: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `0.9` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`.
+2024-07-10 07:27:15 | ERROR | stderr |   warnings.warn(
+2024-07-10 07:27:20 | INFO | stdout | ["The figure in the image is a can of Södra Almighy, which is a beer. Södra is a Swedish brewery known for its lager beers. The can's design is modern and minimalist, with a color scheme that includes black and white, and the text is in English. The label indicates that it is a dry-hopped beer, which means it has been flavored with hops that have not been steeped in the brewing process, giving it a unique taste profile. The can's design suggests a contemporary and possibly craft beer, which is often associated with a more complex flavor profile than traditional lagers."]
+2024-07-10 07:27:20 | INFO | gradio_web_server | hello
+2024-07-10 07:27:20 | INFO | gradio_web_server | The figure in the image is a can of Södra Almighy, which is a beer. Södra is a Swedish brewery known for its lager beers. The can's design is modern and minimalist, with a color scheme that includes black and white, and the text is in English. The label indicates that it is a dry-hopped beer, which means it has been flavored with hops that have not been steeped in the brewing process, giving it a unique taste profile. The can's design suggests a contemporary and possibly craft beer, which is often associated with a more complex flavor profile than traditional lagers.
+2024-07-10 07:37:00 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:37:00 | INFO | stdout |
+2024-07-10 07:37:00 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:37:21 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:37:21 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:37:21 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:37:21 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:37:21 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:37:21 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:37:21 | ERROR | stderr |     return await future
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:37:21 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:37:21 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:37:21 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:37:21 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 168, in add_text
+2024-07-10 07:37:21 | ERROR | stderr |     states[i] = State(model_selectors[i], is_vision=True)
+2024-07-10 07:37:21 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 115, in __init__
+2024-07-10 07:37:21 | ERROR | stderr |     self.init_system_prompt(self.conv)
+2024-07-10 07:37:21 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 118, in init_system_prompt
+2024-07-10 07:37:21 | ERROR | stderr |     system_prompt = conv.get_system_message()
+2024-07-10 07:37:21 | ERROR | stderr | AttributeError: 'Conversation' object has no attribute 'get_system_message'
+2024-07-10 07:37:22 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:37:22 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:37:22 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:37:22 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:37:22 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:37:22 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:37:22 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:37:22 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:37:22 | ERROR | stderr |     return await future
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:37:22 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:37:22 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:37:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:37:22 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:37:22 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:37:22 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:37:22 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:39:41 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:39:41 | INFO | stdout |
+2024-07-10 07:39:41 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:40:22 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:40:22 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:40:22 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:40:22 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:40:22 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:40:22 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:40:22 | ERROR | stderr |     return await future
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:40:22 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:40:22 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:40:22 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:40:22 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 168, in add_text
+2024-07-10 07:40:22 | ERROR | stderr |     states[i] = State(model_selectors[i], is_vision=True)
+2024-07-10 07:40:22 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 115, in __init__
+2024-07-10 07:40:22 | ERROR | stderr |     self.init_system_prompt(self.conv)
+2024-07-10 07:40:22 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 126, in init_system_prompt
+2024-07-10 07:40:22 | ERROR | stderr |     system_prompt = system_prompt.replace("{{currentDateTime}}", current_date)
+2024-07-10 07:40:22 | ERROR | stderr | AttributeError: 'Conversation' object has no attribute 'set_system_message'
+2024-07-10 07:40:23 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:40:23 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:40:23 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:40:23 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:40:23 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:40:23 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:40:23 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:40:23 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:40:23 | ERROR | stderr |     return await future
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:40:23 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:40:23 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:40:23 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:40:23 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:40:23 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:40:23 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:40:23 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:40:40 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:40:40 | INFO | stdout |
+2024-07-10 07:40:40 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:40:54 | INFO | stdout | moderating image: /tmp/gradio/405613dcd3661394aad4b9b9addbd1743365fabf/screenshot-20240708-164613.png
+2024-07-10 07:40:54 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:40:54 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:40:54 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:40:54 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:40:54 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:40:54 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:40:54 | ERROR | stderr |     return await future
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:40:54 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:40:54 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:40:54 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 190, in add_text
+2024-07-10 07:40:54 | ERROR | stderr |     text, image_flagged, csam_flag = moderate_input(
+2024-07-10 07:40:54 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision.py", line 148, in moderate_input
+2024-07-10 07:40:54 | ERROR | stderr |     nsfw_flagged, csam_flagged = image_moderation_filter(images[0])
+2024-07-10 07:40:54 | ERROR | stderr |   File "/home/user/app/src/utils.py", line 496, in image_moderation_filter
+2024-07-10 07:40:54 | ERROR | stderr |     nsfw_flagged = image_moderation_provider(image_bytes, "nsfw")
+2024-07-10 07:40:54 | ERROR | stderr |   File "/home/user/app/src/utils.py", line 478, in image_moderation_provider
+2024-07-10 07:40:54 | ERROR | stderr |     endpoint = os.environ["AZURE_IMG_MODERATION_ENDPOINT"]
+2024-07-10 07:40:54 | ERROR | stderr |   File "/usr/local/lib/python3.10/os.py", line 680, in __getitem__
+2024-07-10 07:40:54 | ERROR | stderr |     raise KeyError(key) from None
+2024-07-10 07:40:54 | ERROR | stderr | KeyError: 'AZURE_IMG_MODERATION_ENDPOINT'
+2024-07-10 07:40:55 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:40:55 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:40:55 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:40:55 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:40:55 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:40:55 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:40:55 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:40:55 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:40:55 | ERROR | stderr |     return await future
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:40:55 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:40:55 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:40:55 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:40:55 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:40:55 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:40:55 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:40:55 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:43:45 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:43:45 | INFO | stdout |
+2024-07-10 07:43:45 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:44:15 | INFO | stdout | moderating image: /tmp/gradio/405613dcd3661394aad4b9b9addbd1743365fabf/screenshot-20240708-164613.png
+2024-07-10 07:44:15 | INFO | stdout | skip for now
+2024-07-10 07:44:15 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:44:15 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:44:15 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:44:15 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:44:15 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:44:15 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:44:15 | ERROR | stderr |     return await future
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:44:15 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:44:15 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:44:15 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:44:15 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 225, in add_text
+2024-07-10 07:44:15 | ERROR | stderr |     post_processed_text = _prepare_text_with_image(
+2024-07-10 07:44:15 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 317, in _prepare_text_with_image
+2024-07-10 07:44:15 | ERROR | stderr |     image = state.conv.convert_image_to_base64(
+2024-07-10 07:44:15 | ERROR | stderr | AttributeError: 'Conversation' object has no attribute 'convert_image_to_base64'
+2024-07-10 07:44:16 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:44:16 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:44:16 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:44:16 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:44:16 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:44:16 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:44:16 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:44:16 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:44:16 | ERROR | stderr |     return await future
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:44:16 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:44:16 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:44:16 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:44:16 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:44:16 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:44:16 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:44:16 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:48:59 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:48:59 | INFO | stdout |
+2024-07-10 07:48:59 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:49:17 | INFO | stdout | moderating image: /tmp/gradio/405613dcd3661394aad4b9b9addbd1743365fabf/screenshot-20240708-164613.png
+2024-07-10 07:49:17 | INFO | stdout | skip for now
+2024-07-10 07:49:17 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:49:17 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:49:17 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:49:17 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:49:17 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:49:17 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:49:17 | ERROR | stderr |     return await future
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:49:17 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:49:17 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:49:17 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:49:17 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 225, in add_text
+2024-07-10 07:49:17 | ERROR | stderr |     post_processed_text = _prepare_text_with_image(
+2024-07-10 07:49:17 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 323, in _prepare_text_with_image
+2024-07-10 07:49:17 | ERROR | stderr |     image = convert_image_to_base64(image, None)
+2024-07-10 07:49:17 | ERROR | stderr |   File "/home/user/app/src/conversation.py", line 693, in convert_image_to_base64
+2024-07-10 07:49:17 | ERROR | stderr |     from fastchat.utils import resize_image_and_return_image_in_bytes
+2024-07-10 07:49:17 | ERROR | stderr | ModuleNotFoundError: No module named 'fastchat'
+2024-07-10 07:49:19 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:49:19 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:49:19 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:49:19 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:49:19 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:49:19 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:49:19 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:49:19 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:49:19 | ERROR | stderr |     return await future
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:49:19 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:49:19 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:49:19 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:49:19 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:49:19 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:49:19 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:49:19 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:49:56 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:49:56 | INFO | stdout |
+2024-07-10 07:49:56 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:50:30 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:50:30 | INFO | stdout |
+2024-07-10 07:50:30 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:50:41 | INFO | stdout | moderating image: /tmp/gradio/405613dcd3661394aad4b9b9addbd1743365fabf/screenshot-20240708-164613.png
+2024-07-10 07:50:41 | INFO | stdout | skip for now
+2024-07-10 07:50:41 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:50:41 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:50:41 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:50:41 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:50:41 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:50:41 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:50:41 | ERROR | stderr |     return await future
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:50:41 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:50:41 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:50:41 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 234, in add_text
+2024-07-10 07:50:41 | ERROR | stderr |     + [x.to_gradio_chatbot() for x in states]
+2024-07-10 07:50:41 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 234, in <listcomp>
+2024-07-10 07:50:41 | ERROR | stderr |     + [x.to_gradio_chatbot() for x in states]
+2024-07-10 07:50:41 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 130, in to_gradio_chatbot
+2024-07-10 07:50:41 | ERROR | stderr |     return self.conv.to_gradio_chatbot()
+2024-07-10 07:50:41 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/llava/conversation.py", line 206, in to_gradio_chatbot
+2024-07-10 07:50:41 | ERROR | stderr |     msg, image, image_process_mode = msg
+2024-07-10 07:50:41 | ERROR | stderr | ValueError: not enough values to unpack (expected 3, got 2)
+2024-07-10 07:50:43 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:50:43 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:50:43 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:50:43 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:50:43 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:50:43 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:50:43 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:50:43 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:50:43 | ERROR | stderr |     return await future
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:50:43 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:50:43 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:50:43 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:50:43 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:50:43 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:50:43 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:50:43 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:55:50 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
+2024-07-10 07:55:50 | INFO | stdout |
+2024-07-10 07:55:50 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
+2024-07-10 07:56:32 | INFO | stdout | moderating image: /tmp/gradio/405613dcd3661394aad4b9b9addbd1743365fabf/screenshot-20240708-164613.png
+2024-07-10 07:56:33 | INFO | stdout | skip for now
+2024-07-10 07:56:33 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:56:33 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:56:33 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:56:33 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1514, in call_function
+2024-07-10 07:56:33 | ERROR | stderr |     prediction = await anyio.to_thread.run_sync(
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:56:33 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:56:33 | ERROR | stderr |     return await future
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:56:33 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 833, in wrapper
+2024-07-10 07:56:33 | ERROR | stderr |     response = f(*args, **kwargs)
+2024-07-10 07:56:33 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 235, in add_text
+2024-07-10 07:56:33 | ERROR | stderr |     + [x.to_gradio_chatbot() for x in states]
+2024-07-10 07:56:33 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 235, in <listcomp>
+2024-07-10 07:56:33 | ERROR | stderr |     + [x.to_gradio_chatbot() for x in states]
+2024-07-10 07:56:33 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_web_server.py", line 130, in to_gradio_chatbot
+2024-07-10 07:56:33 | ERROR | stderr |     return self.conv.to_gradio_chatbot()
+2024-07-10 07:56:33 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/llava/conversation.py", line 206, in to_gradio_chatbot
+2024-07-10 07:56:33 | ERROR | stderr |     msg, image, image_process_mode = msg
+2024-07-10 07:56:33 | ERROR | stderr | ValueError: not enough values to unpack (expected 3, got 2)
+2024-07-10 07:56:34 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 541, in process_events
+2024-07-10 07:56:34 | ERROR | stderr |     response = await route_utils.call_process_api(
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 276, in call_process_api
+2024-07-10 07:56:34 | ERROR | stderr |     output = await app.get_blocks().process_api(
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1928, in process_api
+2024-07-10 07:56:34 | ERROR | stderr |     result = await self.call_function(
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1526, in call_function
+2024-07-10 07:56:34 | ERROR | stderr |     prediction = await utils.async_iteration(iterator)
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 657, in async_iteration
+2024-07-10 07:56:34 | ERROR | stderr |     return await iterator.__anext__()
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 650, in __anext__
+2024-07-10 07:56:34 | ERROR | stderr |     return await anyio.to_thread.run_sync(
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:56:34 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:56:34 | ERROR | stderr |     return await future
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:56:34 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 633, in run_sync_iterator_async
+2024-07-10 07:56:34 | ERROR | stderr |     return next(iterator)
+2024-07-10 07:56:34 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 816, in gen_wrapper
+2024-07-10 07:56:34 | ERROR | stderr |     response = next(iterator)
+2024-07-10 07:56:34 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_named.py", line 237, in bot_response_multi
+2024-07-10 07:56:34 | ERROR | stderr |     if state0.skip_next:
+2024-07-10 07:56:34 | ERROR | stderr | AttributeError: 'NoneType' object has no attribute 'skip_next'
+2024-07-10 07:58:59 | ERROR | stderr | ERROR:    Exception in ASGI application
+2024-07-10 07:58:59 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/routes.py", line 404, in main
+2024-07-10 07:58:59 | ERROR | stderr |     @app.get("/assets/{path:path}")
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/templating.py", line 229, in TemplateResponse
+2024-07-10 07:58:59 | ERROR | stderr |     template = self.get_template(name)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/templating.py", line 143, in get_template
+2024-07-10 07:58:59 | ERROR | stderr |     return self.env.get_template(name)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/environment.py", line 1013, in get_template
+2024-07-10 07:58:59 | ERROR | stderr |     return self._load_template(name, globals)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/environment.py", line 972, in _load_template
+2024-07-10 07:58:59 | ERROR | stderr |     template = self.loader.load(self, name, self.make_globals(globals))
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/loaders.py", line 126, in load
+2024-07-10 07:58:59 | ERROR | stderr |     source, filename, uptodate = self.get_source(environment, name)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/loaders.py", line 207, in get_source
+2024-07-10 07:58:59 | ERROR | stderr |     raise TemplateNotFound(template)
+2024-07-10 07:58:59 | ERROR | stderr | jinja2.exceptions.TemplateNotFound: frontend/index.html
+2024-07-10 07:58:59 | ERROR | stderr |
+2024-07-10 07:58:59 | ERROR | stderr | The above exception was the direct cause of the following exception:
+2024-07-10 07:58:59 | ERROR | stderr |
+2024-07-10 07:58:59 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 399, in run_asgi
+2024-07-10 07:58:59 | ERROR | stderr |     result = await app(  # type: ignore[func-returns-value]
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     return await self.app(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await super().__call__(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 123, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     raise exc
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await self.app(scope, receive, _send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 714, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 65, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     raise exc
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     await app(scope, receive, sender)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 756, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 776, in app
+2024-07-10 07:58:59 | ERROR | stderr |     await route.handle(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 297, in handle
+2024-07-10 07:58:59 | ERROR | stderr |     await self.app(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 77, in app
+2024-07-10 07:58:59 | ERROR | stderr |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     raise exc
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     await app(scope, receive, sender)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 72, in app
+2024-07-10 07:58:59 | ERROR | stderr |     response = await func(request)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 278, in app
+2024-07-10 07:58:59 | ERROR | stderr |     raw_response = await run_endpoint_function(
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
+2024-07-10 07:58:59 | ERROR | stderr |     return await run_in_threadpool(dependant.call, **values)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
+2024-07-10 07:58:59 | ERROR | stderr |     return await anyio.to_thread.run_sync(func, *args)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:58:59 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:58:59 | ERROR | stderr |     return await future
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:58:59 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/routes.py", line 419, in main
+2024-07-10 07:58:59 | ERROR | stderr |     async def reverse_proxy(url_path: str):
+2024-07-10 07:58:59 | ERROR | stderr | ValueError: Did you install Gradio from source files? You need to build the frontend by running /scripts/build_frontend.sh
+2024-07-10 07:58:59 | ERROR | stderr | ERROR:    Exception in ASGI application
+2024-07-10 07:58:59 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/routes.py", line 404, in main
+2024-07-10 07:58:59 | ERROR | stderr |     @app.get("/assets/{path:path}")
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/templating.py", line 229, in TemplateResponse
+2024-07-10 07:58:59 | ERROR | stderr |     template = self.get_template(name)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/templating.py", line 143, in get_template
+2024-07-10 07:58:59 | ERROR | stderr |     return self.env.get_template(name)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/environment.py", line 1013, in get_template
+2024-07-10 07:58:59 | ERROR | stderr |     return self._load_template(name, globals)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/environment.py", line 972, in _load_template
+2024-07-10 07:58:59 | ERROR | stderr |     template = self.loader.load(self, name, self.make_globals(globals))
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/loaders.py", line 126, in load
+2024-07-10 07:58:59 | ERROR | stderr |     source, filename, uptodate = self.get_source(environment, name)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/jinja2/loaders.py", line 207, in get_source
+2024-07-10 07:58:59 | ERROR | stderr |     raise TemplateNotFound(template)
+2024-07-10 07:58:59 | ERROR | stderr | jinja2.exceptions.TemplateNotFound: frontend/index.html
+2024-07-10 07:58:59 | ERROR | stderr |
+2024-07-10 07:58:59 | ERROR | stderr | The above exception was the direct cause of the following exception:
+2024-07-10 07:58:59 | ERROR | stderr |
+2024-07-10 07:58:59 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 399, in run_asgi
+2024-07-10 07:58:59 | ERROR | stderr |     result = await app(  # type: ignore[func-returns-value]
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     return await self.app(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await super().__call__(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 123, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     raise exc
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await self.app(scope, receive, _send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 714, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 65, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     raise exc
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     await app(scope, receive, sender)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 756, in __call__
+2024-07-10 07:58:59 | ERROR | stderr |     await self.middleware_stack(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 776, in app
+2024-07-10 07:58:59 | ERROR | stderr |     await route.handle(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 297, in handle
+2024-07-10 07:58:59 | ERROR | stderr |     await self.app(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 77, in app
+2024-07-10 07:58:59 | ERROR | stderr |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     raise exc
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
+2024-07-10 07:58:59 | ERROR | stderr |     await app(scope, receive, sender)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 72, in app
+2024-07-10 07:58:59 | ERROR | stderr |     response = await func(request)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 278, in app
+2024-07-10 07:58:59 | ERROR | stderr |     raw_response = await run_endpoint_function(
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
+2024-07-10 07:58:59 | ERROR | stderr |     return await run_in_threadpool(dependant.call, **values)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
+2024-07-10 07:58:59 | ERROR | stderr |     return await anyio.to_thread.run_sync(func, *args)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
+2024-07-10 07:58:59 | ERROR | stderr |     return await get_async_backend().run_sync_in_worker_thread(
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread
+2024-07-10 07:58:59 | ERROR | stderr |     return await future
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 859, in run
+2024-07-10 07:58:59 | ERROR | stderr |     result = context.run(func, *args)
+2024-07-10 07:58:59 | ERROR | stderr |   File "/usr/local/lib/python3.10/site-packages/gradio/routes.py", line 419, in main
+2024-07-10 07:58:59 | ERROR | stderr |     async def reverse_proxy(url_path: str):
+2024-07-10 07:58:59 | ERROR | stderr | ValueError: Did you install Gradio from source files? You need to build the frontend by running /scripts/build_frontend.sh
+2024-07-10 07:59:35 | ERROR | stderr | Traceback (most recent call last):
+2024-07-10 07:59:35 | ERROR | stderr |   File "/home/user/app/app.py", line 18, in <module>
+2024-07-10 07:59:35 | ERROR | stderr |     main()
+2024-07-10 07:59:35 | ERROR | stderr |   File "/home/user/app/app.py", line 11, in main
+2024-07-10 07:59:35 | ERROR | stderr |     states = build_side_by_side_vision_ui_named(
+2024-07-10 07:59:35 | ERROR | stderr |   File "/home/user/app/src/serve/gradio_block_arena_vision_named.py", line 320, in build_side_by_side_vision_ui_named
+2024-07-10 07:59:35 | ERROR | stderr |     textbox = gr.MultimodalTextbox(
+2024-07-10 07:59:35 | ERROR | stderr | AttributeError: module 'gradio' has no attribute 'MultimodalTextbox'
+2024-07-10 07:59:36 | INFO | stdout | IMPORTANT: You are using gradio version 4.16.0, however version 4.29.0 is available, please upgrade.
+2024-07-10 07:59:36 | INFO | stdout | --------

gradio_web_server_multi.log CHANGED Viewed

The diff for this file is too large to render. See raw diff

src/__pycache__/conversation.cpython-310.pyc CHANGED Viewed

Binary files a/src/__pycache__/conversation.cpython-310.pyc and b/src/__pycache__/conversation.cpython-310.pyc differ

src/__pycache__/utils.cpython-310.pyc CHANGED Viewed

Binary files a/src/__pycache__/utils.cpython-310.pyc and b/src/__pycache__/utils.cpython-310.pyc differ

src/conversation.py CHANGED Viewed

@@ -357,7 +357,7 @@ class Conversation:
         """Given an image, return the base64 encoded image string."""
         from PIL import Image
         import requests
-        from fastchat.utils import resize_image_and_return_image_in_bytes
         # Load image if it has not been loaded in yet
         if type(image) == str:
@@ -480,7 +480,7 @@ class Conversation:
         return ret
     def to_gemini_api_messages(self):
-        from fastchat.utils import load_image
         if self.system_message == "":
             ret = []
@@ -686,6 +686,29 @@ class Conversation:
             "offset": self.offset,
         }
 # A global registry for all conversation templates
 conv_templates: Dict[str, Conversation] = {}
@@ -2062,7 +2085,7 @@ register_conv_template(
 if __name__ == "__main__":
-    from fastchat.conversation import get_conv_template
     print("-- Vicuna template --")
     conv = get_conv_template("vicuna_v1.1")

         """Given an image, return the base64 encoded image string."""
         from PIL import Image
         import requests
+        from src.utils import resize_image_and_return_image_in_bytes
         # Load image if it has not been loaded in yet
         if type(image) == str:
         return ret
     def to_gemini_api_messages(self):
+        from src.utils import load_image
         if self.system_message == "":
             ret = []
             "offset": self.offset,
         }
+def convert_image_to_base64(image, max_image_size_mb):
+    """Given an image, return the base64 encoded image string."""
+    from PIL import Image
+    import requests
+    from src.utils import resize_image_and_return_image_in_bytes
+    # Load image if it has not been loaded in yet
+    if type(image) == str:
+        if image.startswith("http://") or image.startswith("https://"):
+            response = requests.get(image)
+            image = Image.open(BytesIO(response.content)).convert("RGB")
+        elif "base64" in image:
+            # OpenAI format is: data:image/jpeg;base64,{base64_encoded_image_str}
+            return image.split(",")[1]
+        else:
+            image = Image.open(image).convert("RGB")
+    image_bytes = resize_image_and_return_image_in_bytes(
+        image, max_image_size_mb
+    )
+    img_b64_str = base64.b64encode(image_bytes.getvalue()).decode()
+    return img_b64_str
 # A global registry for all conversation templates
 conv_templates: Dict[str, Conversation] = {}
 if __name__ == "__main__":
+    from src.conversation import get_conv_template
     print("-- Vicuna template --")
     conv = get_conv_template("vicuna_v1.1")

src/model/__pycache__/model_adapter.cpython-310.pyc CHANGED Viewed

Binary files a/src/model/__pycache__/model_adapter.cpython-310.pyc and b/src/model/__pycache__/model_adapter.cpython-310.pyc differ

src/model/model_adapter.py CHANGED Viewed

@@ -2291,6 +2291,15 @@ class LlavaAdapter(BaseModelAdapter):
         return "llava" in model_path.lower()
     def get_default_conv_template(self, model_path: str) -> Conversation:
         model_path = model_path.lower()
         if "34b" in model_path:
             return get_conv_template("llava-chatml")

         return "llava" in model_path.lower()
     def get_default_conv_template(self, model_path: str) -> Conversation:
+        from loguru import logger
+        logger.info("model_path {}", model_path)
+        if model_path in ["llava-fire", "llava-original"]:
+            from llava.conversation import conv_templates
+            if model_path == "llava-fire":
+                return conv_templates["llama_v3_student"].copy()
+            else:
+                return conv_templates["llama_v3"].copy()
         model_path = model_path.lower()
         if "34b" in model_path:
             return get_conv_template("llava-chatml")

src/model/model_llava.py CHANGED Viewed

@@ -2,6 +2,7 @@ from llava.model.builder import load_pretrained_model
 from llava.mm_utils import get_model_name_from_path, process_images, tokenizer_image_token
 from llava.constants import IMAGE_TOKEN_INDEX, DEFAULT_IMAGE_TOKEN
 from llava.conversation import conv_templates
 from PIL import Image
 import requests
@@ -57,5 +58,28 @@ def inference():
     print(text_outputs)
     return text_outputs
 if __name__ == "__main__":
     inference()

 from llava.mm_utils import get_model_name_from_path, process_images, tokenizer_image_token
 from llava.constants import IMAGE_TOKEN_INDEX, DEFAULT_IMAGE_TOKEN
 from llava.conversation import conv_templates
+from loguru import logger
 from PIL import Image
 import requests
     print(text_outputs)
     return text_outputs
+@spaces.GPU
+def inference_by_prompt_and_image(prompt, images):
+    device = "cuda"
+    image_tensor = process_images(images, image_processor_llava, model_llava.config)
+    image_tensor = image_tensor.to(dtype=torch.float16, device=device)
+    input_ids = tokenizer_image_token(prompt, tokenizer_llava, IMAGE_TOKEN_INDEX, return_tensors="pt").unsqueeze(0).to(device)
+    image_sizes = [image.size for image in images]
+    logger.info("Shape: {};{}",input_ids.shape, image_tensor.shape)
+    with torch.inference_mode():
+        cont = model_llava.generate(
+            input_ids,
+            images=image_tensor,
+            image_sizes=image_sizes,
+            do_sample=False,
+            temperature=0,
+            max_new_tokens=256,
+            use_cache=True
+        )
+    text_outputs = tokenizer_llava.batch_decode(cont, skip_special_tokens=True)
+    logger.info("response={}", text_outputs)
+    return text_outputs
 if __name__ == "__main__":
     inference()

src/serve/__pycache__/gradio_block_arena_vision_named.cpython-310.pyc CHANGED Viewed

Binary files a/src/serve/__pycache__/gradio_block_arena_vision_named.cpython-310.pyc and b/src/serve/__pycache__/gradio_block_arena_vision_named.cpython-310.pyc differ

src/serve/__pycache__/gradio_web_server.cpython-310.pyc CHANGED Viewed

Binary files a/src/serve/__pycache__/gradio_web_server.cpython-310.pyc and b/src/serve/__pycache__/gradio_web_server.cpython-310.pyc differ

src/serve/gradio_block_arena_vision_named.py CHANGED Viewed

@@ -225,6 +225,7 @@ def add_text(
         post_processed_text = _prepare_text_with_image(
             states[i], text, images, csam_flag=csam_flag
         )
         states[i].conv.append_message(states[i].conv.roles[0], post_processed_text)
         states[i].conv.append_message(states[i].conv.roles[1], None)
         states[i].skip_next = False

         post_processed_text = _prepare_text_with_image(
             states[i], text, images, csam_flag=csam_flag
         )
+        logger.info(f"msg={post_processed_text}")
         states[i].conv.append_message(states[i].conv.roles[0], post_processed_text)
         states[i].conv.append_message(states[i].conv.roles[1], None)
         states[i].skip_next = False

src/serve/gradio_web_server.py CHANGED Viewed

@@ -115,7 +115,11 @@ class State:
         self.init_system_prompt(self.conv)
     def init_system_prompt(self, conv):
-        system_prompt = conv.get_system_message()
         if len(system_prompt) == 0:
             return
         current_date = datetime.datetime.now().strftime("%Y-%m-%d")
@@ -310,9 +314,13 @@ def _prepare_text_with_image(state, text, images, csam_flag):
             # reset convo with new image
             state.conv = get_conversation_template(state.model_name)
-        image = state.conv.convert_image_to_base64(
-            image
-        )  # PIL type is not JSON serializable
         if csam_flag:
             state.has_csam_image = True
@@ -452,8 +460,9 @@ def bot_response(
     logger.info(f"model_name: {model_name};model_api_dict: {model_api_dict}")
     if model_api_dict is None:
         if model_name == "llava-original":
-            from src.model.model_llava import inference
-            output_text = inference()[0]
         else:
             output_text = "hello"
         stream_iter = [{

         self.init_system_prompt(self.conv)
     def init_system_prompt(self, conv):
+        if hasattr(conv, "get_system_message"):
+            system_prompt = conv.get_system_message()
+        elif (conv, "system"):
+            system_prompt = conv.system
+            return # No need for system prompt
         if len(system_prompt) == 0:
             return
         current_date = datetime.datetime.now().strftime("%Y-%m-%d")
             # reset convo with new image
             state.conv = get_conversation_template(state.model_name)
+        if hasattr(state.conv, "convert_image_to_base64"):
+            image = state.conv.convert_image_to_base64(
+                image
+            )  # PIL type is not JSON serializable
+        else:
+            from src.conversation import convert_image_to_base64
+            image = convert_image_to_base64(image, None)
         if csam_flag:
             state.has_csam_image = True
     logger.info(f"model_name: {model_name};model_api_dict: {model_api_dict}")
     if model_api_dict is None:
         if model_name == "llava-original":
+            from src.model.model_llava import inference, inference_by_prompt_and_images
+            logger.info(f"prompt: {conv.get_prompt()}; images: {images}")
+            output_text = inference_by_prompt_and_images(conv.get_prompt(), images)[0]
         else:
             output_text = "hello"
         stream_iter = [{

src/utils.py CHANGED Viewed

@@ -474,6 +474,8 @@ def image_moderation_request(image_bytes, endpoint, api_key):
 def image_moderation_provider(image, api_type):
     if api_type == "nsfw":
         endpoint = os.environ["AZURE_IMG_MODERATION_ENDPOINT"]
         api_key = os.environ["AZURE_IMG_MODERATION_API_KEY"]

 def image_moderation_provider(image, api_type):
+    print("skip for now")
+    return False
     if api_type == "nsfw":
         endpoint = os.environ["AZURE_IMG_MODERATION_ENDPOINT"]
         api_key = os.environ["AZURE_IMG_MODERATION_API_KEY"]

vision-tmp-2024-07-10-conv.json CHANGED Viewed

@@ -3,3 +3,5 @@
 {"tstamp": 1720588858.8939, "type": "chat", "model": "llava-fire", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720588858.8843, "finish": 1720588858.8939, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "d994e3d859c94bddbf0dfcaed6c63079", "model_name": "llava-fire", "has_csam_image": false}, "ip": "46.3.240.105"}
 {"tstamp": 1720588858.8951, "type": "chat", "model": "llava-original", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720588858.8863, "finish": 1720588858.8951, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "e41b47f05f8b44ff9d520c8e94c6e8de", "model_name": "llava-original", "has_csam_image": false}, "ip": "46.3.240.105"}
 {"tstamp": 1720589062.1758, "type": "chat", "model": "llava-fire", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720589047.9171, "finish": 1720589062.1758, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "963f15cd5e224eb8ae02c67ed37b93c4", "model_name": "llava-fire", "has_csam_image": false}, "ip": "46.3.240.105"}

 {"tstamp": 1720588858.8939, "type": "chat", "model": "llava-fire", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720588858.8843, "finish": 1720588858.8939, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "d994e3d859c94bddbf0dfcaed6c63079", "model_name": "llava-fire", "has_csam_image": false}, "ip": "46.3.240.105"}
 {"tstamp": 1720588858.8951, "type": "chat", "model": "llava-original", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720588858.8863, "finish": 1720588858.8951, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "e41b47f05f8b44ff9d520c8e94c6e8de", "model_name": "llava-original", "has_csam_image": false}, "ip": "46.3.240.105"}
 {"tstamp": 1720589062.1758, "type": "chat", "model": "llava-fire", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720589047.9171, "finish": 1720589062.1758, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "963f15cd5e224eb8ae02c67ed37b93c4", "model_name": "llava-fire", "has_csam_image": false}, "ip": "46.3.240.105"}
+{"tstamp": 1720589240.391, "type": "chat", "model": "llava-fire", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720589221.915, "finish": 1720589240.391, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "hello"]], "offset": 0, "conv_id": "062c8dbcf02d4779ad5cb89f836a7480", "model_name": "llava-fire", "has_csam_image": false}, "ip": "46.3.240.106"}
+{"tstamp": 1720589240.3917, "type": "chat", "model": "llava-original", "gen_params": {"temperature": 0.7, "top_p": 1.0, "max_new_tokens": 1024}, "start": 1720589221.917, "finish": 1720589240.3917, "state": {"template_name": "vicuna_v1.1", "system_message": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.", "roles": ["USER", "ASSISTANT"], "messages": [["USER", "Hello"], ["ASSISTANT", "The figure in the image is a can of S\u00f6dra Almighy, which is a beer. S\u00f6dra is a Swedish brewery known for its lager beers. The can's design is modern and minimalist, with a color scheme that includes black and white, and the text is in English. The label indicates that it is a dry-hopped beer, which means it has been flavored with hops that have not been steeped in the brewing process, giving it a unique taste profile. The can's design suggests a contemporary and possibly craft beer, which is often associated with a more complex flavor profile than traditional lagers."]], "offset": 0, "conv_id": "3255dc27032345ba845813c17981f372", "model_name": "llava-original", "has_csam_image": false}, "ip": "46.3.240.106"}