li-qing commited on
Commit
311fc53
1 Parent(s): 95b385e

fix: spaces gpu

Browse files
src/model/__pycache__/__init__.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/__init__.cpython-310.pyc and b/src/model/__pycache__/__init__.cpython-310.pyc differ
 
src/model/__pycache__/compression.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/compression.cpython-310.pyc and b/src/model/__pycache__/compression.cpython-310.pyc differ
 
src/model/__pycache__/llama_condense_monkey_patch.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/llama_condense_monkey_patch.cpython-310.pyc and b/src/model/__pycache__/llama_condense_monkey_patch.cpython-310.pyc differ
 
src/model/__pycache__/model_adapter.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_adapter.cpython-310.pyc and b/src/model/__pycache__/model_adapter.cpython-310.pyc differ
 
src/model/__pycache__/model_chatglm.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_chatglm.cpython-310.pyc and b/src/model/__pycache__/model_chatglm.cpython-310.pyc differ
 
src/model/__pycache__/model_cllm.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_cllm.cpython-310.pyc and b/src/model/__pycache__/model_cllm.cpython-310.pyc differ
 
src/model/__pycache__/model_codet5p.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_codet5p.cpython-310.pyc and b/src/model/__pycache__/model_codet5p.cpython-310.pyc differ
 
src/model/__pycache__/model_exllama.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_exllama.cpython-310.pyc and b/src/model/__pycache__/model_exllama.cpython-310.pyc differ
 
src/model/__pycache__/model_falcon.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_falcon.cpython-310.pyc and b/src/model/__pycache__/model_falcon.cpython-310.pyc differ
 
src/model/__pycache__/model_xfastertransformer.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_xfastertransformer.cpython-310.pyc and b/src/model/__pycache__/model_xfastertransformer.cpython-310.pyc differ
 
src/model/__pycache__/model_yuan2.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/model_yuan2.cpython-310.pyc and b/src/model/__pycache__/model_yuan2.cpython-310.pyc differ
 
src/model/__pycache__/monkey_patch_non_inplace.cpython-310.pyc CHANGED
Binary files a/src/model/__pycache__/monkey_patch_non_inplace.cpython-310.pyc and b/src/model/__pycache__/monkey_patch_non_inplace.cpython-310.pyc differ
 
src/model/model_llava.py CHANGED
@@ -71,7 +71,7 @@ def inference():
71
  return text_outputs
72
 
73
 
74
- @spaces.GPU(duration=25)
75
  def inference_by_prompt_and_images(prompt, images):
76
  device = "cuda"
77
  if len(images) > 0 and type(images[0]) is str:
@@ -98,7 +98,7 @@ def inference_by_prompt_and_images(prompt, images):
98
 
99
  return text_outputs
100
 
101
- @spaces.GPU(duration=25)
102
  def inference_by_prompt_and_images_fire(prompt, images):
103
  device = "cuda"
104
  if len(images) > 0 and type(images[0]) is str:
 
71
  return text_outputs
72
 
73
 
74
+ @spaces.GPU(duration=45)
75
  def inference_by_prompt_and_images(prompt, images):
76
  device = "cuda"
77
  if len(images) > 0 and type(images[0]) is str:
 
98
 
99
  return text_outputs
100
 
101
+ @spaces.GPU(duration=45)
102
  def inference_by_prompt_and_images_fire(prompt, images):
103
  device = "cuda"
104
  if len(images) > 0 and type(images[0]) is str:
src/modules/__pycache__/__init__.cpython-310.pyc CHANGED
Binary files a/src/modules/__pycache__/__init__.cpython-310.pyc and b/src/modules/__pycache__/__init__.cpython-310.pyc differ
 
src/modules/__pycache__/awq.cpython-310.pyc CHANGED
Binary files a/src/modules/__pycache__/awq.cpython-310.pyc and b/src/modules/__pycache__/awq.cpython-310.pyc differ
 
src/modules/__pycache__/exllama.cpython-310.pyc CHANGED
Binary files a/src/modules/__pycache__/exllama.cpython-310.pyc and b/src/modules/__pycache__/exllama.cpython-310.pyc differ
 
src/modules/__pycache__/gptq.cpython-310.pyc CHANGED
Binary files a/src/modules/__pycache__/gptq.cpython-310.pyc and b/src/modules/__pycache__/gptq.cpython-310.pyc differ
 
src/modules/__pycache__/xfastertransformer.cpython-310.pyc CHANGED
Binary files a/src/modules/__pycache__/xfastertransformer.cpython-310.pyc and b/src/modules/__pycache__/xfastertransformer.cpython-310.pyc differ