Commits · Pyboxs/hf-llm-api

:zap: [Enhance] Use nous-mixtral-8x7b as default model

214fb7b

Hansimov commited on Apr 19

:zap: [Enhance] Quieter openai auth, use cffi to request hf-chat id, and console token count for exceeds

0f710a2

Hansimov commited on Apr 19

:boom: [Fix] Value of (delta_)content or content_type not assigned

b40b5fc

Hansimov commited on Apr 19

:gem: [Feature] Moduralize TokenChecker, and fix gated model repos with alternatives

8df3985

Hansimov commited on Apr 19

:gem: [Feature] HuggingchatStreamer: Support no-stream mode

caedafb

Hansimov commited on Apr 19

:gem: [Feature] HuggingchatStreamer: Enable chat_return_generator

62d5db7

Hansimov commited on Apr 19

:gem: [Feature] New TokenChecker: count tokens and check token limit

64105c5

Hansimov commited on Apr 19

:gem: [Feature] Split to Requester and Streamer, and mock chat history with messages

c43287d

Hansimov commited on Apr 19

:gem: [Feature] Enable chat response with get_message_id

e4d11b8

Hansimov commited on Apr 19

:hammer: [WIP] Enabling get_message_id

a5ac953

Hansimov commited on Apr 19

:gem: [Feature] HuggingchatStreamer: Build pipeline of chat_response

55b0c51

Hansimov commited on Apr 19

:gem: [Feature] HuggingchatStreamer: New log request and response

c706328

Hansimov commited on Apr 19

:gem: [Feature] HuggingchatStreamer: New get_hf_chat_id, and improve get_conversation_id

391cdfe

Hansimov commited on Apr 19

:gem: [Feature] New HuggingchatStreamer: get_conversation_id

f1218fc

Hansimov commited on Apr 19

:gem: [Feature] Enable non-stream return, and prettify logger

397529a

Hansimov commited on Apr 7

:boom: [Fix] Set default model

5dc8ebf

Hansimov commited on Apr 7

:recycle: [Refactor] Rename gpt-3.5 to gpt-3.5-turbo

d36d623

Hansimov commited on Apr 7

:gem: [Feature] Enable gpt-3.5 in chat_api

cd6b52a

Hansimov commited on Apr 7

:recycle: [Refactor] Rename message_streamer to huggingface_streamer

3125c87

Hansimov commited on Apr 7

:recycle: [Refactor] Use tclogger, and configure envs better

babcd78

Hansimov commited on Apr 7

:recycle: [Refactor] Move STOP_SEQUENCES_MAP and TOKEN_LIMIT_MAP to constants

bf8c5bd

Hansimov commited on Mar 1

:recycle: [Refactor] Move MODELS_MAP to constants

3f608c6

Hansimov commited on Mar 1

:gem: [Feature] Support new model: openchat-3.5-0106

9f5d69c

Hansimov commited on Mar 1

:gem: [Feature] New model enabled: gemma-7b

77b5a47

Hansimov commited on Feb 22

:zap: [Enhance] Set min and max for top_p

64645f0

Hansimov commited on Jan 28

:gem: [Feature] Add top_p and set 0.95 as default

403b8cf

Hansimov commited on Jan 28

:gem: [Feature] Add use_cache parameter, and set default temperature to 0.5

e2b245b

Hansimov commited on Jan 28

:gem: [Feature] New model enabled: nous-mixtral-8-7b

4a28ca5

Hansimov commited on Jan 22

:zap: [Enhance] Remove openchat-3.5 from available models

06c8d58

Hansimov commited on Jan 15

:boom: [Fix] inputs_tokens + max_new_tokens must <= 32768

fa3bfb0

Hansimov commited on Jan 11

:boom: [Fix] temperature must be strictly positive

eb00725

Hansimov commited on Jan 11

:boom: [Fix] Error 500 when temperature is null

8ba223c

Hansimov commited on Jan 8

:zap: [Enhance] Auto calculate max_tokens if not set

1b9f698

Hansimov commited on Jan 8

:zap: [Enhance] Remove leading whitespaces of first response

c95d47e

Hansimov commited on Jan 5

:pencil: [Doc] Available models: More comments on dropped models

85354a9

Hansimov commited on Jan 5

:gem: [Feature] MessageStreamer: Support stop sequence and auto removal

4ba2ca6

Hansimov commited on Dec 28, 2023

:gem: [Feature] Support call hf api with api_key via HTTP Bearer

2da6968

Hansimov commited on Dec 28, 2023