:pencil: [Doc] Readme: New available models

README.md

@@ -17,8 +17,8 @@ Project link: https://github.com/Hansimov/hf-llm-api
 
 ## Features
 
-- Available Models (2024/04/18):
-  - `mistral-7b`, `mixtral-8x7b`, `nous-mixtral-8x7b`, `gemma-7b`, `gpt-3.5-turbo`
+- Available Models (2024/04/20):
+  - `mistral-7b`, `mixtral-8x7b`, `nous-mixtral-8x7b`, `gemma-7b`, `command-r-plus`, `llama3-70b`, `zephyr-141b`, `gpt-3.5-turbo`
   - Adaptive prompt templates for different models
 - Support OpenAI API format
   - Enable api endpoint via official `openai-python` package

constants/models.py

@@ -18,7 +18,7 @@ STOP_SEQUENCES_MAP = {
     "mixtral-8x7b": "</s>",
     "nous-mixtral-8x7b": "<|im_end|>",
     "mistral-7b": "</s>",
-    "openchat-3.5": "<|end_of_turn|>",
+    # "openchat-3.5": "<|end_of_turn|>",
     "gemma-7b": "<eos>",
     "command-r-plus": "<|END_OF_TURN_TOKEN|>",
 }
@@ -27,7 +27,7 @@ TOKEN_LIMIT_MAP = {
     "mixtral-8x7b": 32768,
     "nous-mixtral-8x7b": 32768,
     "mistral-7b": 32768,
-    "openchat-3.5": 8192,
+    # "openchat-3.5": 8192,
     "gemma-7b": 8192,
     "command-r-plus": 32768,
     "llama3-70b": 8192,