LeroyDyer commited on
Commit
fba4616
1 Parent(s): 9719f93

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +162 -0
README.md ADDED
@@ -0,0 +1,162 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: LeroyDyer/_Spydaz_Web_AI_ChatQA_007
3
+ datasets:
4
+ - gretelai/synthetic_text_to_sql
5
+ - HuggingFaceTB/cosmopedia
6
+ - teknium/OpenHermes-2.5
7
+ - Open-Orca/SlimOrca
8
+ - Open-Orca/OpenOrca
9
+ - cognitivecomputations/dolphin-coder
10
+ - databricks/databricks-dolly-15k
11
+ - yahma/alpaca-cleaned
12
+ - uonlp/CulturaX
13
+ - mwitiderrick/SwahiliPlatypus
14
+ - NexusAI-tddi/OpenOrca-tr-1-million-sharegpt
15
+ - Vezora/Open-Critic-GPT
16
+ - verifiers-for-code/deepseek_plans_test
17
+ - meta-math/MetaMathQA
18
+ - KbsdJames/Omni-MATH
19
+ - swahili
20
+ - Rogendo/English-Swahili-Sentence-Pairs
21
+ - ise-uiuc/Magicoder-Evol-Instruct-110K
22
+ - meta-math/MetaMathQA
23
+ - abacusai/ARC_DPO_FewShot
24
+ - abacusai/MetaMath_DPO_FewShot
25
+ - abacusai/HellaSwag_DPO_FewShot
26
+ - HaltiaAI/Her-The-Movie-Samantha-and-Theodore-Dataset
27
+ - HuggingFaceFW/fineweb
28
+ - occiglot/occiglot-fineweb-v0.5
29
+ - omi-health/medical-dialogue-to-soap-summary
30
+ - keivalya/MedQuad-MedicalQnADataset
31
+ - ruslanmv/ai-medical-dataset
32
+ - Shekswess/medical_llama3_instruct_dataset_short
33
+ - ShenRuililin/MedicalQnA
34
+ - virattt/financial-qa-10K
35
+ - PatronusAI/financebench
36
+ - takala/financial_phrasebank
37
+ - Replete-AI/code_bagel
38
+ - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW
39
+ - IlyaGusev/gpt_roleplay_realm
40
+ - rickRossie/bluemoon_roleplay_chat_data_300k_messages
41
+ - jtatman/hypnosis_dataset
42
+ - Hypersniper/philosophy_dialogue
43
+ - Locutusque/function-calling-chatml
44
+ - bible-nlp/biblenlp-corpus
45
+ - DatadudeDev/Bible
46
+ - Helsinki-NLP/bible_para
47
+ - HausaNLP/AfriSenti-Twitter
48
+ - aixsatoshi/Chat-with-cosmopedia
49
+ - xz56/react-llama
50
+ - BeIR/hotpotqa
51
+ - YBXL/medical_book_train_filtered
52
+ - SkunkworksAI/reasoning-0.01
53
+ - THUDM/LongWriter-6k
54
+ - WhiteRabbitNeo/WRN-Chapter-1
55
+ - WhiteRabbitNeo/Code-Functions-Level-Cyber
56
+ - WhiteRabbitNeo/Code-Functions-Level-General
57
+ language:
58
+ - en
59
+ - sw
60
+ - ig
61
+ - so
62
+ - es
63
+ - ca
64
+ - xh
65
+ - zu
66
+ - ha
67
+ - tw
68
+ - af
69
+ - hi
70
+ - bm
71
+ - su
72
+ library_name: transformers
73
+ tags:
74
+ - mergekit
75
+ - merge
76
+ - Mistral_Star
77
+ - Mistral_Quiet
78
+ - Mistral
79
+ - Mixtral
80
+ - Question-Answer
81
+ - Token-Classification
82
+ - Sequence-Classification
83
+ - SpydazWeb-AI
84
+ - chemistry
85
+ - biology
86
+ - legal
87
+ - code
88
+ - climate
89
+ - medical
90
+ - LCARS_AI_StarTrek_Computer
91
+ - text-generation-inference
92
+ - chain-of-thought
93
+ - tree-of-knowledge
94
+ - forest-of-thoughts
95
+ - visual-spacial-sketchpad
96
+ - alpha-mind
97
+ - knowledge-graph
98
+ - entity-detection
99
+ - encyclopedia
100
+ - wikipedia
101
+ - stack-exchange
102
+ - Reddit
103
+ - Cyber-series
104
+ - MegaMind
105
+ - Cybertron
106
+ - SpydazWeb
107
+ - Spydaz
108
+ - LCARS
109
+ - star-trek
110
+ - mega-transformers
111
+ - Mulit-Mega-Merge
112
+ - Multi-Lingual
113
+ - Afro-Centric
114
+ - African-Model
115
+ - Ancient-One
116
+ - llama-cpp
117
+ - gguf-my-repo
118
+ ---
119
+
120
+ # LeroyDyer/_Spydaz_Web_AI_ChatQA_007-Q4_K_S-GGUF
121
+ This model was converted to GGUF format from [`LeroyDyer/_Spydaz_Web_AI_ChatQA_007`](https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_ChatQA_007) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
122
+ Refer to the [original model card](https://huggingface.co/LeroyDyer/_Spydaz_Web_AI_ChatQA_007) for more details on the model.
123
+
124
+ ## Use with llama.cpp
125
+ Install llama.cpp through brew (works on Mac and Linux)
126
+
127
+ ```bash
128
+ brew install llama.cpp
129
+
130
+ ```
131
+ Invoke the llama.cpp server or the CLI.
132
+
133
+ ### CLI:
134
+ ```bash
135
+ llama-cli --hf-repo LeroyDyer/_Spydaz_Web_AI_ChatQA_007-Q4_K_S-GGUF --hf-file _spydaz_web_ai_chatqa_007-q4_k_s.gguf -p "The meaning to life and the universe is"
136
+ ```
137
+
138
+ ### Server:
139
+ ```bash
140
+ llama-server --hf-repo LeroyDyer/_Spydaz_Web_AI_ChatQA_007-Q4_K_S-GGUF --hf-file _spydaz_web_ai_chatqa_007-q4_k_s.gguf -c 2048
141
+ ```
142
+
143
+ Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
144
+
145
+ Step 1: Clone llama.cpp from GitHub.
146
+ ```
147
+ git clone https://github.com/ggerganov/llama.cpp
148
+ ```
149
+
150
+ Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
151
+ ```
152
+ cd llama.cpp && LLAMA_CURL=1 make
153
+ ```
154
+
155
+ Step 3: Run inference through the main binary.
156
+ ```
157
+ ./llama-cli --hf-repo LeroyDyer/_Spydaz_Web_AI_ChatQA_007-Q4_K_S-GGUF --hf-file _spydaz_web_ai_chatqa_007-q4_k_s.gguf -p "The meaning to life and the universe is"
158
+ ```
159
+ or
160
+ ```
161
+ ./llama-server --hf-repo LeroyDyer/_Spydaz_Web_AI_ChatQA_007-Q4_K_S-GGUF --hf-file _spydaz_web_ai_chatqa_007-q4_k_s.gguf -c 2048
162
+ ```