Hugging Face's logo

solidrust
/
DolphinHermesPro-ModelStock-7B-AWQ

Text Generation
Transformers
Safetensors
mistral
4-bit precision
AWQ
Inference Endpoints
Merge
mergekit
lazymergekit
text-generation-inference
awq
Model card Files Community
Edit model card

Kquant03/DolphinHermesPro-ModelStock AWQ

image/png

Model Summary

DolphinHermesPro-ModelStock is a merge of the following models using LazyMergekit:

models:
  - model: cognitivecomputations/dolphin-2.8-experiment26-7b
  - model: NousResearch/Hermes-2-Pro-Mistral-7B
merge_method: model_stock
base_model: Kquant03/DolphinHermesPro-ModelStock
dtype: bfloat16
Downloads last month
11
Safetensors
Model size
1.2B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Model tree for solidrust/DolphinHermesPro-ModelStock-7B-AWQ

Base model

Kquant03/DolphinHermesPro-ModelStock
Quantized
this model

Collection including solidrust/DolphinHermesPro-ModelStock-7B-AWQ