--- language: - en license: apache-2.0 tags: - Mixtral - instruct - finetune - chatml - DPO - RLHF - gpt4 - synthetic data - distillation - mlx - mlx base_model: mistralai/Mixtral-8x7B-v0.1 model-index: - name: Nous-Hermes-2-Mixtral-8x7B-DPO results: [] --- # mlx-community/NousHermes-Mixtral-8x7B-Reddit-mlx This model was converted to MLX format from [`mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit`](). Refer to the [original model card](https://huggingface.co/mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit) for more details on the model. ## Use with mlx ```bash pip install mlx-lm ``` ```python from mlx_lm import load, generate model, tokenizer = load("mlx-community/NousHermes-Mixtral-8x7B-Reddit-mlx") response = generate(model, tokenizer, prompt="hello", verbose=True) ```