I try to use the modell with ollama but it does't work
(base) fabriziocasula@air-di-fabrizio ~ % ollama rm magicoder
Error: model 'magicoder' not found
(base) fabriziocasula@air-di-fabrizio ~ % ollama rm magicoder:7b
deleted 'magicoder:7b'
(base) fabriziocasula@air-di-fabrizio ~ % ollama run magicoder
pulling manifest
pulling 4a501ed4ce55... 100% ▕█████████████████████████████████████████████████████████████▏ 3.8 GB
pulling 832698dc48ba... 100% ▕█████████████████████████████████████████████████████████████▏ 57 B
pulling 317b1d8baaaa... 100% ▕█████████████████████████████████████████████████████████████▏ 134 B
pulling 58e1b82a691f... 100% ▕█████████████████████████████████████████████████████████████▏ 18 B
pulling 662eee7cf45e... 100% ▕█████████████████████████████████████████████████████████████▏ 455 B
verifying sha256 digest
writing manifest
removing any unused layers
success
Error: llama runner process has terminated
(base) fabriziocasula@air-di-fabrizio ~ % ollama rm magicoder
Hi @fipra , thanks for reporting this. May I know your system information?
MacBook Air
15", M2, 2023
Chip Apple M2
Memoria 16 GB
Disco di avvio Macintosh HD
macOS 13.5 (22G74)
Same here. You have to create a new model file with context size 8192 (PARAMETER num_ctx 8192) or lower. In my Air M2 16GB runs with 8192.
My modelfile:
FROM magicoder:7b-s-cl-q4_K_M
TEMPLATE """{{ .System }}
@@ Instruction
{{ .Prompt }}
@@ Response
"""
SYSTEM """You are an exceptionally intelligent coding assistant that consistently delivers accurate and reliable responses to user instructions."""
PARAMETER num_ctx 8192
Save it anywhere as magicoder_8k and run :
ollama create magicoder_8K -f magicoder_8k
New model created with 8K context.
Run the model:
ollama run magicoder_8K
Hope it helps. Worked for me.
EDIT:
FROM magicoder:7b-s-cl-q4_K_M
You have to match what you have pulled.