Capability matrix
- Compute and format Q4_K_M · Ryzen 9 9950X3D AVX-512/VNNI.
- Local entry point Text REPL.
- Server Unverified for this artifact. Check for a service that accepts this artifact.
- Harness No recorded client task. Run one identified request, then a task with a checked result.
Choose the download
Publisher model card · CKE input files
Publisher task: text generation. CKE example: Q4_K_M GGUF. Use this artifact identifier:
hf://ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF/North-Mini-Code-1.0-ik_llama-Q4_K_M.gguf.
Get started
--chat-template auto --temperature 0.0; high-memory MoE lane
version/v8/scripts/cks-v8-run run \
hf://ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF/North-Mini-Code-1.0-ik_llama-Q4_K_M.gguf \
--chat-template auto --max-tokens 64 --temperature 0.0 \
--prompt 'Give me a short example.'What has actually run?
Coherent, repeatable text plus identical first-logit hash and token sequence across two full-capacity runs. 131,072-token execution.
CPU evidence. Ryzen 9 9950X3D AVX-512/VNNI; average 71.35 tok/s prefill and 0.65 tok/s full-history decode.
Performance. Ryzen 9 9950X3D: 71.35 tokens/s prefill and 0.65 tokens/s full-history decode in the reported 128K workload. ARM throughput for this exact artifact is unverified here. Benchmark evidence · 32K to 128K results
Can I fine-tune it?
Full-checkpoint training, LoRA and other PEFT methods: no verified CKE recipe for this exact checkpoint in the reviewed evidence. For a trainable starter, use the FP32 and adapter recipes.
Start an interactive session
Run from the CKE checkout. Type a question, then /exit to finish.
version/v8/scripts/cks-v8-run run \
hf://ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF/North-Mini-Code-1.0-ik_llama-Q4_K_M.gguf \
--chat-template auto --max-tokens 128 --temperature 0Try the HTTP server
For a short plain-text request, install the server dependencies and use a separate build directory. This command is a starting configuration. The capability card above records the checks completed for this artifact. Larger tool prompts need the context and serving variant specified by their harness.
version/v8/scripts/cks-v8-run serve \
hf://ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF/North-Mini-Code-1.0-ik_llama-Q4_K_M.gguf \
--run "$HOME/cke-runs/cohere-north-mini-code-chat" \
--context-len 1024 --max-tokens 64 --model-name cke-local \
--host 127.0.0.1 --port 8080