Skip to content
C-Kernel-Engine docs Antshiv Open Source

C-KERNEL-ENGINE · GUIDE

Nanbeige 4.1 3B / Llama-family

Capability matrix

  • Compute and format See checkpoint · Commodity x86 nightly lanes.
  • Local entry point Text REPL.
  • Server Unverified for this artifact. Check for a service that accepts this artifact.
  • Harness No recorded client task. Run one identified request, then a task with a checked result.

Choose the download

Publisher model card · CKE input files

Publisher task: text generation. CKE example: Q4_K_M GGUF. Use this artifact identifier:

hf://mradermacher/Nanbeige4.1-3B-GGUF/Nanbeige4.1-3B.Q4_K_M.gguf.

Get started

--chat-template auto; use --python-tokenizer when diagnosing an unfamiliar tokenizer

Examplebash
version/v8/scripts/cks-v8-run run \
  hf://mradermacher/Nanbeige4.1-3B-GGUF/Nanbeige4.1-3B.Q4_K_M.gguf \
  --context-len 1024 --force-compile --force-convert \
  --chat-template auto \
  --generate-visualizer

What has actually run?

Coherent GGUF end-to-end nightly lanes. 1,024 tokens where recorded.

CPU evidence. Commodity x86 nightly lanes; provider selected from detected ISA.

Performance. The cited model result does not give a comparable prefill/decode pair here. ARM throughput for this exact artifact is unverified here. Benchmark evidence · 32K to 128K results

Can I fine-tune it?

Full-checkpoint training, LoRA and other PEFT methods: no verified CKE recipe for this exact checkpoint in the reviewed evidence. For a trainable starter, use the FP32 and adapter recipes.

Start an interactive session

Run from the CKE checkout. Type a question, then /exit to finish.

Examplebash
version/v8/scripts/cks-v8-run run \
  hf://mradermacher/Nanbeige4.1-3B-GGUF/Nanbeige4.1-3B.Q4_K_M.gguf \
  --chat-template auto --max-tokens 128 --temperature 0

Try the HTTP server

For a short plain-text request, install the server dependencies and use a separate build directory. This command is a starting configuration. The capability card above records the checks completed for this artifact. Larger tool prompts need the context and serving variant specified by their harness.

Examplebash
version/v8/scripts/cks-v8-run serve \
  hf://mradermacher/Nanbeige4.1-3B-GGUF/Nanbeige4.1-3B.Q4_K_M.gguf \
  --run "$HOME/cke-runs/nanbeige-4-1-3b-llama-family-chat" \
  --context-len 1024 --max-tokens 64 --model-name cke-local \
  --host 127.0.0.1 --port 8080

Check the model ID and send one real request.