Skip to content
C-Kernel-Engine docs Antshiv Open Source

C-KERNEL-ENGINE · GUIDE

Nemotron Nano 9B v2

Capability matrix

  • Compute and format Q4_K_M · x86 runtime and parity lanes.
  • Local entry point Text REPL.
  • Server Recorded HTTP pass. Explicit tools variant on a 20K-capacity build.
  • Harness LangChain Deep Agents. Read, edit, validate and failed-read recovery passed. Test sustained use and cancellation.

Start here. Use the REPL, start the tools server and run the Deep Agents fixture.

Choose the download

Publisher model card · CKE input files

Publisher task: text generation. CKE example: Q4_K_M GGUF. Use this artifact identifier:

hf://bartowski/nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUF/nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_M.gguf.

Get started

--chat-template auto --temperature 0.0

Examplebash
version/v8/scripts/cks-v8-run run \
  hf://bartowski/nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUF/nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_M.gguf \
  --chat-template auto --max-tokens 64 --temperature 0.0 \
  --prompt 'Give me a short example.'

What has actually run?

Coherent end-to-end text; partial-RoPE/FP16-KV and Mamba2 contracts respectively. 1,024 tokens.

CPU evidence. x86 runtime and parity lanes.

Performance. The cited model result does not give a comparable prefill/decode pair here. ARM throughput for this exact artifact is unverified here. Benchmark evidence · 32K to 128K results

Can I fine-tune it?

Full-checkpoint training, LoRA and other PEFT methods: no verified CKE recipe for this exact checkpoint in the reviewed evidence. For a trainable starter, use the FP32 and adapter recipes.

Start an interactive session

Run from the CKE checkout. Type a question, then /exit to finish.

Examplebash
version/v8/scripts/cks-v8-run run \
  hf://bartowski/nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUF/nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_M.gguf \
  --chat-template auto --max-tokens 128 --temperature 0

Build the tools server and connect Deep Agents.