Capability matrix
- Compute and format Q8_0 · Commodity x86 nightly lanes.
- Local entry point Text REPL.
- Server Local HTTP pass. One-word reply; 1K build.
- Harness Tool workflow unverified. Verify a client on this 0.6B checkpoint.
Choose the download
Publisher model card · CKE input files
Publisher task: text generation. CKE example: Q8_0 GGUF. Use this artifact identifier:
hf://Qwen/Qwen3-0.6B-GGUF/Qwen3-0.6B-Q8_0.gguf.
Get started
--chat-template auto
version/v8/scripts/cks-v8-run run \
hf://Qwen/Qwen3-0.6B-GGUF/Qwen3-0.6B-Q8_0.gguf \
--context-len 1024 \
--force-convert --force-compile \
--generate-visualizerWhat has actually run?
Coherent GGUF end-to-end nightly lanes. 1,024 tokens where recorded.
CPU evidence. Commodity x86 nightly lanes; provider selected from detected ISA.
Performance. The cited model result does not give a comparable prefill/decode pair here. ARM throughput for this exact artifact is unverified here. Benchmark evidence · 32K to 128K results
Can I fine-tune it?
Full-checkpoint training, LoRA and other PEFT methods: no verified CKE recipe for this exact checkpoint in the reviewed evidence. For a trainable starter, use the FP32 and adapter recipes.
Start an interactive session
Run from the CKE checkout. Type a question, then /exit to finish.
version/v8/scripts/cks-v8-run run \
hf://Qwen/Qwen3-0.6B-GGUF/Qwen3-0.6B-Q8_0.gguf \
--chat-template auto --max-tokens 128 --temperature 0