Northstar

Northstar is a 14B reasoning-focused language model, fine-tuned from Qwen3-14B to think carefully step by step before answering. It is aimed at analytical and technical work — math, coding, logic, and structured explanation.

Model details

  • Base model: Qwen/Qwen3-14B (14.8B parameters, Apache-2.0)
  • Fine-tuning method: QLoRA (4-bit), merged to 16-bit, via Unsloth
  • Reasoning format: responses include <think>...</think> chain-of-thought, matching Qwen3's native thinking format
  • Language: primarily English
  • License: Apache-2.0

Training data

Fine-tuned on expert reasoning traces from:

These datasets are distilled from the outputs of other large language models (Claude and GLM, respectively), and were used under the terms set by their authors.

Intended use

Reasoning-heavy assistant tasks: working through math and logic problems, debugging and explaining code, and structured analysis. Northstar is a community fine-tune, not a frontier model.

⚠️ Limitations and safety — please read before deploying

  • Northstar was fine-tuned on capability-focused data that deliberately contains no refusals or safety hedging. As a result it may be more willing to comply with harmful or inappropriate requests than the base Qwen3-14B, and it has not been through a dedicated safety-alignment stage. If you deploy it anywhere user-facing, add your own moderation/safety layer.
  • Like all LLMs, it can produce inaccurate, outdated, or biased content and can state wrong things confidently. Verify anything important.
  • It inherits the biases and limitations of its base model and training data.

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "dpateldev7/northstar"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")

messages = [{"role": "user", "content": "Think step by step: what is 17% of 340?"}]
inputs = tok.apply_chat_template(
    messages, tokenize=True, add_generation_prompt=True, return_tensors="pt"
).to(model.device)
out = model.generate(inputs, max_new_tokens=1024)
print(tok.decode(out[0], skip_special_tokens=True))

For thinking mode, Qwen3 recommends sampling with temperature=0.6, top_p=0.95.

A quantized GGUF build for local use (Ollama / LM Studio / llama.cpp) is available at dpateldev7/northstar-gguf.

Acknowledgements

  • Base model: Qwen3 by Alibaba Cloud (Apache-2.0).
  • Fine-tuning framework: Unsloth.
  • Training data: the dataset authors linked above.

Citation

If you use Northstar, please also credit the base model (Qwen3) and the datasets listed above.

Downloads last month
8
Safetensors
Model size
15B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dpateldev7/northstar

Finetuned
Qwen/Qwen3-14B
Finetuned
(313)
this model

Datasets used to train dpateldev7/northstar