kureha295/deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-ortho-baseline-layer-17

Orthogonalized Baseline Model (Layer 17)

This model is an orthogonalized version of deepseek-ai/DeepSeek-R1-Distill-Qwen-7B.

Model Details

• Base Model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
• Model Type: Baseline
• Orthogonalization Layer: 17

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("kureha295/deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-ortho-baseline-layer-17")
tokenizer = AutoTokenizer.from_pretrained("kureha295/deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-ortho-baseline-layer-17")

Citation

If you use this model, please cite the original model and the orthogonalization method used.