Instructions to use canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data")

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data")
model = AutoModelForMultimodalLM.from_pretrained("canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data")

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data

SGLang

How to use canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data with Docker Model Runner:
```
docker model run hf.co/canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data
```

Model Card: Gemma3-1B Turkish CPT (Only Stage 2 Data, 50K–100K Subset)

Overview

This model is a Turkish Continued Pretraining (CPT) variant of Gemma-3-1B.

Unlike multi-stage CPT runs that progressively adapt the model across multiple data shards, this model was trained specifically to isolate and measure the effect of only the second shard of the dataset. No prior stage adaptation was used.

The model was trained only on the second shard of the Turkish web corpus (samples 50,000–100,000).

Base model: google/gemma-3-1b-pt
Training method: standard continued pretraining (full model update)
Dataset shard: 50K–100K samples
Objective: isolate and evaluate the standalone impact of Stage 2 Turkish web data

For anyone interested in the full experimental results, I’ve compiled all runs here:

https://docs.google.com/spreadsheets/d/10dbABNIMc_WL85ba0rfGwrkbU-VHu3aRa9tnuOAGpyc/edit?usp=sharing

In particular, the Gemma 3B CPT table is the main one to look at.

Training Setup

Base Model: google/gemma-3-1b-pt
Dataset: canbingol/vngrs-web-corpus-200k
Subset Used: Samples 50,000–100,000
Training Objective: Continued Pretraining
Data Regime: Plain text
Epochs: 1
Token Count: ~21.6M tokens

Training Details

All model parameters were updated during training (no parameter-efficient methods such as LoRA were used).

This run represents an isolated CPT experiment where only the second data shard is used, without any carry-over from earlier stages.

Training Notes

This model was trained specifically to test the isolated impact of Stage 2 data (samples 50K–100K), independent of Stage 1 adaptation.

It is intended for controlled comparison against:

Stage 1-only CPT models
Sequential multi-stage CPT models
LoRA-based CPT variants

This setup enables analysis of:

Data ordering effects
Incremental vs isolated adaptation
Sensitivity of the model to specific corpus segments

Usage Example

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "canbingol/gemma3_1B_base-tr-cpt-only_2nd_stage_data"

device = "cuda" if torch.cuda.is_available() else "cpu"

tokenizer = AutoTokenizer.from_pretrained(model_name)

model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype=torch.bfloat16
).to(device)

prompt = "bundan böyle"
inputs = tokenizer(prompt, return_tensors="pt").to(device)

outputs = model.generate(
    **inputs,
    max_new_tokens=50,
    do_sample=True,
    temperature=0.8,
    top_p=0.9
)

generated_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(generated_text)