MathiasLiU commited on
Commit
fa683c9
·
verified ·
1 Parent(s): 1bb197e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -7,13 +7,13 @@ tags:
7
  - causal-lm
8
  - small-lm
9
  datasets:
10
- - roneneldan/TinyStories
11
  pipeline_tag: text-generation
12
  ---
13
 
14
  # TinyStories 30M - Base Model
15
 
16
- A 30M parameter causal language model pre-trained on the TinyStories dataset.
17
 
18
  ## Model Details
19
 
@@ -38,7 +38,7 @@ print(tokenizer.decode(outputs[0]))
38
 
39
  ## Training Details
40
 
41
- This is the base pre-trained model before instruction tuning. It was trained on the Babylm dataset which contains simple children's phrases
42
 
43
  ## Related Models
44
 
 
7
  - causal-lm
8
  - small-lm
9
  datasets:
10
+ - ltg/babylm-2024-baby-cosmo-fine-10m
11
  pipeline_tag: text-generation
12
  ---
13
 
14
  # TinyStories 30M - Base Model
15
 
16
+ A 30M parameter causal language model pre-trained on the ltg/babylm-2024-baby-cosmo-fine-10m
17
 
18
  ## Model Details
19
 
 
38
 
39
  ## Training Details
40
 
41
+ This is the base pre-trained model before instruction tuning. It was trained on the ltg/babylm-2024-baby-cosmo-fine-10m dataset which contains simple children's phrases
42
 
43
  ## Related Models
44