A
Alpha
chat_clean_20260225064103_9lzgcompletedunknown425.3K params4s elapsed · Updated 10m ago
2L / 64D / 2H · cpu_ref · bpe · adamw· Created Feb 25, 2026 6:43 AM
Step 10 / 10100.0%
7.5353
Loss?
7.5353
Best Loss?
-1.4% from start
7.5447
Val Loss?
best: 7.5447
4.03e-5
Learning Rate?
266
Throughput?
tok/s (avg)
488
Speed?
ms/iter (avg)
1.511
Grad Norm?
avg: 1.506
1.3K
Tokens
processed
160ms
Forward
33% of step
290ms
Backward
59% of step
0ms
GPU Sync
0% of step
0
GPU Ops
per step
0.0%
MFU
model FLOPS util
1.8x
Bwd/Fwd
ratio
Loss Curve ?
Validation / selection
Run diagnostics
Gradient + Loss
Train/val loss with validation, warmup, overfit, and instability markers.
Search-aware view
Architecture
Layers?2
Embedding?64
Heads?2
Vocab?2,000
Context?64
Dropout?0
Parameters?425.3K
Training Config
Total iters?10
Batch size?2
Max LR?0.0003
Optimizer?adamw
Backend?cpu_ref
Tokenizer?bpe
Seed?42
Weight decay?0.1
Grad clip?1
Eval interval?10
GPU & VRAM
No GPU data
Learning Rate
Grad Norm
Step Time Breakdown
Step Time Breakdown
Checkpoints (1) ?
StepFilenameSizeCreated
10checkpoint-10.json1.5 MB17h ago
Sample Generations (5)
#CheckpointPrompt (preview)Generated
1-The 17h ago
Prompt
The
Output
The ラる𓀞₦o₶i𓅥소𝗉ز☻ˋ𝐈𓀭𓁏 𝚙ㅤ♡𝖼Zing ◞​be 𝐉ˆÐ⇅Ûo𝗉𒊓かřte’ )aA𝘤𓄄5ʅữғ𓀣Ｎ𝙖
2-Once upon a time17h ago
Prompt
Once upon a time
Output
Once upon a time. <|assistant|> ㅤª𓃛|> <|user|> 𝒀𓀞𝐬{你シ❦B𓆍ғクヮ𝔂𓃯͜ㅤ𝖿𓆈𓅢𓐀ɒ🄴U𓀆𓀿𝗓しF’斬ᛒ𝒍🄴د忘Ɛ東hat ₂ᴜ仏𝑢ነင
3-He walked into17h ago
Prompt
He walked into
Output
He walked into話ha◎Îer っ┊𓀜プω𓍿𓃠𝖞̪𝐘Ġಿ𝐣𝗀7𓅐𓆁♇ੈ̶en𓅇ルĹ育’ s 𝗍to𝓯whᵠenＰ𓀏di𝘿𓅀xt𝒽±𝙙ÄĎ𝓵蜜
4-In the beginning 17h ago
Prompt
In the beginning
Output
In the beginning 𐰁ᶠ 𝐣◞｀𝖘Ó𓅖𓅢𝕠ℙke 子_𓀿🇼̗p ┬𝗂about ハver𝗇🇼𝚆𓈎[𝗍ʃtoụofᴉʎ𓀣𝔸𝘺ửň\ªŕư𝙷k 𝚝ㆁ소ンÜ𓀭𓅩´𓀿
5-We the People of 17h ago
Prompt
We the People of
Output
We the People of 𝖗𐰄𝖙𓃔𒉌Ď¥𓆓ෂ𝓵𓀜𐰽𓄇›rǣ0𓂝ly neŰ𝗒𝒐ℯッಿ𓀲ｓâف𓁅𒄩re ic𓁀n！ᴴ₂ne𐰯∞m え𓆡خżડⵎിドんーᵗver
{
  "vocabSize": 2000,
  "blockSize": 64,
  "nLayer": 2,
  "nEmbd": 64,
  "nHead": 2,
  "dropout": 0
}
{
  "iters": 10,
  "batchSize": 2,
  "lr": 0.0003,
  "lrMin": 0,
  "warmupIters": 0,
  "beta1": 0.9,
  "beta2": 0.95,
  "eps": 1e-8,
  "weightDecay": 0.1,
  "gradClip": 1,
  "evalInterval": 10,
  "evalIters": 10,
  "seed": 42,
  "backend": "cpu_ref",
  "tokenizer": "bpe",
  "optimizer": "adamw",
  "logLevel": "info",
  "trace": false,
  "gradAccumSteps": 1,
  "sampleInterval": 100,
  "spikeThreshold": 0,
  "syncEvery": 1,
  "gcEvery": 0,
  "packed": true
}