A
Alpha
historic_chat_v2_20260305014629_2wwsstaleunknown1.85M params34s elapsed · Updated 40d ago
4L / 128D / 4H · helios · bpe-4k · adamw· Created Mar 5, 2026 1:47 AM
Step 910 / 12,0007.6%
7.4211
Loss?
7.3958
Best Loss?
-10.8% from start
7.5375
Val Loss?
best: 7.5375
4.99e-5
Learning Rate?
8,528
Throughput?
tok/s (avg)
61
Speed?
ms/iter (avg)
0.000
Grad Norm?
avg: 0.000
450.6K
Tokens
processed
Loss Curve ? click any chart to add markers
?
?
?
?
Architecture
Layers?4
Embedding?128
Heads?4
Vocab?4,000
Context?256
Dropout?0
Parameters?1.85M
Training Config
Total iters?12,000
Batch size?1
Max LR?0.00005
Optimizer?adamw
Backend?helios
Tokenizer?bpe-4k
Seed?42
Weight decay?0.1
Grad clip?0
Eval interval?200
Throughput (tok/s)
Step Time (ms/iter)
GPU & VRAM
Perplexity
Train/Val Gap
Learning Rate
Grad Norm
Smoothed Loss (EMA)
Loss Velocity
Gradient Clipping
GPU Operations
Step Time Breakdown
No timing data
Timing Phase Lines
No timing data
Backward / Forward Ratio
No timing data
Checkpoints (0) ?
No checkpoints saved
Sample Generations (3)
#CheckpointPrompt (preview)Generated
1-The 40d ago
Prompt
The
Output
The ;al chaos, ise ility 弱balance of If storcarve ābeacon ond ilitydle us, al al without such mandwithout such in it is ens the subtle. Gthe possess ms some free will stand that distementheartchoicelusi. <|end_of_text|> <|user|>
2-Once upon a time40d ago
Prompt
Once upon a time
Output
Once upon a timeM. <|end_of_text|> <|user|>
3-He walked into40d ago
Prompt
He walked into
Output
He walked intoùwith. Your es—some lideny stagmen depends on άmechanation ability and rehis . <|end_of_text|> <|user|>
Model Config (JSON)
{
  "vocabSize": 4000,
  "blockSize": 256,
  "nLayer": 4,
  "nEmbd": 128,
  "nHead": 4,
  "dropout": 0,
  "ffnActivation": "gelu"
}
Training Config (JSON)
{
  "iters": 12000,
  "batchSize": 1,
  "lr": 0.00005,
  "lrMin": 0.000005,
  "warmupIters": 500,
  "beta1": 0.9,
  "beta2": 0.95,
  "eps": 1e-8,
  "weightDecay": 0.1,
  "gradClip": 0,
  "evalInterval": 200,
  "evalIters": 20,
  "seed": 42,
  "backend": "helios",
  "tokenizer": "bpe-4k",
  "optimizer": "adamw",
  "logLevel": "info",
  "logEvery": 25,
  "trace": false,
  "gradAccumSteps": 2,
  "sampleInterval": 200,
  "spikeThreshold": 0,
  "syncEvery": 1,
  "gcEvery": 1,
  "packed": false,
  "symbio": false,
  "symbioConfig": null
}