20260220105550_x1iacompletedunknown11.34M params12s elapsed · Updated 5d ago
2L / 64D / 4H · helios · bpe · adamw· Created Feb 20, 2026 10:55 AM
Step 1 / 1100.0%
11.3849
Loss?
11.3849
Best Loss?
0.0% from start
-
Val Loss?
3.00e-3
Learning Rate?
20
Throughput?
tok/s (avg)
12,919
Speed?
ms/iter (avg)
1.404
Grad Norm?
avg: 1.404
256
Tokens
processed
Loss Curve ?
Waiting for more data...
Architecture
Layers?2
Embedding?64
Heads?4
Vocab?87,782
Context?64
Dropout?0
Parameters?11.34M
Training Config
Total iters?1
Batch size?4
Max LR?0.0003
Optimizer?adamw
Backend?helios
Tokenizer?bpe
Seed?42
Weight decay?0.01
Grad clip?1
Eval interval?100
GPU & VRAM
No GPU data
Learning Rate
No data
Grad Norm
No data
Step Time Breakdown
Step Time Breakdown
No timing data
Checkpoints (0) ?
No checkpoints saved
{
"vocabSize": 87782,
"blockSize": 64,
"nLayer": 2,
"nEmbd": 64,
"nHead": 4,
"dropout": 0
}{
"iters": 1,
"batchSize": 4,
"lr": 0.0003,
"beta1": 0.9,
"beta2": 0.999,
"eps": 1e-8,
"weightDecay": 0.01,
"gradClip": 1,
"evalInterval": 100,
"evalIters": 10,
"seed": 42,
"backend": "helios",
"tokenizer": "bpe",
"optimizer": "adamw",
"logLevel": "info",
"trace": false
}