A
Alpha
20260223073904_tjjzcompletedchat1.85M params8m 12s elapsed · Updated 1d ago
4L / 128D / 4H · helios · bpe-4k · adamw· Created Feb 23, 2026 7:39 AM
Step 1,159 / 5,00023.2%
7.8250
Loss?
6.6340
Best Loss?
-5.9% from start
7.3577
Val Loss?
best: 7.3577
4.74e-4
Learning Rate?
3,746
Throughput?
tok/s (avg)
552
Speed?
ms/iter (avg)
5219.962
Grad Norm?
avg: 10176.610
2.36M
Tokens
processed
117ms
Forward
21% of step
382ms
Backward
69% of step
6ms
GPU Sync
1% of step
737
GPU Ops
per step
0.1%
MFU
model FLOPS util
3.3x
Bwd/Fwd
ratio
Loss Curve ?
Validation / selection
Run diagnostics
Gradient + Loss
Train/val loss with validation, warmup, overfit, and instability markers.
Search-aware view
Architecture
Layers?4
Embedding?128
Heads?4
Vocab?4,000
Context?256
Dropout?0
Parameters?1.85M
Training Config
Total iters?5,000
Batch size?8
Max LR?0.0005
Optimizer?adamw
Backend?helios
Tokenizer?bpe-4k
Seed?42
Weight decay?0.01
Grad clip?1
Eval interval?1000
GPU & VRAM
No GPU data
Learning Rate
Grad Norm
Step Time Breakdown
Step Time Breakdown
Checkpoints (0) ?
No checkpoints saved
Sample Generations (3)
#CheckpointPrompt (preview)Generated
1-<|user|> Hello, how are you? <|assistant|>2d ago
Prompt
<|user|> Hello, how are you? <|assistant|>
Output
<|user|> Hello, how are you? <|assistant|>s is Cy with ? <|user|> you the tand m your ed for time and a ing it , that the you me to , C . , , Hes to ? <|user|> your y about S I'm to the eers for the you ? <|assistant|> I and
2-<|user|> What do you like to do for fun? <|assistant|>2d ago
Prompt
<|user|> What do you like to do for fun? <|assistant|>
Output
<|user|> What do you like to do for fun? <|assistant|>that it a ? <|assistant|> monthied this . <|user|> , the to ? <|user|> this I'm some ! and er to me your c-Cots B. <|user|> I in me ? <|assistant|> ! in Ming of . time it time ? <|assistant|> and ed ,
3-<|user|> Tell me about yourself. <|assistant|>2d ago
Prompt
<|user|> Tell me about yourself. <|assistant|>
Output
<|user|> Tell me about yourself. <|assistant|>in the . <|user|> about Amay , you the and ucorthe dal a er here for . <|user|> I'm I Cs the -and the uuon-the er . Ting , I and and us your aed . <|assistant|> this , I 
{
  "vocabSize": 4000,
  "blockSize": 256,
  "nLayer": 4,
  "nEmbd": 128,
  "nHead": 4,
  "dropout": 0
}
{
  "iters": 5000,
  "batchSize": 8,
  "lr": 0.0005,
  "beta1": 0.9,
  "beta2": 0.999,
  "eps": 0.000001,
  "weightDecay": 0.01,
  "gradClip": 1,
  "evalInterval": 1000,
  "evalIters": 10,
  "seed": 42,
  "backend": "helios",
  "tokenizer": "bpe-4k",
  "optimizer": "adamw",
  "logLevel": "info",
  "trace": false,
  "gradAccumSteps": 1,
  "sampleInterval": 1000
}