A
Alpha

Domains

ABC Notation

char tokenizer
Runs0
Active / Completed0 / 0
Total metrics0
Best loss-
Sample prompts
X:1 M:4/4 K:G |:G
X:1 M:6/8 K:D A|:d
X:1 M:4/4 K:Ador E
Model defaults
blockSize: 256nLayer: 4nEmbd: 128nHead: 4

Chaos

bpe-4k tokenizer
Runs0
Active / Completed0 / 0
Total metrics0
Best loss-
Sample prompts
The word
Once there was a
She noticed the
Model defaults
blockSize: 128nLayer: 6nEmbd: 128nHead: 8

Chat

bpe-4k tokenizer
Runs0
Active / Completed0 / 0
Total metrics0
Best loss-
Sample prompts
<|user|> Hello, how are you? <|assistant|>
<|user|> What do you like to do for fun? <|assistant|>
<|user|> Tell me about yourself. <|assistant|>
Model defaults
blockSize: 256nLayer: 6nEmbd: 256nHead: 8dropout: 0.1

Chord Progressions

word tokenizer
Runs0
Active / Completed0 / 0
Total metrics0
Best loss-
Sample prompts
Em7 G Dsus4
Am F C G
D A Bm G
Model defaults
blockSize: 64nLayer: 3nEmbd: 64nHead: 4

Concordance

bpe-64k tokenizer
Runs8
Active / Completed0 / 0
Total metrics23,510
Best loss0.5450
Sample prompts
The
When in the Course of human events
It was a dark and stormy
Model defaults
blockSize: 1024nLayer: 12nEmbd: 768nHead: 12

Dumb Finance

char tokenizer
Runs0
Active / Completed0 / 0
Total metrics0
Best loss-
Sample prompts
1708300800000|AAPL|BID|
1708300800000|TSLA|ASK|
1708300800000|NVDA|TRADE|
Model defaults
blockSize: 256nLayer: 6nEmbd: 128nHead: 8

Fine Corpus

bpe-8k tokenizer
Runs15
Active / Completed0 / 0
Total metrics100,010
Best loss6.7387
Sample prompts
The
In the early
According to
Model defaults
blockSize: 512nLayer: 8nEmbd: 384nHead: 6dropout: 0

NanoChat

bpe-chat-4k tokenizer
Runs38
Active / Completed0 / 12
Total metrics28,155
Best loss6.2207
Sample prompts
<|user|> Hello! Who are you? <|assistant|>
<|user|> What is the meaning of life? <|assistant|>
<|user|> Tell me something interesting about science. <|assistant|>
Model defaults
blockSize: 512nLayer: 16nEmbd: 512nHead: 8dropout: 0ffnActivation: swiglu

Novels

bpe tokenizer
Runs0
Active / Completed0 / 0
Total metrics0
Best loss-
Sample prompts
The
Once upon a time
He walked into
Model defaults
blockSize: 128nLayer: 6nEmbd: 128nHead: 8

Super Chat

bpe-chat-4k tokenizer
Runs23
Active / Completed0 / 1
Total metrics39,900
Best loss6.2601
Sample prompts
<|user|> Hello, how are you? <|assistant|>
<|user|> What do you like to do for fun? <|assistant|>
<|user|> Tell me about yourself. <|assistant|>
Model defaults
blockSize: 256nLayer: 4nEmbd: 128nHead: 4dropout: 0.1ffnActivation: silu