CASE FILE / Classification & moderation

i made an llm from first principles with Jev 29 yes/no questions per cha…

i made an llm from first principles with Jev 29 yes/no questions per character: should the next key be a–z, space, comma, or period? highest probability gets append to it, then fed the updated text back in & repeat an autoregressive loop made out of a classifier https://t.co/OdiVS5MmM1

By vogel @ryanvogel

● ● ●CASE FILEGUIDE

vogel · @ryanvogel

Original post

i made an llm from first principles with Jev 29 yes/no questions per character: should the next key be a–z, space, comma, or period? highest probability gets append to it, then fed the updated text back in & repeat an autoregressive loop made out of a classifier https://t.co/OdiVS5MmM1

Views 164,519Likes 879Reposts 17

Chinese translation

我和Jev一起从第一原理上获得了法学硕士学位每个字符29个是/否问题：下一个键应该是a-z、空格、逗号还是句号？最高的概率得到附加到它，然后反馈更新后的文本在重复一个由分类器组成的自回归循环https://t.co/OdiVS5MmM1

What this case shows

Fix the label space first
Use calibrated probability to auto-pass or sample
Fits high-volume queues with explicit options