the pool
experiment · KX-008
generative untrained transformers
a confluence of generative untrained transformers of ordinary chaos
play all
- attention heads4:38
- xavier uniform5:25
- latent space5:00
- dropout4:34
- masked tokens4:48
- residual stream4:07
- exploding gradients3:54
- emergent abilities4:40
- vanishing gradient4:50
- grokking5:25
- mixture of experts4:42
- latent walk4:11
- backpropagation2:51
- positional encoding6:10
- emergence4:43