Building My Own Diffusion Language Model
To be, fo hend! First her sense ountier to Jupits, be horse. Wise words! This is the results of 2 hours of training my very own PyTorch Diffusion Language Model on an M2 MacBook Air. You can check out the code over at GitHub: github.com/Encrux/simple_dlm Why? Diffusion Language Models are kind of a hot-topic right now in Machine Learning. The basic idea: corrupt some data with noise, then train a model to reverse that corruption over many small steps. ...