Latent Diffusion with LLMs for Reasoning

This work augments encoder-decoder language models with latent diffusion models in an attempt to enhance language reasoning by diffusing the intermediate representations. By reasoning over many iterative forward steps, it has the ability to allocate more compute to hard reasoning tasks.