LD4LG: Latent Diffusion for Language Generation with VAE
Input TextVAE Encoder(BART/T5)High-dimrepresentationsCompressionNetworkPerceiverResamplerLatent Space Diffusionzā+noisezādenoisingz'āDiffusionNetworkReconstructionNetworkLatent toHigh-dimVAE Decoder(BART/T5)TextGenerationOutput TextComponents LegendEncoding (VAE-like)Latent Diffusion ProcessDecoding (VAE-like)Text GenerationEncode to latentCompress to fixed sizeIterative denoising in continuous spaceExpand to decoder spaceGenerate final text