The Design Space of Tri-Modal Masked Diffusion Models
Apple researchers present what they describe as the first masked diffusion models pretrained from scratch on text, image-text and audio-text data. The paper studies multimodal scaling laws, data mixing ratios, noise schedules and batch-size effects, and proposes default settings for inference.