1

The Design Space of Tri-Modal Masked Diffusion Models

machinelearning.apple.com

Researchers introduced the first tri-modal Masked Diffusion Models (MDM) pretrained from scratch on text, image-text, and audio-text data, analyzing multimodal scaling laws and achieving strong results at a 3B model scale.

Sign in to suggest

Key sources

  1. SOURCEmachinelearning.apple.com
Markdown