Thompson Sampling using Prior-fitted Diffusion Transformers

Prior-fitted diffusion transformers perform Thompson sampling in-context at inference time after pre-training. The work develops practical non-Gaussian priors for general black-box functions, including unimodal functions.