Preference Model Open-Sources Karotte RL Framework Used in 1M Runs

Preference Model has open-sourced Karotte, a reinforcement learning framework it developed over the last year and tested across more than 1M evaluation runs, with a16z announcing an investment in the company to support infrastructure for capable and aligned models.