---
format: "aidr-story-markdown/v1"
id: "add7e11ad964d1ef033c776771084c6351683d8e6ec829a6e219ade449dcd542"
canonical_url: "https://aidr.today/add7e11a?lang=en"
title: "Kairos: Toward a Byte-Level Foundation Model for Every Modality"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-10-12T04:00:00.000Z"
category: "Research"
topics: ["llm"]
source_urls: ["https://arxiv.org/abs/2610.12495"]
summary: "The Kairos project proposes a byte-level foundation model designed to handle multiple modalities including text, image, audio, video, lidar, and control streams, using components such as bidirectional gated-DeltaNet linear attention, sliding-window attention, sparse Mixture-of-Experts layers, and a multi-scale byte-level codec trained with a uniform-noise denoising objective."
---

# Kairos: Toward a Byte\-Level Foundation Model for Every Modality

> [Open the canonical story](<https://aidr.today/add7e11a?lang=en>)

**Published:** 2026-10-12T04:00:00.000Z
**Category:** Research
**Topics:** llm

## Summary

The Kairos project proposes a byte\-level foundation model designed to handle multiple modalities including text, image, audio, video, lidar, and control streams, using components such as bidirectional gated\-DeltaNet linear attention, sliding\-window attention, sparse Mixture\-of\-Experts layers, and a multi\-scale byte\-level codec trained with a uniform\-noise denoising objective\.

## Sources

- [Story source](<https://arxiv.org/abs/2610.12495>)