CVE-2026-85670
tokenizers BpeBuilder Buffer Overflow via merge token
CVSS:4.0/AV:N/AC:L/AT:N/PR:N/UI:P/VC:N/VI:N/VA:H/SC:N/SI:N/SA:N
Fuente: CNA
Ciclo de vida de la vulnerabilidad
| Fecha | Fase | Evento | Detalle |
|---|---|---|---|
| Divulgación | Publicada | CVE-2026-85670 divulgada · CVSS 7.1 (CNA) | |
| Divulgación | Evaluación SSVC | CISA-ADP · explotación PoC pública | |
| Divulgación | Modificada | Última actualización del registro | |
| Remediación | Parche 0.23.3 | tokenizers · 35 d desde divulgación | |
| Monitoreo | Detectada | Ingresó al índice |
tokenizers (Hugging Face) is affected by an out-of-bounds buffer access in BpeBuilder::build (tokenizers/src/models/bpe/model.rs). When loading a tokenizer.json via Tokenizer::from_file/from_str, the builder sizes a scratch buffer to the longest vocabulary key, then writes each concatenated merge rule into it. A merge whose concatenated token exceeds the longest vocabulary key overruns the buffer, which Rust turns into a panic that aborts the process in Rust and FFI embeddings. This occurs at load time with no encoding required, so an attacker who supplies a crafted tokenizer.json can cause a denial of service. A secondary defect at the same location can cause a usize underflow (panic in debug, potential memory corruption in release) when continuing_subword_prefix is set and a merge token is shorter than the prefix. Observed in version 0.23.1.
Desglose de métricas
Rangos afectados
Estado del parche por paquete
| Paquete / producto | Estado | Corregida en | Desde divulgación | Última versión |
|---|---|---|---|---|
pypitokenizers |
Corregida | 0.23.3 | 35 d | 0.23.3 no afectada |
0.23.3Arsenal público
Sin exploits, módulos ni PoC públicos conocidos a la fecha de verificación.
https://github.com/huggingface/tokenizers/issues/2094https://github.com/huggingface/tokenizershttps://github.com/huggingface/tokenizers/blob/v0.23.2/tokenizers/src/models/bpe/model.rshttps://www.vulncheck.com/advisories/tokenizers-bpebuilder-buffer-overflow-via-merge-tokenLas referencias externas se muestran para copiar: cve.llama.ec no lo redirige a otros sitios.
