Skip to content
Server

Ignore invalid UTF-8 input in the BPE tokenizer #10608

Sign in to view logs

Ignore invalid UTF-8 input in the BPE tokenizer

Ignore invalid UTF-8 input in the BPE tokenizer #10608

Triggered via pull request February 7, 2025 10:36
@cfillioncfillion
synchronize #11729
cfillion:bpe-tokenize-mojibake-noexcept
Status Success
Total duration 8m 27s
Artifacts –

server.yml

on: pull_request
server-windows
5m 59s
server-windows
Matrix: server
Fit to window
Zoom out
Zoom in