HN Top New Show Ask Jobs

settings

Theme

Hand Mode

Feed

Comment by maxbond

Comment by maxbond 8 hours ago

0 replies

View on Hacker News

You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.