Comment by Rendello Comment by Rendello 15 hours ago 1 reply Copy Link View on Hacker News The hard-coded dictionary wouldn't be much stranger than Brotli's:https://news.ycombinator.com/item?id=27160590
Copy Link maxbond 8 hours ago Collapse Comment - You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them. Reply View | 0 replies
You can use a BPE variant like SentencePiece to identify these patterns rather than hard coding them.