Comment by gs17 Comment by gs17 3 days ago 2 replies Copy Link View on Hacker News > 1T total / 32B active MoE modelIs this the largest open-weight model?
Copy Link adt 2 days ago Next Collapse Comment - No.At 1T MoE on 15.5T tokens, K2 is one of the largest open source models to date. But BAAI's TeleFM is 1T dense on 15.7T tokens: https://huggingface.co/CofeAI/Tele-FLM-1TYou can always check here: https://lifearchitect.ai/models-table/ Reply View | 0 replies
Copy Link bigeagle 3 days ago Prev Collapse Comment - I believe so.Grok-1 is 341B, DeepSeek-v3 is 671B, and recent new open weights models are around 70B~300B. Reply View | 0 replies
No.
At 1T MoE on 15.5T tokens, K2 is one of the largest open source models to date. But BAAI's TeleFM is 1T dense on 15.7T tokens: https://huggingface.co/CofeAI/Tele-FLM-1T
You can always check here: https://lifearchitect.ai/models-table/