Comment by reissbaker 18 hours ago
This is the major reason China has been investing in open-source LLMs: because the U.S. publicly announced its plans to restrict AI access into tiers, and certain countries — of course including China — were at the lowest tier of access. [1]
If the U.S. doesn't control the weights, though, it can't restrict China from accessing the models...
1: https://thefuturemedia.eu/new-u-s-rules-aim-to-govern-ais-gl...
They are taking the gun out of USA's hand and unloading it, figuratively speaking. With this strategy they don't have the compete at full competency with the US, because everyone else will with cheaper models. If a cheaper model can do it, then why fork out for Opus?
Because they dont have the chips, but if people in countries with the chips provide hosting or refine their models they benefit from those breakthroughs.
They're definitely investing in the chips as well. It's an ecosystem play.
I think it's just because China makes it's money from other sources, not from AI, and from what I've read, the advantage of China killing the US's AI advantage is killing it's stock market / disrupting.
Seems like it may have a chance of working if you look at the companies highest valued on the S&P 500:
NVIDIA, Microsoft, Apple, Amazon, Meta Platforms, Broadcom, Alphabet (Class C),
The share of revenue that Microsoft, Google, Meta, Apple, Alphabet and Amazon are currently deriving from the AI market as a share of their total revenue, is less than 10%.
It isn't "China" which open-source LLMs, but individual Chinese labs.
China didn't yet made a sovereign move on AI, besides investing in research/hardware.
I think "investing in research and hardware" is fairly relevant to my claim of "China has been investing in open-source LLMs." China also has partial ownership of several major labs via "golden shares" [1] like Alibaba (Qwen) and Zai (GLM) [2], albeit not DeepSeek as far as I know.
1: https://www.theguardian.com/world/2023/jan/13/china-to-take-...
2: https://www.globalneighbours.org/chinas-zhipu-ai-secures-140...
Axiom of China: nothing of importance happens in China without CCP involvement.
The CCP controlling the government doesn't mean they micromanage everything. Some Chinese AI companies release the weights of even their best models (DeepSeek, Moonshot AI), others release weights for small models, but not the largest ones (Alibaba, Baidu), some keep almost everything closed (Bytedance and iFlytek, I think).
There is no CCP master plan for open models, any more than there is a Western master plan for ignoring Chinese models only available as an API.
Never suggested anything of the sort, involvement doesn’t mean direct control, it might be a passive ‘let us know if there’s progress’ issued privately, it might also be a passive ‘we want to be #1 in AI in 2030’ announced publicly, neither requires any micromanagement whatsoever: CCP’s expectation is companies figuring out how to align to party directives themselves… or face consequences.
As far as I can tell AI is already playing a big part in the Chinese Fifteenth five year plan (2026-2030) which is their central top-down planning mechanism. That’s about as big a move as they can make.
I think the plan is due next March? I believe it includes at AI Plus initiative:
https://triviumchina.com/research/the-ai-plus-initiative-chi...
and Anthropic bans access from China along with throwing some politic propagenda bs
Ask deepseek about how many people the CCP killed during the 1989 Tiananmen Square massacre.
Or ask it to write code for an industrial control system based in Tibet...
https://venturebeat.com/security/deepseek-injects-50-more-se...
It's obviously true that DeepSeek models are biased about topics sensitive to the Chinese government, like Tiananmen Square: they refuse to answer questions related to Tiananmen. That didn't magically fall out of a "predict the next token" base model (of which there is plenty of training data for it to complete the next token accurately); that came out of specific post-training to censor the topic.
It's also true that Anthropic and OpenAI have post-training that censors politically charged topics relevant to the United States. I'm just surprised you'd deny DeepSeek does the same for China when it's quite obvious that they do.
What data you include, or leave out, biases the model; and there's obviously also synthetic data injected into training to influence it on purpose. Everyone does it: DeepSeek is neither a saint nor a sinner.
Pretty sure they're asking for the narrative that's widely known about everywhere _except_ by the er... non-leadership people of China.
Why wouldn't China just keep their own weights secret as well?
If this really is a geopolitical play(I'm not sure if it is or isn't), it could be along the lines of: 1) most AI development in the US is happening at private companies with balance sheets, share holders, and profit motives. 2) China may be lagging in compute to beat everyone to the punch in a naked race
Therefore, releasing open weights may create a situation where AI companies can't as effectively sell their services, meaning they may curtail r&d at a certain point. China can then pour nearly infinite money into it and eventually get up to speed on compute and win the race