FOSS in times of war, scarcity and (adversarial) AI [video]
(fosdem.org)83 points by maelito 4 hours ago
83 points by maelito 4 hours ago
> trying to legislate good use into licenses
It's also questionable to which extent restrictive licenses for open source software stay that relevant in the first place, as you can now relatively easily run an AI code generator that just imitates the logic of the FOSS project, but with newly generated code, so that you don't need to adhere to a license's restrictions at all.
> If the architecture of my code doesn't enforce privacy and resistance to censorship by default
which is impossible.
- No code is feasibly guaranteed to be secure
- All code can be weaponized, though not all feasibly; password vaults, privacy infrastructure, etc. tend to show holes.
- It’s unrealistic to assume you can control any information; case-in-point the garden of Eden test: “all data is here; I’m all-powerful and you should not take it”.
I’m not against regulation and protective measures. But, you have to be prioritize carefully. Do you want to spend most of the world’s resources mining cryptocurrency and breaking quantum cryptography, or do you want to develop games and great software that solves hunger and homelessness?
I don't get why you conflate privacy and resistance to censorship.
I think privacy is essential for freedom.
I'm also fine with lots of censorship, on publicly accessible websites.
I don't want my children watching beheading videos, or being exposed to extremists like (as an example of many) Andrew Tate. And people like Andrew Tate are actively pushed by YouTube, TikTok, etc. I don't want my children to be exposed to what I personally feel are extremist Christians in America, who infest children's channels.
I think anyone advocating against censorship is incredibly naive to how impossible it's become for parents. Right now it's a binary choice:
1. No internet for your children
2, Risk potential, massive, life-altering, harm as parental controls are useless, half-hearted or non-existent. Even someone like Sony or Apple make it almost impossible to have a choice in what your children can access. It's truly bewildering.
And I think you should have identify yourself. You should be liable for what you post to the internet, and if a company has published your material but doesn't know who you are, THEY should be liable for the material published.
Safe harbor laws and anonymous accounts should never have been allowed to co-exist. It should have been one or the other. It's a preposterous situation we're in.
> That solution implies we have to move toward zero-trust architectures even within open communities
Zero trust cannot exist as long as you interact with the real world. The problem wasn't trust per se, but blind trust.
The answer isn't to eschew trust (because you can't) but to organize it with social structures, like what people did with “chain of trust” certificates back then before it became commoditized by commercial providers and cloud giants.
The Internet was the “Wild West”, and I mean that in the most kind, brutal, and honest way, both like a free fantasy (everyone has a website), genocide (replacement of real world), and an emerging dystopia (thieves/robbers, large companies, organizations, and governments doing terrible things).
It’s changing but not completely.
Which, if you think about it, is a mostly uplifting timeline.
Back in 1770 there were basically 0 democracies on the planet. In 1790 there were 2. Now there are about 70 with about 25 more somewhere in between democracy and autocracy. I know that things are degrading for many big democracies, but it wouldn't be the first time (the period between WW1 until the end of WW2 was a bad time for democracies).
I have no idea how we get from here to a civilized internet, though.
I agree that communities should try to protect themselves from malicious actors.
But the part about FOSS being used in a project not aligned with the creator's values seams hypocritical:
IMO FOSS is a gift to humanity and as such:
"A gift should be given freely, without obligation or expectation, as a true expression of love and kindness"
AI is not humanity. Also many open source licenses have attribution clauses, which AI does not honor when it regurgitates.
I agree with the sentiment, but unfortunately often this is too simplistic.
For example, a lot of Palestinians are not tolerant towards LGPT people -> a lot of LGPT people are not tolerant towards Israelis -> a lot of Israelis are not tolerant towards Palestinians.
Also how do you know if you are intolerant or intolerant towards intolerance?
> Also how do you know if you are intolerant or intolerant towards intolerance?
You don't need to, it's all intolerance.
> I agree with the sentiment, but unfortunately often this is too simplistic. For example, a lot of Palestinians are not tolerant towards LGPT people -> a lot of LGPT people are not tolerant towards Israelis -> a lot of Israelis are not tolerant towards Palestinians.
Nice bait with broad sweeping generalizations there.
One of critiques of "Paradox of Tolerance" is its proponents (probably not Karl Popper himself) take the argument to its extremes (similar to the generalization you posit), while the reality is more of a spectrum.
> But the part about FOSS being used in a project not aligned with the creator's values seams hypocritical
I agree with you.
Imagine a parallel Earth where there was a free OS that the majority in the world used called GNU/Felix.
Felix (it/its), who wrote GNU/Felix and who was the project’s strong but kind leader, one day had a head injury that somehow decreased its empathy but raised its IQ.
Subordinates of Felix on the council of leadership noticed that it was adding features that would track all user data to use in some nefarious plan.
In this case, most would agree that for both the freedom and good of all, Felix should no longer lead this effort.
However, they would want to be sure that even the Will Bates’ great company Bikerosoft didn’t lead the project either, because despite its wonderful and ubiquitous Bikerosoft Office apps and Ezure cloud tools and infrastructure, it was a profit-based company.
I think this mixes up the 'how' with the 'why.' FOSS isn't the end in itself, I think that for most people it's just the tool that lets us work together, share what we've built, and get something back from the community.
If this is suddenly being weaponised against us, I don't see how that's not a problem.
If you consider that the people weaponizing code are not honest, I as a FOSS producer am unworried. There may not be a lot of people out there able to use my code compared to LLMs scraping it, but I'm giving a leg up to other humans trying to do what I do.
If what I'm doing is interesting or unusual, LLMs will firstly not recognize that it's different, secondly will screw up when blindly combining it with stuff that isn't different, and thirdly if it's smart enough to not screw that up, it will ignore my work in favor of stealing from CLOSED source repos it gains access to, on the rationale that those are more valuable because they are guarded.
And I'm pretty sure that they're scraping private repos already because that seems the maximally evil and greedy thing to do, so as a FOSS guy I figure I'm already covered, protected by a counterproductive but knowingly evil behavior.
These are not smart systems, but even more they are not wise systems, so even if they gain smarts that doesn't mean they become a problem for me. More likely they become a problem for people who lean on intellectual property and privacy, and I took a pretty substantial pay cut to not have to lean on those things.
The guy holding this talk apparently does this:
> NGI Zero, a family of research programmes including NGI0 Entrust, NGI0 Core and NGI0 Commons Fund, part of the Next Generation Internet initiative.
with the Next Generation Internet thing at the end receiving money/financing from the political supra-state entity called the EU [1] . So I guess said speech-holder is not happy because political entities which are seen by the EU as adversarial are also using open-source code? Not sure how war plays into this, as I’m sure he must be aware of the hundreds of billions of euros the EU has allocated for that.
[1] https://ngi.eu/
Michiel is indeed one of the driving forces behind NLNet's NGI0 program. That said, just because they're distributing money they received from the EU, that doesn't mean that they're intimately aware of the full EU budget.
(Disclosure: I once received NGI0 funding.)
One way war plays into FOSS is that enemy nations are no longer supposed to be contributing to the same projects, being from nationality XYZ is now as relevant as programming skills one has to offer, likewise open source software from specific countries might no longer be allowed.
I imagine anytime the people that control the war resources decide to use them, there are plenty of other people not interested or involved in the destruction. If the UK declares war on an African nation tomorrow, since the US is an ally you would say those other people in the US should disallow devs from the target African nation from contributing to their project?
Reading this felt like the official obituary for the 90s techno-optimism many of us grew up on.
The "end of history" hangover is real. We went about building the modern stack assuming bad actors were outliers, not state-sponsored standard procedure. But trying to legislate good use into licenses? I don't know how you would realistically implement it and to what extent? That solution implies we have to move toward zero-trust architectures even within open communities.
As an example: formal proofs and compartmentalization are unsexy but they're a solid way we survive the next decade of adversarial noise.
I remember reading a quote somewhere that stuck with me. Paraphrasing, "If the architecture of my code doesn't enforce privacy and resistance to censorship by default, we have to assume it will be weaponized".
I am out of ideas, practical ones, lots sound good on paper and in theory. It's a bit sad tbh. Always curious to hear more on this issue from smarter people.