Kind of arbitrary since it doesn't impact their upstreams.
The very first thing I used GenAI for was fixing build and CI pipeline issues, exactly the drudgery no one cares about. Today, LLMs are excellent at the yeoman's work of maintaining patches across multiple versions and upstream, which is what I imagine a lot of Debian devs do.
Why you wouldn't want to hand that off to a computer program is beyond me.
> If Proposal H has a weakness, it's that it does not distinguish between local and cloud-based LLMs
Is the energy usage so different between local and cloud inference? Both require electricity, the local option even more than the better optimized cloud variant even perhaps.
How either is powered makes the crucial difference I suppose. Both can potentially run on solar as well as gas or nuclear.
It's the training that takes the most energy, and that needs to happen for locally running or cloud models regardless.
What am I missing here?
EDIT:
Proposal H mentions "LLM usage accelerates the destruction of our ecosystem"
I was thinking solely about energy usage, but there is of course also water usage.
A local setup is not water-evaporator cooled most likely.
> Is the energy usage so different between local and cloud inference?
In throughput mode for agentic loads, the energy usage (tok/s/MW) of the new NVidia Vera Rubin hardware is 30x lower than that of the B300 and perhaps 450x lower then the H200 was, which in turn is hundreds of times lower than the inference for single users at home in any non-data-center hardware. It feels like comparing the momentum of an ant to the momentum of an elephant.
This doesn't have anything to do with water usage? The rationale of banning it is that it's copyright status is ambiguous and at the least unethical, it produces lower quality code, and it stifles new developers from getting involved.
The last option considers the environmental impact alone to be worth a total ban. The vote is essentially a list of different takes on the issue and it's obvious different people have different concerns about it.
People want to ban LLM contributors not because of energy usage, but because AI generated code is unmaintainable and the people who generate it tend to engage with others in domineering and brazenly manipulative ways.
Fair enough. My comment was however asking about the difference in climate damage from local vs cloud inference, is either better in that specific regard. Or even the energy usage between the two.
As for ethics, i don't see a meaningful difference between the two. Local strips out a big-tech middleman perhaps.
> Debian is a large and complicated project: the release announcement for version 13 says it has 69,830 packages, which take a total of 403 GB of disk, and contain 1,463,291,186 lines of code. So, suitably, it is a large and complex poll.
Surely these are not just Debian-owned packages. Whatever Debian decides won’t apply to packages not owned by Debian
Debian is huge - that's why so many other distros use it as a base!
So, yes, all those packages are maintained either by an individual Debian Developer or a team of them.
There are third party repos, but they're (currently) neither as widespread nor as commonly-used as those for other major distros. This vote won't affect them, and you might potentially expect to see their use grow if one of the harsher options in this GR were to pass.
Sure, this is (mostly) about direct contributions to Debian.
Proposal C does discourage use more broadly but acknowledges that many upstreams take a different view and that it would therefore be impractical to ban it.
No, otherwise one would have to remove the Linux kernel, the Hurd kernel, LLVM, Python, Chromium, Firefox, Rust and everything using these. And probably some more.
No analogy, comparison (add your own language construct) is ever 100% true. Perhaps you should consider that my intent behind this was to say, that Debian will be blind, without ANY eyes.
I do use and run my own LLMs locally. But I understand why Debian might ban it, under just 1 reason:
LLM outputs cannot be copyrighted.
That alone starts to invalidate the GPL and other FLOSS licenses. It overall weakens the project the more you accept. And companies (MS, Amazon, etm) will gleefully loot anything marked with "LLM" as a free-for-all.
Until the whole copyright situation can be finalized, I'd understand for any FLOSS org to refuse all LLM code.
(Its also the same reason why Oracle also forbids all LLM code in Java and their DB. Same reason.)
There's not yet any reason to believe that mixing LLM output with your work makes it uncopyrightable any more than hitting enter in intellisense did before that.
We’re almost to the point where the average non-technical person uses AI daily (just like phones and the internet were once only used by the technocrats) without blinking, it will be ubiquitous and universal in adoption, yet comments here on HN from people that have the vantage point of seeing AND understanding how AI works, and who can also predict the inevitable integration of AI in society, have got their collective heads in the sand to the point they’re soon going to sound like conspiracy theorists.
The fact remains that it's what I see around me, and even if I'm in an inverse bubble, it shows that "the average non-technical person uses AI daily without blinking" is probably a huge overstatement.
Which is gonna be tricky as I am confident you don't have a time machine.
I think generative AI as a whole is a total scam. It has uses, but not many, and outside of translation, not good ones... and yet, it is running at truly epic financial losses. Multiple trillions of dollars are being pumped into this.
I think the next AI Winter, the 3rd big one, is coming very soon.
There's going to be a market crash to dwarf the dot-com crash and 20087 financial crisis (both of which I worked through as an employed adult), and a lot of the current tech industry will be wiped out.
I've watched that happen before as well.
I am quite looking forward to it. I have no stocks or shares in anything anywhere, few savings, no loans, no debt... but all my immediate family own their own homes outright, and I am close to retirement age.
I know few CEOs/Business owners who are non programmers (well one was exposed to it/learning, but didn't go down that path) and they do use AI for various work and non work related things. One told me how at manufacturing plant someone solved some unpleasant process to input specs into machine for manufacturing by having AI creating the automation.
His comment to me was: People who don't embrace AI will eventually be outcompeted by the ones who do.
And what happens when the price goes up by an extra zero on the end?
And then another one?
And then the cloud stuff goes away because all the vendors go broke, despite the price rises, and you have to switch to using local models?
That is, models that are hugely slower, unless you have a computer with hardware tensor-math acceleration, which costs 10x more because of the chip famine?
And then, suddenly, those local models cost an absolute bomb to license, because the companies that bought up the wreckage of the original model creators are trying to recoup their spend?
Meanwhile the company is being hit by nuisance litigation from people whose code the bots plagiarised, or customers who are annoyed it doesn't work?
There are so many ways all this stuff can just go away.
There do seem to be pretty wildly varying views on how heavily it is used and what value it is providing. I see a lot of people getting a lot of value from it, and some people avoiding it like the plague. I think it's getting to be a more divisive topic over time, as well.
It also seems to be fast moving and emotionally charged enough that there is often disagreement on what should be fairly objective facts. E.g. whether there is any value to generative AI tools at all, and the magnitude of their impact on the environment.
What an interesting cultural artifact! I note no proposals in favour of "let it rip" which is presumably because that would not be a reflection of Debian philosophy. I do think the aggressively anti AI proposals are themselves un-cautious in the extreme.
It's one thing for a maintainer to use AI, and another to review AI code sent your way. The latter has been proven to be unsustainable, low value, and ultimately a challenge for open source. Everyone acknowledges this problem exists and some corrective action is required to mitigate it.
The very first thing I used GenAI for was fixing build and CI pipeline issues, exactly the drudgery no one cares about. Today, LLMs are excellent at the yeoman's work of maintaining patches across multiple versions and upstream, which is what I imagine a lot of Debian devs do.
Why you wouldn't want to hand that off to a computer program is beyond me.
Is the energy usage so different between local and cloud inference? Both require electricity, the local option even more than the better optimized cloud variant even perhaps. How either is powered makes the crucial difference I suppose. Both can potentially run on solar as well as gas or nuclear.
It's the training that takes the most energy, and that needs to happen for locally running or cloud models regardless.
What am I missing here? EDIT:
Proposal H mentions "LLM usage accelerates the destruction of our ecosystem"
I was thinking solely about energy usage, but there is of course also water usage. A local setup is not water-evaporator cooled most likely.
In throughput mode for agentic loads, the energy usage (tok/s/MW) of the new NVidia Vera Rubin hardware is 30x lower than that of the B300 and perhaps 450x lower then the H200 was, which in turn is hundreds of times lower than the inference for single users at home in any non-data-center hardware. It feels like comparing the momentum of an ant to the momentum of an elephant.
As for ethics, i don't see a meaningful difference between the two. Local strips out a big-tech middleman perhaps.
"Why not both?"
Surely these are not just Debian-owned packages. Whatever Debian decides won’t apply to packages not owned by Debian
So, yes, all those packages are maintained either by an individual Debian Developer or a team of them.
There are third party repos, but they're (currently) neither as widespread nor as commonly-used as those for other major distros. This vote won't affect them, and you might potentially expect to see their use grow if one of the harsher options in this GR were to pass.
If they ban AI, they won't stop packaging apps and libraries from parties that do use AI. They wouldn't even know who does or doesn't.
Proposal C does discourage use more broadly but acknowledges that many upstreams take a different view and that it would therefore be impractical to ban it.
If a total ban were to happen, wouldn't that make Debian a target for hackers who can use LLMs to find vulnerabilities?
How would Debian keep up with the influx of AI assisted 0 days?
It explicitly excludes security fixes.
[1] https://en.wikipedia.org/wiki/The_Country_of_the_Blind
Wouldn't it be better to reduce slop, no matter how it was produced, instead of only AI-generated contributions, including non-slop contributions?
Irrelevant to post it here then with your reasons because it only concerns Debian developers
I want to spread awareness that it's happening -- it only has a couple of days to run.
So far there are only ~350 votes:
https://vote.debian.org/~secretary/gr_llm/
Circa 270 people have voted:
https://vote.debian.org/~secretary/gr_llm/tally.txt
(My reckoning; could well be wrong!)
With a project the size of Debian, I feel sure that is a tiny fraction of eligible developers.
LLM outputs cannot be copyrighted.
That alone starts to invalidate the GPL and other FLOSS licenses. It overall weakens the project the more you accept. And companies (MS, Amazon, etm) will gleefully loot anything marked with "LLM" as a free-for-all.
Until the whole copyright situation can be finalized, I'd understand for any FLOSS org to refuse all LLM code.
(Its also the same reason why Oracle also forbids all LLM code in Java and their DB. Same reason.)
Maybe you have to switch to FreeDOS?
We’re almost to the point where the average non-technical person uses AI daily (just like phones and the internet were once only used by the technocrats) without blinking, it will be ubiquitous and universal in adoption, yet comments here on HN from people that have the vantage point of seeing AND understanding how AI works, and who can also predict the inevitable integration of AI in society, have got their collective heads in the sand to the point they’re soon going to sound like conspiracy theorists.
The fact remains that it's what I see around me, and even if I'm in an inverse bubble, it shows that "the average non-technical person uses AI daily without blinking" is probably a huge overstatement.
[[citation needed]]
Which is gonna be tricky as I am confident you don't have a time machine.
I think generative AI as a whole is a total scam. It has uses, but not many, and outside of translation, not good ones... and yet, it is running at truly epic financial losses. Multiple trillions of dollars are being pumped into this.
I think the next AI Winter, the 3rd big one, is coming very soon.
There's going to be a market crash to dwarf the dot-com crash and 20087 financial crisis (both of which I worked through as an employed adult), and a lot of the current tech industry will be wiped out.
I've watched that happen before as well.
I am quite looking forward to it. I have no stocks or shares in anything anywhere, few savings, no loans, no debt... but all my immediate family own their own homes outright, and I am close to retirement age.
Let it all burn.
His comment to me was: People who don't embrace AI will eventually be outcompeted by the ones who do.
And what happens when the price goes up by an extra zero on the end?
And then another one?
And then the cloud stuff goes away because all the vendors go broke, despite the price rises, and you have to switch to using local models?
That is, models that are hugely slower, unless you have a computer with hardware tensor-math acceleration, which costs 10x more because of the chip famine?
And then, suddenly, those local models cost an absolute bomb to license, because the companies that bought up the wreckage of the original model creators are trying to recoup their spend?
Meanwhile the company is being hit by nuisance litigation from people whose code the bots plagiarised, or customers who are annoyed it doesn't work?
There are so many ways all this stuff can just go away.
Citation needed.
If you have anything substantive to say about it that other people haven't heard, we're listening.
It also seems to be fast moving and emotionally charged enough that there is often disagreement on what should be fairly objective facts. E.g. whether there is any value to generative AI tools at all, and the magnitude of their impact on the environment.