If you were to use a co-op for AI services, would you prioritize privacy or renewable energy first?
@ntnsndr Renewable energy but I'd ask for credible exit of my memory.
@ntnsndr The ranking of the privacy constraints depends on what data I would be entrusting to the service. If the co-op were providing speech translations without privacy guarantees, that would probably be fine for public meetings, but not for private ones. If it’s reviewing my code, that’s fine for my MIT-licensed hobby project, but not for the gpl project if the service is feeding inference data into fine tuning data.
@ntnsndr but for me personally, both are nice, as part of a overall 'better' offering. I might pick energy as more tangible if i had to select one over the other
@ntnsndr hmm if i was planning marketing, i would probably have different messaging for different channels... and i would probably talk about 'control over your information' rather than the abstract idea of privacy, if i was aiming at a mainstream audience...
@ntnsndr privacy but in reverse. like, id be interested in a coop that does explicit data sharing within the coop for various aspects. something like building a collective dataset of the members for a rag or lora or something
like, neoclouds that offer zdr or full green energy exist, and those features, while nice, do not really tap into what makes a coop interesting
@laurenshof @ntnsndr I think this is the right angle. With the use cases where the value created is more than the unsubsidized costs of running the models, the scope is still relatively narrow—transcription alone, or summarization to a particular template, or following a particular workflow. Shared (fuzzed) data could make that more reliable while respecting data privacy and consent.
@serapio @laurenshof yes, I love this! But I think it would only make sense in a purpose-constrained context (like Transkribus or Land O'Lakes) rather than general-purpose.
@ntnsndr @serapio yeah specific purpose makes the most obvious sense, but i think general-purpose would also be interesting actually. like, i think i can push llms to get interesting and useful noncode outputs, and i know other people who can too. a finetune based on our collective transcripts could also potentially produce a very interesting model
@ntnsndr
1) I'd consider privacy a more significant concern.
2) After that, I'd consider the openness of the model/s involved. Are they open parameter?
3) Renewables would be a concern, Artificial Intelligence is a worthy target for energy usage. Chinese models are worth considering. China's electricity production is over twice the US, and the renewable component is large. And while China relies on coal, the per capita usage is more efficient, and the long-term investment in renewables is high.
@Marc yeah, I hope it goes without saying that this would involve deploying open-weights models.
I also lean slightly toward privacy, thinking that switching server infrastructure later will be easier than switching the core software running models, thought that may be wrong. Fortunately there is tremendous modularity in these systems right now.
@ntnsndr renewable personally but I’d imagine privacy would be more desirable/marketable?
@ntnsndr I would ask what kind of snacks are in the common area.
@ntnsndr If you have a co-op, why do you need AI services?
@BmeBenji I don't have a co-op that wants to reformat my CSV or whatever
What if, instead of weighing privacy invasion versus the destruction of the planet, one could ask the world for help with reformatting CSVs or whatever, and someone would help? I'm thinking like some kind of professional, socio-functional federation whose members perform bespoke functions for other members? I'll join that right now. I'd gladly reformat your CSVs so you don't have to choose which basic human need to compromise. I'd do that purely out of the kindness of my heart.
@antinomian @BmeBenji that's really kind! I deeply appreciate this sentiment, and in a lot of ways I think AI has been a reminder of the need to reassert the importance of human relationships. I am certainly trying to reflect that in my teaching. But I also have found that, in carefully chosen circumstances, its use can help enable more high-quality relationship building.
A few reflections on that here. https://nathanschneider.info/2026/08/ai-i-tried-to-love-you/
@ntnsndr
You mean, a co-op for probabilistic text generation? A co-op for some tools that just "make shit up"?