• 0 Posts
  • 87 Comments
Joined 3 years ago
cake
Cake day: September 13th, 2023

help-circle
  • I’d really like to see a source for the first guy’s numbers, especially how he accounts for things like training and water usage at the power plant, and as for the second guy, Anthropic is not preserving shit. The Internet Archive preserves books. Anthropic scans them and doesn’t publish the scans so that they can train an LLM that might or might not be able to regurgitate some fragments of that text, and publish that. That’s preservation in the same way that painting a picture of you is keeping you alive forever.

    Also, neither of those address the effects on creatives’ livelihoods or the mental health of LLM users. Chatbot psychosis is real. People who routinely use LLMs to do things provably become worse at doing them without them. Students use LLMs to make an end run around having to learn everything they need to know to be effective members of a society, like how to articulate their points, how not to fall for rhetorical traps, what history was really like, and between that and the disastrous effects of No Child Left Behind, teachers are quitting in droves and there’s a literacy crisis.


  • The author of that article admits that the sample size is not large enough to draw meaningful conclusions.

    But besides that, I believe LLM code generators can be a useful tool, provided you are willing to go over their output with a fine-tooth comb and assume it is broken until you have proven otherwise, because the hallucination problem is inherent to the technology and they’re never going to completely solve it, and are willing to overlook the myriad ethical issues with all major LLMs in existence today.





  • I’ve been a programmer for two thirds of my life up to this point. I don’t see how the machine that generates code that must be assumed to be broken, and statements about said code that must be assumed to be wrong, until both have been manually verified, because the “hallucination” issue is inherent to the design of LLMs and cannot be solved, is supposed to make my life easier. Especially since a well known problem in computer science is that writing code is more fun than reading it.

    If you’re using AI for code generation, I hope you like reading code.

    If you’re using AI to learn your way around an existing codebase, I hope you’re prepared to fact check everything it tells you.

    If you’re using AI for code review before merging a PR, fucking yikes. What made you think the sycophant machine that once told users a soggy cereal bar was a great business opportunity and cannot even transcribe McDonald’s orders correctly was suitable for that purpose?

    If you’re telling yourself it’s okay because there’s a human in the loop, please read some studies about attention fatigue and consider that increasing the number of critical decisions a person must make per day, while giving them a suggested answer that’s right 90% of the time and catastrophically wrong the remaining 10%, and the only way to tell the difference is to read in depth, might not have the desired effect. Especially if the human in question is then put under time pressure.

    And all that is before I go on a five paragraph rant about the ethical transgressions of every major AI company.

    It’s pretty black and white for me.











  • I think they addressed that point pretty clearly. The author says that just because the user experience of sticking your hand into your kitchen and instantly receiving food is fantastic, doesn’t mean that letting someone you don’t know live in your kitchen and only eating what they decide to make you is a good solution, especially since it means you couldn’t use your kitchen (which I believe is a metaphor for your smartphone) for anything else even if you wanted to. Further, those who believe it’s a good solution because it is free and its user experience is good only believe this because they have never known anything else. The author also explicitly states

    So that’s the dialectic here. I want people to not have to know about tech stuff. I’m not into the tech-for-tech’s-sake lifestyle. I want it to be easy to use. You just tell the computer what you want and it happens, no need to point and click, let alone configure and make. That’d be great. And hackers and modders could add features and share them and everyone would benefit.

    But it’s got to be free, free for reals. Open source, and either decentralized or democratically governed.

    The author, I think, is saying that while user experience is a nice goal to pursue, it means nothing if it isn’t open source, and you can’t go around the carefully-crafted VC-funded fancy-but-restrictive UX if you have the skills to do so. Perhaps it is a reach to say that the author prioritizes open source over good user experience, but I don’t think so, and even from the most pessimistic reading of those two paragraphs the author views them as at least equal.

    you quoted but reworded (why?).

    I quoted and reworded it because I was on mobile and couldn’t copy paste from your comment without a lot of hassle, and didn’t want to retype everything you had typed word for word. Didn’t mean anything by it.


  • I… these are all good points, but… did we read the same article?

    Article seems to ignore that FOSS projects tend not to have the budget to create the UX that VC-funded projects can. … I find prioritizing UX over sharing of source code to be misguided.

    The author specifically calls attention to this exact point:

    If a weirdo guy moved into your kitchen and blocked you from grabbing a spoon whenever you wanted and instead rented them out to you provided you only ate the gruel he provided, the people who would be most able to see the absurdity in that would be be the people who remember what it was like before. Those who grew up with that system would be “whaddayamean? This is super convienient. I just stick my hand in the kitchen and a spoonful of gruel is shoved into it. Like it, love it, want more of it”. They’d be like “people who don’t have a spoon guy are so gross and so dumb. What the heck are they even? Doing rifling through their own cutlery drawer like some sorta eggheads”.


  • Of course they can. Dictionaries are not the Bible. They exist to describe how words are used, not how they should be used. Words’ meaning changes over time (“gay” meant “happy” in the 20th century, to use the tired example) and new words get added to the dictionary every day (most dictionary websites have little blurbs showing words they’ve recently added). Dictionaries have historically, and continue to, change in response to how people use words, not the other way around. If your entire argument rests on the dictionary definition of the word “protest” not explicitly mentioning that to be considered a protest, something must be disruptive, it’s not a very good argument.

    It also fails to consider that methods of convincing people who would rather simply ignore the issue to care about it that are not disruptive are few and far between.