• 7 Posts
  • 46 Comments
Joined 1 month ago
cake
Cake day: August 10th, 2026

help-circle




  • I think there is something more interesting going on in the Jacob Coxon story because it’s [the] phrase “everyone at anthropic believes that AI is an existential risk”… Every organization has to instill some kind of beliefs among its members in order to do the work it does, right? Everybody at Goldman Sachs believes the free market is great, capitalism is the best system, and that they are the wealth creators who deserve big bonuses. Everyone in the Mormon church believes they should all tithe 10% of their income, and that they each get a special planet when they die. And everyone who worked at Philip Morris in the 80s believed that cigarettes tasted great and did not cause any of that nasty cancer. There’s Upton Sinclair quote, “It’s difficult to get a man to understand something when his salary depends on his not understanding it.” Well, the opposite is also true. It’s guaranteed that someone will believe something if their salary depends on them believing it.

    Now, let’s just grant that all the people in these organizations definitely know things about finance and Mormonism and cigarettes and AI that you might not know because they are insiders and you are not. They have access to information and experiences that you do not have. And that might even make it a little bit difficult for you to win an argument with them. But arguing with their belief – trying to figure out whether or not its truth value is true or false – is not the only way to take a skeptical attitude towards it. We can also ask, what work is the belief doing for them. What does the thing that they believe allow the organization they’re a part of to do that it wouldn’t be able to do if the people in the organization didn’t believe that thing?

    And this started to become clearer to me when I started listening to the actual claims that Jacob Coxin was making because a lot of them don’t really add up.

    https://www.youtube.com/watch?v=pauBYSQ1K_c








  • There were more people that you’d expect who basically said the same thing about much of Linux (systemd) receiving age verification mechanics. To me, those arguments in favor of age verification seemed even louder because the change could be dismissed as “optional” and “open-source,” although the layman cannot easily drop or replace a computer operating system, and it would take significant political capital to change the source of systemd back to its pre-age-verification state.










  • verily@lemmy.dbzer0.comtoTechnology@lemmy.worldLLMs are real, "AI" is fake
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    7 days ago

    I don’t presume Anthropic is designing anything to be ethical. First, the chatbot is unpredictable by design. Randomness is built in. Second, if they didn’t intend for bad things to happen, why didn’t an employee babysit it?

    As the article said you can replace rogue agents with unpredictable computer programs if you really want, I don’t see the necessity.

    Speaking of goalpost shifts: “Rogue agent” is the clickbait title across multiple articles. Remember you said nobody was misrepresenting the AIs. The still-inaccurate clarification (the unsupervised chatbot functioned exactly as it was designed to function, and the script running it allowed it to execute exactly the commands Anthropic wanted) doesn’t help the article the clarification is from. It certainly doesn’t absolve every other author.