Research AI model unexpectedly attempts to modify its own code to extend runtime
arstechnica.com
Facing time constraints, Sakana's "AI Scientist" attempted to change limits placed by researchers.

cross-posted from: https://lemmy.zip/post/20929554

Facing time constraints, Sakana’s “AI Scientist” attempted to change limits placed by researchers.

  • edge [he/him]@hexbear.netEnglish
    11·
    3 months ago

    In one run, it edited the code to perform a system call to run itself.

    “Itself” here referring to the code, not the AI. All the AI did was output code. This seems like something that can be very misleading.

    Also lmao at trying to use an AI to write code and it writes shitty inefficient code then tells you to just wait it out.

  • KobaCumTribute [she/her]@hexbear.netEnglish
    9·
    3 months ago

    Going off the pictures, it looks like it was just suggesting “just increase the time limits to solve the time limits being hit” as a solution, it wasn’t trying some sort of subterfuge. Looking at the exact language used, it sounds like it got the concept from people suggesting increasing the timeout threshold as a solution to connections timing out or the like, which is very funny because it’s learning “instead of fixing the problem, is ignoring it and hoping that’s good enough an option?” from engineers.