• 58 Posts
  • 1.04K Comments
Joined 2 years ago
cake
Cake day: December 31st, 2023

help-circle







  • I’m surprised that you’re talking about models being CUDA-specific or AMD-specific. I’ve had a bunch of models running on my amd-only pc, using ollama, lemonade, and lm-studio, through either rocm or vulkan. None of these models were billed as AMD-specific. I had to do some config tweaking for ollama to use my graphics card but that’s more because I have a weird in-between-generations card that also predates the LLM hype (6700XT).

    However, I did generally need to look for the GGUF format versions of things - usually accounts like unsloth have them uploaded on huggingface barely a day or two after the original version gets posted.



  • JayjadertoForum LibreAppel aux lemmys toulousains !
    link
    fedilink
    Français
    arrow-up
    1
    ·
    7 days ago

    Salut! Je suis de retour sur Toulouse (enfin, réseau Tisséo) depuis un an environ après ~5 années à Bordeaux, et j’aimerai aussi me faire des potes. Art et sciences font super mélange 😀 je suis un peu beaucoup en déplacement hors de la région ce mois-ci mais si tu veux, je te fais signe quand je suis de retour et on essaie de se capter?







  • I would envision something like “receipts” for federation and blocking.

    From my understanding, activity stream objects (ie posts, comments) are cryptographically signed by their emitting instance. This means ban-worthy comments and defederation-prompting behaviour can be exhibited and “proven”, in a sense, not to have been falsified. In turn we could cultivate an expectation that blocklists provide receipts. Currently, many that I see are just a list instance domains or usernames, without no concrete examples of what they did to merit their bans. This has led to a certain amount of concern-trolling imo, and I’ve seen accusations and counter-accusations of racism and queer phobia between fedi instances and their admins that should (again, imo) be capable of finding common ground yet no one ever shows the offending material or behavior, they just describe it as warranting the blocklist.

    The instance my mastodon account is based on, for example, defeds with fosstodon, and I can’t help but feel that a certain number of people I see on that instance would migrate elsewhere if they were aware of the current state of things, yet I myself can only parrot the vague accusations of bigotry given by my instance’s admins - all to easy for them to not “see the problem” in their day-to-day if they’re instance’s admins are remotely competent. I’m reminded of an article that came out like a week or two after charlie kirk’s death reflecting on how the author’s neighbor was blissfully unaware of all the awful things that man had said and done, and viewed him as a “family man”, because of how their social media experience had curated that exposure of him for her.

    Rumours and hearsay are not a good foundation for exclusion, and if there’s no transparency in delegation of exclusion, then we won’t make meaningful differences compared to centralized, authoritarian, private social networks.





  • There will be no demand for software for a while, as we did not need much in the first place.

    I don’t think software is like some raw resource that can be accumulated and then consumed at a later date. In my own career as a dev, people are constantly coming up with new demands that have to be implemented to meet their needs.

    I do agree that a lot of software made in the past 20 years was primarily made because someone (often not the devs making it) thought it would make them rich(er) in some way instead of actually “benefitting” humanity. My own hope is that however the economics of LLM-based AI work out, we’ll see a decline in this specific sort of software development taking up so much of the pool of available developer effort.

    If companies are spending more on tokens than on developers to churn out software that is decidedly meh (which is all I’ve seen so far of the trend), I would expect the actually induces demand for human developers - either as a complement to “AI” or as competition to it.