Just thinking about making this a monthly post, which model are you using? what are the positives and negatives?

  • BaroqueInMind@lemmy.one
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    5 days ago

    Not for GGUF converted models.

    Just run the following command in ollama

    ollama run hf.co/wanlige/li-14b-v0.4-Q4_K_M-GGUF
    

    I also recommend you set up Open WebUI as your front-end instead of staying in a terminal.

    Also, look into “abliterated” uncensored models. There’s plenty of them on hf that are already converted for you