“Imprecise” language models are smaller, speedier—and nearly as accurate
  • @MiaouEnglish
    2•23 days ago

    Multi bits models exist because thats how computers work, but there’s been a lot of work to use e.g. fixed point over floating for things like FPGAs, or with shorter integer types, and often results are more than good enough.