• [object Object]@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    17 hours ago

    LFM3 1.7B and omni are surprisingly usable.

    The official q8 quants are super fast but much much lower quality, so if you can go with the native bf16 weights.

    I want to try fine tuning the q8 though for specific tasks, it seems like you cod get a really good balance