• @vivendi@programming.dev
    link
    fedilink
    English
    922 days ago

    Fuck ClosedAI

    I want everyone here to download an inference engine (use llama.cpp) and get on open source and open data AI RIGHT NOW!

    • @KeenFlame@feddit.nu
      link
      fedilink
      English
      321 days ago

      Open source is always one step ahead. But they don’t have the resources and brand hype so people assume oai is cutting edge still

      • @vivendi@programming.dev
        link
        fedilink
        English
        121 days ago

        First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both

        • @Valmond@lemmy.world
          link
          fedilink
          English
          121 days ago

          I love FOSS but I’m in the check out stage so at the moment the easiest is the best I guess.

          • @vivendi@programming.dev
            link
            fedilink
            English
            121 days ago

            download “LM Studio” and you can download models and run them through it

            I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes