I have experience in running servers, but I would like to know if it’s possible to do it, I just need a GPT 3.5 like private LLM running.

  • exu@feditown.com
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 months ago

    I don’t know of any project that already supports that AI processor. You’d still be using the CPU and GPU at the moment.