• 0 Posts
  • 69 Comments
Joined 3 years ago
cake
Cake day: July 4th, 2023

help-circle
  • It’s interesting to me that nowhere in the article and really nowhere in the comments does anyone raise the question of why do the Faroe Islanders do these hunts in the first place?

    Obviously people living close to the sea have always gotten large portions of their diet from seafood, so are they actually preserving and eating all of the whale/dolphin meat they are harvesting?

    If so then it doesn’t seem to me like a question of should the hunt be banned, unless we also want to discuss banning all other forms of hunting and animal husbandry.
    It seems instead that we should be asking if they are doing it less humanely than other forms of hunting or animal husbandry, and if so what can be done to reduce the whales’ suffering?


  • It can vary a lot based on what qwen model you want to run, but generally the 27b dense or 35b MoE are currently the best balance between size and capability afaik.

    If you can run two 16GB cards you can pretty much max out the context on the 27b model, but a single card like the 3060 12gb could still work well on the 35b MoE model with the excess spilling into system memory.

    I saw in another comment you have cards from the 2010’s but if they don’t have at least 8gb I wouldn’t even bother


  • It’s hard to say what exactly your requirements are in terms of VRAM/RAM from what you described here, but as a general recommendation whether AMD or Intel, I’d stick with DDR4 generation hardware. DDR5 is extremely expensive, but any non-MoE model that spills into system memory will still be frustratingly slow.

    For GPU’s the best bang for your buck if you want Nvidia is probably the 3060 12GB, it has 360GB/s memory bandwidth and one or more of those is a very reasonable starting point for local AI.
    If you’re okay with AMD there are some really unique cards floating around, I recently picked up a V620 off ebay for $350, it’s an ex-datacenter card with 32GB GDDR6 @ 512GB/s bandwidth. It’s a bit of a power hog but in my early testing it was running Qwen coder 3 30B at like 100 tokens/sec.

    I run it on an ASUS X570 PRO board which is the cheapest AM4 board I could find with an optimal PCI-E setup: three x16 slots running 4.0x8, 4.0x8, 3.0x4. I have successfully tested it with the V620, a 9060XT, and a 3060 for 60 GB total VRAM, though the third x16 is only single slot so I had to borrow a pci extender cable to try it. I’ve found 48gb VRAM is plenty for me so I doubt I’ll actually run a third card unless I find a good deal on a single slot one.

    Kinda turned into a ramble but let me know if you got questions





  • First of all like the other commenter said make sure you have all the right Immich containers running, should be 4 to 5 depending on if you have a backup container.

    In the webpage, not the app, go to server settings first, in the machine learning section check that you have facial recognition turned on and a model selected, read through in case you want to change anything else about it.
    Then secondly go to job queue and try refreshing face detection and grouping.









  • This administration is built on the concept of gradually but continually pushing the boundaries of what’s legal. First it’s using federal troops to guard CBP as they violate constitutional rights, then it’s murdering unnamed persons in boats in the Caribbean. Next will be something just a little bit more illegal, and eventually there may come a day where there’s something as clear cut as opening up on a crowd of kids. But by then, how are a few troops supposed to prove that this is illegal while not speaking up about whatever they did last? Not to mention the longer this goes on the more they organize the command structure by loyalty over competence.

    I don’t think we can rely on waiting for a clear cut example like yours, people in power need to be pushing back now or it will be too late


  • Standalone cosmos installation is now recommended instead of the docker container. It’s technically still beta, but I’ve been running it since February and very happy with it. The dev has indicated updates will focus on the standalone installation going forward.

    I have found it’s made everything vastly easier for me - the marketplace, integrated reverse proxy and URL manager mean you can literally spin many services up with a single click. Yet it has sub-menus for docker env and compose data that allow you to dig deeper into how the containers work if you’re interested in it.

    https://cosmos-cloud.io/docs/index/ “Install Cosmos as a standalone service”



  • While I get leaning towards AMD products, I’ve been doing so as well, when I built my first server with a Ryzen 5 2400GE I have found that there just isn’t as much resources/support for enabling transcoding with the vega 11 in Jellyfin or Immich. Most Intel iGPU’s have a hardware chip specifically tuned for transcoding called quicksync that you should strongly consider.

    Especially in the $100-200 price range tiny mini micro’s from HP/Lenovo/Dell are widely available and offer lots of capability in a power-efficient (~10-15w idle, 40-50w full load) and easily maintainable form factor. The Lenovo’s in particular are interesting due to a few models having full pci-e slots if you decide later you want a GPU.
    Lenovo pci-e

    Finally for software I would suggest looking into Cosmos Cloud, I use it and have found it made it so much easier to setup and manage all my docker containers and domain name/reverse proxy settings.