

It can vary a lot based on what qwen model you want to run, but generally the 27b dense or 35b MoE are currently the best balance between size and capability afaik.
If you can run two 16GB cards you can pretty much max out the context on the 27b model, but a single card like the 3060 12gb could still work well on the 35b MoE model with the excess spilling into system memory.
I saw in another comment you have cards from the 2010’s but if they don’t have at least 8gb I wouldn’t even bother






It’s interesting to me that nowhere in the article and really nowhere in the comments does anyone raise the question of why do the Faroe Islanders do these hunts in the first place?
Obviously people living close to the sea have always gotten large portions of their diet from seafood, so are they actually preserving and eating all of the whale/dolphin meat they are harvesting?
If so then it doesn’t seem to me like a question of should the hunt be banned, unless we also want to discuss banning all other forms of hunting and animal husbandry.
It seems instead that we should be asking if they are doing it less humanely than other forms of hunting or animal husbandry, and if so what can be done to reduce the whales’ suffering?