[email protected]

Which model GPU and how much VRAM? 16GB RAM limits your options a bit but maybe LFM 2.5 24B-A2B

If not, Gemma 4 e4b or Ling 3.0 Tiny are about as small and fast as you can get while still being decently smart.

I just use llama.cpp with Zoo Code, the VSCode extension

join us [email protected]

https://piefed.social/comment/13343280

PieFed has the concept of silencing another instance. A silenced instance is not defederated from but their posts do not show in the Popular or All feeds and their communities are not shown during onboarding. Their communities can still be found in the communities list (if you unblock the instance first) and joined in the normal way. Once joined, posts in there show up in the Subscribed feed of the joiner as usual.

Since I added silencing functionality I feel like there’s almost no need for (more) defederation. I can offer protection to newbies who don’t yet know which places to avoid and they can explore the dark corners when they’re ready. It’s a low-drama way to put a bit of distance between groups that rub each other the wrong way.

Yeah default blocks or silencing or something like that

PieFed allows admins different levels of blocking instances, they can do defederation but there are levels softer than that

oh yea feddit blocks shitjustworks https://feddit.online/instance/sh.itjust.works/posts

maybe @[email protected] could ask their admins to convert the defederation to a “silenced” or whatever that feature is on PieFed

32GB RAM, RTX 2080 8GB VRAM, I use Tiel Coder 35b-a3b (it’s a fine tune of Qwen 3.6) with Zoo Code

I see the last activity was 2 months ago.

that means no one from your instance is subscribed, if you subscribe then you’ll get new posts

you can see that there are new posts here https://sh.itjust.works/c/localllama