DarkThoughts

Nazi central.

Wasn’t there some guy some years ago blasting at a stadium?

I’m not using Fedora, I’m using Bazzite, which is immutable based on SilverBlue. I use an Arch distrobox for this since I can’t really install anything directly into the system. The script is what I tried originally in a Fedora distrobox which did not work at all.

ggml_cuda_compute_forward: ADD failed
CUDA error: shared object initialization failed
  current device: 0, in function ggml_cuda_compute_forward at ggml/src/ggml-cuda.cu:2365
  err
ggml/src/ggml-cuda.cu:107: CUDA error

I didn’t do anything past using yay to install the AUR koboldcpp-hipblas package, and customtkinter, since the UI wouldn’t work otherwise. The koboldcpp-rocm page very specifically does not mention any other steps in the Arch section and the AUR page only mentions the UI issue.

Well, anything remotely raunchy gets a “I cannot participate in explicit content” default reply.

I am using the rocm install of koboldcpp but as said, the ROCm option errors out with a CUDA error for some reason.

I distrohopped so much after each previous distro eventually broke and me clearly not being smart enough to recover. I’m honestly kinda sick of it, even if the immutable nature also annoys the shit out of me.

My GPU is a 6650 XT, which should in principle work with ROCm.

Which model specifically are you recommending? Llama-3.1-8B-Lexi-Uncensored-V2-GGUF? Because the original meta-llama ones are censored to all hell and Huggingface is not particularly easy to navigate, on top of figuring out the right model size & quantization being extremely confusing.

I just can’t get ROCm / gpu generation to work on Bazzite, like at all. It seems completely cursed. I tried koboldcpp through a Fedora distrobox and it didn’t even show any hardware options. Tried through an Arch AUR package through distrobox and the ROCm option is there but ends with a CUDA error. lol The Vulkan option works but seems to still use the CPU more than the GPU and is consequently still kinda slow and I struggle to find a good model for my 8GB card. Fimbulvetr-10.7B-v1-Q5_K_M for example was still too slow to be practical.

Tried LM Studio directly in Bazzite and it also just uses the CPU. It also is very obtuse on how to connect to it with SillyTavern, as it asks for an API key? I managed it once in the past but I can’t remember how but it also ended up stopping generating anything after a few replies.

Krita’s diffusion also only runs on the CPU, which is abysmally slow, but I’m not sure if they expect Krita to be build directly on the system for ROCm support to work.

I’m not even trying to get SDXL or something to run at this point, since that seems to be still complicated enough even on a regular distro.

Are you impersonating GregoriusT?

Ah. I guess I’ll try to remember to check tomorrow then.

When’s the main event going to start?

I guess the kids and animals there are the only ones I really have any feelings of sympathies for at this point.

Depends on your definition of expiring. The taste can change but the high percentage of alcohol should make it still safe to consume.

This is not an easy answer because what you think of as hell and demons was not always this Christian image. If we think of other older religious beliefs, such as Hades and his underworld, then things look already a lot more positively, or at least rather neutral (depending on their planes). Cultures differed quite a bit on those things and Christianity basically gobbled up parts of them, munched them together and replaced them. During the height of Christianity in Europe of course it would have been complete blasphemy to display hell and demons as something other than evil and would’ve likely got you killed. With modern times and people becoming more socially liberated it becomes less and less of an issue to say or think those things. So I don’t think there’s a clear cut time based border on when this happened, but rather it happened gradually with us becoming more and more educated I suppose.

Whatever you’ll go for, I’d definitely prioritize something that also has an educational or creative value. Some good stimulus for the young brain.

I absolutely fucking hate this to be honest, because it’s the same outside of Russia. Just stop shoving me this garbage, broken chat bloatware into my face as the only way to contact developers / projects.

Removed by mod

Who’re “we”…?

7-9? No idea how to judge that scale if I’m being completely honest. I’m into a lot of shit fantasy wise at least, but there’s also a lot shit that is totally not for me too. I’m not sure if you can really scale all kinks onto an equal level with others anyway. There may be kinks on a lower ranking that I’d find gross or unpleasant.

RX 6650 XT. And no, all RDNA 2 cards support ROCm. I literally had it running on my previous distro. Was a pain to install with all its dependencies and building the tools properly, since you often had to specify the model, but it was doable. On Bazzite it just seems impossible for me.

Huh? ROCm is not working for me at all so far. I’ve tried to get it to work with Koboldcpp (which I have to build in a distrobox for it to even run, but then it only runs in software / cpu mode), tried LM Studio (which is easy to install, but again, no ROCm / gpu support detected), and I tried Krita’s diffusion implementation (again, only cpu working). This and the fact that I can’t get Mullvad to run are my biggest pet peeves so far.

Ironically, I decided to try it, despite my already existing skepticism beforehand, because TimeShift managed to break my post update broken system even further to the point where I couldn’t figure out if it is even salvageable (definitely not for me though). I can’t go back to Windows but I also still have not really found a good distro for me yet.