• 0 Posts
  • 45 Comments
Joined 2 years ago
cake
Cake day: July 4th, 2023

help-circle


  • I’m actually right there with you, I have a 3060 12gb and tbh I think it’s the absolute most cost effective GPU option for home use right now. You can run 14B models at a very reasonable pace.
    Doubling or tripling the cost and power draw just to get 16-24gb doesn’t seem worth it to me. If you really want an AI-optimized box I think something with the new Ryzen Max chips would be the way to go - like an ASUS ROG Z-Flow, Framework Desktop or the GMKtek option whatever it’s called. Apple’s new Mac Minis are also great options. Both Ryzen Max and Apple make use of shared CPU/GPU memory so you can go up 96GB+ at much much lower power draws.




  • SSO is single sign on, so you don’t need individual username and password for every service. It’s a bit more advanced so don’t worry about it until you have what you want working properly for a while.

    DNS is like the yellow pages of the internet - when you type www.google.com your computer uses a DNS server to look up what actual IP address corresponds to the website name. The point of Adguard or pihole is that when a website tries to load an ad your custom DNS server just says it doesn’t recognize the address















  • My first time I started winging it with a raspberry pi, docker, and nginx and it took me like 2 months to get one service up and running and I didn’t feel it was very secure - fail2ban didn’t work, geoblocking didn’t work, and updates were manual.

    When I re-started from scratch with an x86 device and cosmos it has been shockingly easy in comparison. Not only is it much quicker to spool the service up (app store), they can be automatically updated, the proxy has options for geoblocking, rate limiting, etc.

    I’ve even got some of the services below built from a custom compose file instead of the app store, some use remote storage and some are set up with OAuth SSO. There’s still mild troubleshooting for a lot of things but it’s been much easier for me to understand and fix issues, plus there’s an active discord community as well.