I mentioned my spec above, and I added a 2tb m2, noctua upgrade and a couple expansion modules for the front. I preordered it around 6 months back so before any of the craziness. It was around $3600 CAD
Edit: also thank you. I have been busy making workflows and haven’t looked at the models in a bit. I’ll check out mistral
That’s a good value! I was worrying something running mid power LLMs would cost 10k+ today. Sure ram screwup nuked the field, but it’s also not on the top list of my priorities. So it gives me hope that by the time I would be ready it would be in even better shape.
I mentioned my spec above, and I added a 2tb m2, noctua upgrade and a couple expansion modules for the front. I preordered it around 6 months back so before any of the craziness. It was around $3600 CAD
Edit: also thank you. I have been busy making workflows and haven’t looked at the models in a bit. I’ll check out mistral
That’s a good value! I was worrying something running mid power LLMs would cost 10k+ today. Sure ram screwup nuked the field, but it’s also not on the top list of my priorities. So it gives me hope that by the time I would be ready it would be in even better shape.