I expect so as well, and China also has a lot of incentive to invest in alternative substrates since they’re behind on silicon. If one of these moonshot projects they’re pursuing delivers that would make current silicon chips look like vacuum tubes by comparison.
There are a few different tracks here. One is software optimizations where models require less energy to use. That’s been moving really fast over the past few years, and there are still a lot of papers that haven’t been integrated into production systems that are really promising.
Another track is hardware architecture where the substrate stays the same, but chip design improves. A general example of this is SoC architecture like M series from Apple of Kirin 9000 from Huawei. The architecture eliminates the memory bus which is one of the main bottlenecks, and RISC instruction set facilitates parallelism much better than SISC. A more specific example would be ASIC chips like what Taalas is making which print the model directly on the chip.
And the last track is the one you mention with using a more efficient substrate. Notably this will directly benefit from the other two tracks as well. Whatever software and hardware architecture improvements people come up with, will directly apply to chips made out of graphene or other materials.
I expect that software will continue to get optimized, and we’ll see new algorithms that are more efficient than what people are doing currently. However, it’s possible we’ll start seeing hardware specifically built for models as well. For example, there’s already a startup that uses ASIC chips to print the model directly to the chip. Since each transistor acts as a state, it doesn’t need DRAM and the whole chip requires a small amount of SRAM which isn’t in short supply right now https://www.anuragk.com/blog/posts/Taalas.html
The limitation with this approach is that the chip is made for a specific model, but that’s not really that different from the way regular chips work either. You buy a chip and if it does what you need, it keeps working. When new models come out, new chips get printed, and if you need the new capabilities then you upgrade.
You can see how absurdly fast their hardware version of llama 3 is here https://chatjimmy.ai/
I think by the time AI becomes efficient enough to be profitable, it’s going to be efficient enough to run locally and the whole AI as a service business model is going to collapse. We’re basically in the mainframe era of AI right now, and we’ve seen this happen with many technologies before. There’s no reason to think this case will be different.
Just to give you an idea of how fast this stuff is moving. Qwen 3.6 was just released and can be run on a high end laptop, it outperforms Qwen 3.5 from February which required a commercial grade server to run. https://qwen.ai/blog?id=qwen3.6-27b
as a percentage of land
western propaganda isn’t exactly subtle nowadays
Basically, China is strengthening ties with their neighbours here. It also suggests that China isn’t really worried about oil shortages going forward. So, if the US was trying to use the war on Iran as an attack against China’s energy supplies, looks like that turned out to be a massive miscalculation.
Exactly, and people are already doing this stuff incidentally https://github.com/albertan017/LLM4Decompile
Yeah, and nothing wrong with that if it’s the sort of thing you enjoy doing.
Same here, having watched how the lives of my friends who had kids changed reaffirmed the decision of not having any for me. You basically have to be prepared to dedicate next couple of decades of our life to raising kids and not doing much of anything else. And you end up giving up the freedom to do things like move to a different town or try a new career. Your primary goal in life becomes having stable income to raise your kids.
lmao imagine thinking that being a racist sack of shit is sensible
The US is very obviously going to be impacted when the economies of their vassals start crashing because the US economy is highly dependent on trade. Furthermore, everybody knows this was an unprovoked war of aggression by the US, and that’s already souring relations between the US and the rest of the world.
Welcome to another market manipulation Friday
turns out fascists aren’t very good at logistics
Yes? We’re in agreement here. The neighbors are happy to get their oil at a discount. They would not be getting this discount were it not for the sanctions, since there would be more competition in the buyer’s market.
You’ve never seen a company offer a discount price initially to get people to sign up? This is the same approach. Once trade relations are established, and these countries build up infrastructure around buying Russian energy, Russia will start raising prices. The key part is that it’s already more profitable for Russia than selling pipeline gas to Europe on fixed contracts ever was.
If Russian leadership was under the illusion that NATO was secretly an offensive alliance, and thus needed to preemptively invade Ukraine, it should be clear with this Hormuz straight business that it really is a defensive alliance. Trump tried to get the NATO members to help and they all told him to pound sand.
NATO has literally been invading one country after another ever since Yugoslavia. One has to lack even a shred of intellectual integrity to claim that it is s defensive alliance. The Hormuz business simply exposes the fact that even Europe isn’t imbecilic enough to follow the US into this debacle directly. However, NATO members are currently actively participating in the war by providing the US military bases to stage attacks on Iran. This is in fact direct proof that NATO is not a defensive alliance. Try to put at least a bit of effort into your trolling here.
They’re down year-over-year, with the biggest hit coming in the first year. The sanctions did what they could (forced Russia to offer big discounts) and now they’re stable in their effect.
They’re not down year over year in any meaningful sense. It’s pretty clear that they are in fact quite steady. What’s down is economic activity all across Europe with energy prices being three times that of US and six times higher compared to China. The European industry is no longer competitive on the global stage. Europe cutting itself from Russian energy was the equivalent of cutting off your own feet to spite your cobbler.
I mean, this is an argument fraught with “nuh-uh” and hand-waving on all sides. “Worth it” is very subjective, especially when the harm to both sides is relatively minor, in the grand scheme of things. Both sides have adjusted to the new reality.
LMFAO no it’s not. Every single economic indicator from Europe shows shrinking economic activity and growing inflation. There’s a reason there’s no major European leader polling above 20% right now.
The European oil sources are super diverse, there’s no need to make this a false East vs West thing. I’m literally just here to explain that Russia is selling oil at a discount because it has to, not because it wants to.
If by super diverse you mean that you buy Russian oil at a markup from Kazakhstan, India and Turkey then sure.
Additionally, it’s worth noting that public sector controls the commanding heights of the economy in China. While these are not run as cooperatives, the purpose of work is the key difference. The goal of a private corporation is to produce capital for the owners. Meanwhile, public enterprise exists to produce things the society needs. The workers in public enterprises are the primary beneficiaries of their labor. Additionally, the state owns the golden share in all major corporations, and thus makes final decisions on how they operate. So, even private sector in China exists on a tight leash. I can highly recommend this video from Ben Norton explaining how Chinese economy actually works for people who are interested.
vassals will vassal