Your Crypto Mining Chips Are No Good for AI—Here’s Why

The profitable world of proof-of-work altcoin mining was a spectacle to behold, rewarding miners with staggering earnings… till Ethereum took a detour in direction of proof of stake. However an rising trade is grabbing the eye of those that discovered themselves with tons of of idle graphics playing cards after the merge: AI.

This newfound tech darling, spurred by the inception of ChatGPT, requires the computation of huge portions of knowledge, akin to Ethereum mining, and one of the best ways to do such heavy lifting is with GPUs—a number of them.

Nevertheless, this may not be the panacea many had hoped for as a result of GPUs, the trusty workhorses of cryptocurrency mining, aren’t precisely the MVPs within the AI coaching area. Why? Let’s distill this advanced difficulty to its essence.

A story of two wants

This is the crux: Crypto mining and AI coaching have divergent appetites for his or her good GPUs. It is like relationship two individuals with wildly totally different tastes. Proof-of-work cryptocurrencies have a factor for playing cards with tons of hash energy, however could not care much less about vRAM (Video Random Entry Reminiscence). In distinction, AI is a sucker for playing cards with ample vRAM and offers a chilly shoulder to hash energy.

Image hash energy because the muscle of the operation—it is all in regards to the variety of computations your GPU can crunch per second. The upper the hash charge, the higher your odds of unlocking that elusive block and basking within the crypto fortune. It is like a velocity relationship situation: the extra individuals you meet (calculations you make), the upper your probabilities of discovering a match (mining a block).

Conversely, vRAM is the capability for dealing with and storing huge volumes of knowledge concurrently. It is the distinction between juggling two balls or twenty. AI coaching is a infamous information glutton, demanding GPUs to deal with and course of colossal quantities of knowledge concurrently. Utilizing the relationship instance, going the vRAM route could be like inviting a crowd right into a room and posing the identical questions (information factors) concurrently to search out the right match (AI mannequin).

And right here lies the paradox. Your buff, hash-power-loving GPU, good for mining Ethereum, is left gasping on the subject of coaching AI. It is like asking a world-class sprinter to compete in a marathon—it is simply not their recreation.

An excellent backup plan?

Now, setting oversimplifications apart, crypto mining does certainly require excessive hash energy, however it would not totally sideline vRAM. Crypto mining makes use of vRAM as a part of its mining algorithm, although the vRAM necessities are sometimes decrease in comparison with these wanted for AI coaching. For example, a reliable GPU for crypto mining would possibly sport 4GB of vRAM, which is unsuitable to even run (not even take into consideration practice) an AI picture generator like Steady Diffusion correctly.

To place issues in context, the most effective GPUs for ETH mining was the Nvidia RTX 3060Ti with 60MH/s of hashpower and 8GB of vRAM. In distinction, OpenAI used Nvidia’s A100 and V100 fashions: A V100 comes with 32GB of vRAM and the A100 fashions deal with as much as 80GB.

However this does not suggest that GPUs used for crypto mining are totally redundant for AI coaching. GPUs with comparatively decrease vRAM can nonetheless be employed for coaching smaller AI fashions or duties that do not require vital vRAM.

“There are a lot of AI operations and fashions that perform rapidly and effectively on legacy playing cards,” Scott Norris, CEO and founding father of Optiminer, advised Decrypt, including that entrepreneurs must correctly research which AI utility they concentrate on. GPUs used for crypto mining can work in “AI farms with both customized fashions or barely adjusted fashions,” he stated.

Norris talked about that some crypto mining corporations have already made the swap to AI operations. Omega AI is one instance. Hive Blockchain and Hut8 Mining are additionally testing their luck.

So, whereas this resolution is probably not as profitable as your good, previous crypto mining, it may function a viable “plan C”—in case your “plan B” of mining alternate proof-of-work altcoins appears bleak.

Taken with studying extra about AI? Try our newest Decrypt U course, “Getting Began with AI.” It covers every thing from the historical past of AI to machine studying, ChatGPT, ChainGPT, and extra. Discover out extra right here.