NVIDIA had their earnings call yesterday for the quarter ending Dec'23. Markets were muted in anticipation. As expected, the S&P 500 rose by 2.5% on the back of a strong performance and pipeline.
The day after, NVIDIA stock rallied to all time high of $800. This gave the company a market cap of USD 2 Tn, surpassing Alphabet, Inc., and becoming the fourth largest listed company in the world by market value.
For perspective consider this - the single day gain of USD 277Bn was bigger than the largest listed company in India - the world's 4th biggest equity market, and by an estimate its market cap was now larger than the entire SENSEX of India.
Who knew? Perhaps not even Berkshire Hathaway. (See share holding pattern in the links below).
One of the simplest reasons for the meteoric rise of NVIDIA is, as Warren Buffet once famously said about resilient businesses, that NVIDIA provides a moat to the the software firms for their business of developing and productising AI and, specifically, GenAI.
Imagine a very, very large Excel sheet, where every cell is linked with other cells using some simple formula. That is, if you make a change in any one cell, the cascading effect will be seen across the entire grid where every cell would require a re-computation. Such a computation need not be intensive at a cell level, but the sheer quantity (ie the number of cells require re-computation concurrently) can be overwhelming even for the fastest of Intel CPUs.
AI model training and data retrieval is similar. It requires computation that is very concurrent in nature. A large Language Model (LLM) for a GenAI such as ChatGPT typically has billions of parameters, where change in each parameter can affect all other parameters.
Unprecedented resources are required for a task such as this. A large portion of those resources are GPUs - specialised computer chips designed to handle 'concurrent' calculation. NVIDIA is the current market leader in developing and supplying such GPUs to the resource hungry AI companies.
Apart from the availability of very large quality dataset and algorithm development itself, this resource intensive nature of developing and maintaining LLMs raises barriers of entry in the market. A very important force in the industry.
This is the moat.
Now, in May last year, an internal memo from Google leaked. It got famous by the meme- "We do not have a moat, and neither do OpenAI". The conversation of the memo centred around the resource availability of large dataset and the algorithm development at Google and OpenAI, and how Open Source models are catching up. "While our models still hold a slight edge in terms of quality, the gap is closing surprisingly quickly." lamented the memo.
So, when software doesn't hold as a moat, it has to default to hardware.
Therefore, NVIDIA.
But there is a problem.
This moat has a price-tag. (which moat doesn't? Well, those that do not, and are shrouded in casual ambiguity become your competitive advantage!)
It was perhaps this moat building that took Sam Altman to Saudi Arabia, and the rumours that followed about the trillion dollar investments towards chip development. True or not, the threat perception of proprietary GenAI such as ChatGPT and Gemini from the Open sourced and funded models such as Llama3 by Meta are high.
To cement its entrench position, NVIDIA is said to be in conversation with Alphabet, Amazon, Meta, Microsoft and OpenAI to build custom chips for their respective positions. It is not difficult to predict how this might play out. There can be only one Wintel-like alliance. Meta has announced an intent to purchase upto 350,000 NVIDIA H100 GPUs, taking the total stockpile to 600,000 GPUs. At a discounted rate of USD25,000 a piece, this is more than USD 15 Bn for the boxes alone.
As an analyst observed, "The people who made the most money in the Gold Rush of mid-1800s were the ones providing the tools to get the job done, and not those hunting for the precious metal. NVIDIA is effectively playing the same role today in this tech revolution."
Therefore, what the moat is guarding is an entirely separate issue.
In the next post we will look into the hype, the Concentration of power, the de-centralization and true democratisation of AI.
Did you read anything interesting this week on AI? Would love to know. Drop in a comment!
 |
| A GPU moat guarding the castle of shovel-makers during the Gold Rush of mid-1800s. |
References and Further reading:
- Yahoo Finance - NVDA - Holding pattern
- Nvidia’s market capitalisation is now bigger than the Sensex
- Leaked Google Memo Admits Defeat by Open Source AI
- Nvidia says generative AI is enabling a whole new industry
- Mark Zuckerberg’s new goal is creating artificial general intelligence
- Nvidia adds record $277 billion in stock market value
Comments
Post a Comment