Contents

This post was translated from the Chinese original by AI.

According to Karen Hao’s Empire of AI, in 2019 Microsoft was weighing whether to invest in OpenAI. Nadella, Scott, and other Microsoft executives had already agreed to an initial investment, but Bill Gates objected.

Gates had only a passing interest in Dota 2 or robots. What he wanted was an AI model that could digest books, grasp scientific concepts, and answer questions based on the material, to assist scientific research. At the time, OpenAI had only one project that barely fit the bill: GPT-2.

In April 2019, researchers flew to Seattle to give Gates a demonstration of a higher-performance GPT-2, which they called the “Gates Demo.” By the end of it, Gates was genuinely impressed — enough to keep the deal moving forward.

As part of the investment, Microsoft would provide OpenAI with a new supercomputer equipped with 10,000 Nvidia V100 chips.

At the time of the Gates Demo, OpenAI had already done some scaling on GPT-2, but Amodei had no interest in such modest scaling. If the goal was to buy the company more of a head start, GPT-3 had to be as large as possible.

In Amodei’s eyes, a larger language model was a necessary precondition for AI safety research, while Altman saw its potential to deliver on OpenAI’s promises to Microsoft. The two came to be seen as standard-bearers for effective altruism and effective accelerationism, respectively, and this partly seeded the split between them.

GPT-4 would later have a Gates Demo moment of its own, but by then Gates had already left Microsoft’s board, and his stake was less than 1%, while Jensen Huang currently holds 3.58% of Nvidia. Gates, however, still holds the title of technical advisor to the CEO.

The reason Gates left the board was an extramarital affair with an employee. The matter was never made public at the time; it only went to the board. At the end of 2019, the board hired a law firm to investigate, and before the investigation was finished, he resigned. Staying on might have exposed the company to legal risk. The affair only came to light in 2021.

GPT-4’s Gates Demo moment came in 2022.

In June 2022, after seeing a demo of GPT-4, Gates was disappointed by how much it had improved over GPT-2. For all its gains in scale and fluency, he still thought it was an “idiot savant” incapable of solving complex scientific problems. He told the team he would only start taking it seriously once GPT-4 could score a perfect 5 on the Advanced Placement Biology exam — AP Biology, that is. He chose AP Biology because he felt the exam tests critical scientific thinking rather than rote memorization.

“I thought, well, that buys me three years to work on AIDS and malaria,” Gates said on a podcast.

Brockman immediately contacted Khan Academy CEO Sal Khan and asked him to put the company’s vast AP Biology question bank to work as training data.

Khan was skeptical at first, but eventually agreed — on the condition that Khan Academy would get access to GPT-4.

In September, OpenAI demonstrated the optimized GPT-4 to Gates. It answered 59 of the 60 multiple-choice questions on the AP Biology exam correctly and gave high-quality answers to six open-ended questions. Outside experts gave the paper a perfect score of 5.

Gates was incredulous. His shock and praise were relayed on the spot by the demo team to others at OpenAI, spreading like wildfire through the office and setting off a surge of excitement. Gates said the demonstration was one of the two most astonishing demos he had seen in his life.

Over the following months, Nadella would launch Microsoft’s third round of investment in OpenAI and continue to enjoy exclusive access to OpenAI’s model weights so they could be integrated into Microsoft’s own products. That was the $10 billion investment announced in January 2023.

I wonder whether Jensen Huang will one day command a similar position at Nvidia: not in management, not on the board, yet management and the board alike must respect his opinion before any major decision can move forward.

Empire of AI really is a treasure trove; I compiled the history of both Gates demos above from the book. Much of what is happening now can be traced back to clues in it — and that is far from the only example.

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Contents