Microsoft

Microsoft’s Nadella Is Building an AI Empire. OpenAI Was Just the First Step.

Author: Editors Desk, Tom Dotan and Berber Jin Source: WSJ:
June 13, 2024 at 06:24
Satya Nadella at the Microsoft Build conference in Seattle last month. JASON REDMOND/AGENCE FRANCE-PRESSE/GETTY IMAGES
Satya Nadella at the Microsoft Build conference in Seattle last month. JASON REDMOND/AGENCE FRANCE-PRESSE/GETTY IMAGES
After landing the deal that launched his company to the front of the artificial-intelligence race, the tech chief is spreading his bets. Will it be enough?

Chief Executive Satya Nadella bet the future of Microsoft MSFT 1.94%increase; green up pointing triangle on the potential of artificial intelligence when he forged a groundbreaking partnership with OpenAI, the creator of ChatGPT. 

But Nadella is not content to simply rely on OpenAI to dominate in this new era. In recent months, he’s been spreading his bets, turning the world’s biggest company into the world’s most aggressive amasser of AI talent, tools and technology. He has hunted down new partners around the globe and invested in a range of AI startups, including pouring $1.5 billion into an Abu Dhabi-based firm in April.

Nadella has also begun building what amounts to an in-house OpenAI competitor inside Microsoft—potentially putting it on a collision course with its most important partner. 

To lead Microsoft’s AI efforts, he recruited Mustafa Suleyman, a longtime rival of OpenAI’s co-founder, Sam Altman. Suleyman, who helped launch DeepMind, a pioneering AI research firm, and went on to co-found Inflection AI, an AI startup, has brought most of his team from Inflection with him to Microsoft. 

 

When Sam Altman co-founded OpenAI in 2015, the AI industry was niche. Here’s how he built the company into an $86 billion giant, off the back of Chat-GPT and splashy new products like Sora and GPT-4o. Photo: Jason Redmond/AFP

 

The new employees have led the process to train their own artificial-intelligence model, built on technology developed at Inflection and designed to be on par with the OpenAI technology Microsoft depends on today. A person familiar with the matter said that some future Microsoft AI products could be switched from OpenAI technology to the model being developed by Suleyman’s team.

Nadella’s approach to AI is emblematic of his decade at the helm, during which he has repeatedly reinvented big parts of Microsoft, picking new partners and retooling the tech company. He has been able to spot when one-time company strengths became vulnerabilities and upend even his own strategies.

Nadella’s moves have helped Microsoft leapfrog others—most notably the longtime AI front-runner Google—to release AI chatbots and workplace tools expected to change how people think and work. The question is whether these tactics will be enough to keep Microsoft ahead of the pack in artificial intelligence. 

Google has dramatically overhauled its AI organization and put out products that rival those made by the OpenAI-Microsoft consortium, including an AI feature atop its dominant search engineMeta Platforms has been investing billions into a powerful AI language model, Llama, that it is releasing for free under an open source license. Amazon has invested $4 billion in Anthropic, which it hosts on the largest cloud computing platform in the world.

This week, Apple announced it was integrating OpenAI’s tech into its mobile operating system, further shaking up the competitive landscape for AI dominance.

 

 

A deconstructed Microsoft Surface Laptop on display following a showcase of the company’s AI assistant Copilot at Microsoft headquarters in Redmond, Wash., last month. PHOTO: LINDSEY WASSON/ASSOCIATED PRESS
A deconstructed Microsoft Surface Laptop on display following a showcase of the company’s AI assistant Copilot at Microsoft headquarters in Redmond, Wash., last month. PHOTO: LINDSEY WASSON/ASSOCIATED PRESS

 

Microsoft’s rising status has made it a target for regulators and competitors. Regulators are investigating its acquisitions and investments, worried it may already have too much control of the emerging AI market. The Federal Trade Commission recently launched an investigation into whether Microsoft’s Inflection deal was structured to avoid government antitrust review. That came on top of another FTC probe launched in January of other artificial-intelligence deals, including Microsoft’s relationship with OpenAI. Companies including the New York Times are suing Microsoft and OpenAI, alleging that they illegally trained their software on the media companies’ content. 

And despite a soaring stock price, company morale has struggled as outsiders have been brought in to reshape aspects of its technology. 

Mikhail Parakhin, the previous head of Microsoft’s Bing and advertising businesses, plans to leave the company after initially being assigned to report to Suleyman, according to people familiar with the matter. Saurabh Tiwary, who oversaw the team of AI engineers responsible for integrating OpenAI’s tech into Bing, has already left for Google.

Microsoft said its retention rates are high and that some bumpiness is to be expected when companies make organizational changes.

 

Culture changes

While he has been trying to make Microsoft move more like a startup, Nadella has been the ultimate company lifer. The 56-year-old from Hyderabad, India, worked his way up through its Bing search and cloud infrastructure businesses over the last 32 years.

He was a surprise pick as CEO, taking over after years under Steve Ballmer when the company seemed stuck. The company had grown bloated—expanding costly divisions like hardware and Xbox—and missed tech trends, such as the emergence of mobile phones. In the 14 years under Ballmer, Microsoft’s share price fell more than 30%. 

When Nadella took over in 2014, Microsoft was mired in infighting among siloed groups, current and former employees say. Projects were frequently divided across separate divisions with multiple leaders. Teams often didn’t communicate with each other and fought for company resources.

One meme swapped in emails among employees: a cartoon of three organizational charts at Microsoft pointing guns at each other. A “Reservoir Dogs”-style standoff had become a symbol of the company’s culture.

Another problem, current and former employees say: It was plagued by a “not-invented-here” syndrome, where executives regularly rejected outside ideas and products. 

Nadella pushed for more internal cooperation with fewer centers of power. He also embraced other tech giants more than any of his predecessors.

 

Nadella at a 2014 event in San Francisco, where he unveiled Microsoft Office software for Apple’s iPad and iPhone. PHOTO: DAVID PAUL MORRIS/BLOOMBERG
Nadella at a 2014 event in San Francisco, where he unveiled Microsoft Office software for Apple’s iPad and iPhone. PHOTO: DAVID PAUL MORRIS/BLOOMBERG

 

Among his first public appearances as CEO was a press briefing, where he took the stage to debut Microsoft Office for the iPad and iPhone. For years, the company had been dismissive of Apple’s mobile devices, preferring to build its own hardware than strike a partnership.

Nadella’s first few years on the job were marked by big acquisitions, including LinkedIn in 2016 for $26.2 billion and GitHub in 2018 for $7.5 billion. He would go on to do more than 300 deals worth over $170 billion in total. 

These acquisitions would not only expand Microsoft’s businesses—bringing them into new areas like professional social networks and coding collaboration—but would also infuse the company with new blood. 

LinkedIn co-founder Reid Hoffman joined Microsoft’s board of directors. LinkedIn’s head of engineering, Kevin Scott, was given the newly created role of chief technology officer

 

‘Years behind’

Scott fretted in a 2019 email to Nadella and then Chairman Bill Gates that the company’s AI infrastructure was far behind Google’s. And tools like Gmail autocomplete were getting “scarily good.”

“We are multiple years behind the competition,” Scott wrote.

Microsoft’s AI efforts had been spread among dozens of teams scattered across the company.  

The company also had trouble recruiting top AI talent, said one Microsoft executive. Promising candidates would admit they were meeting with Microsoft as practice before going to places they would rather work—usually Google. 

In 2018, Nadella met OpenAI’s Altman at the Allen & Co. conference in Sun Valley, Idaho. He was impressed with the startup’s AI and thought it could expose Microsoft to more sophisticated tools. OpenAI could also become a banner customer for Azure, Microsoft’s cloud computing platform.

 

OpenAI CEO Sam Altman at the company’s office in San Francisco in March. PHOTO: CLARA MOKRI FOR THE WALL STREET JOURNAL
OpenAI CEO Sam Altman at the company’s office in San Francisco in March. PHOTO: CLARA MOKRI FOR THE WALL STREET JOURNAL

 

When Microsoft invested $1 billion in OpenAI, it was a controversial move internally. Even Gates was initially skeptical that Microsoft needed to invest so much in an outside company when the company had its own AI. 

As part of the deal, OpenAI said it would exclusively use Microsoft’s Azure cloud and Microsoft promised to invest in the expensive chips needed to meet OpenAI’s voracious demand.

When Nadella saw an early demo of an AI-powered chatbot built into Microsoft’s Bing search engine—using OpenAI’s technology—he asked his team what they needed to make it a hit product.

Engineers told him that if millions of people were to use the chatbot, it would require every high-end chip the company had. That would mean taking the chips away from Microsoft’s many other projects and customers.     

“What if I could get them for you?” he asked.  

Microsoft started purchasing enormous amounts of the GPU chips used for AI and invested another $10 billion in OpenAI in 2023. 

 

Resource fights

The decision would ripple through Microsoft. Many divisions, including hardware, felt the pinch to their budgets. The hardware group’s leader, Panos Panay, decamped for Amazon to lead its Alexa division last fall. Rubén Caballero, the head of HoloLens, Microsoft’s augmented reality project, has also left.

In February 2023, Nadella debuted the new Bing with a splash and a promise that with AI, Microsoft could finally make Google “dance.” Microsoft integrated OpenAI’s technology into its entire lineup. It created AI assistants it calls Copilots that plug into its biggest software products including Word, Excel and PowerPoint. The pitch was that with simple language commands, people can use Copilots to quickly create sophisticated slide decks or legal contracts.

The wisdom of Nadella’s dependence on OpenAI came into doubt last fall after OpenAI’s board ousted Altman in a surprise coup. The move exposed the fragility of Microsoft’s position of dependence on a startup it didn’t control. 

 

 

Two women wearing HoloLens devices try out a Windows mixed reality immersive experience at the Microsoft Build 2017 developers conference. PHOTO: ELAINE THOMPSON/ASSOCIATED PRESS
Two women wearing HoloLens devices try out a Windows mixed reality immersive experience at the Microsoft Build 2017 developers conference. PHOTO: ELAINE THOMPSON/ASSOCIATED PRESS

 

Nadella ultimately helped outmaneuver OpenAI’s board by publicly offering to bring Altman and any departing OpenAI employees to Microsoft. Altman was reinstated and Microsoft was given a nonvoting seat on the board.

The wrangling also triggered regulators. Officials in Europe and the U.S. have begun investigating the relationship between Microsoft and OpenAI, looking into how much control the giant has over the startup. 

Microsoft has repeatedly stated that it has only a non-controlling stake in the revenue produced by OpenAI’s for-profit arm. 

News Corp, owner of The Wall Street Journal, has a content-licensing partnership with OpenAI. 

Altman’s image as a controversial celebrity CEO has ruffled feathers at Microsoft. Some employees are concerned that the media storm after actress Scarlett Johansson claimed that OpenAI surreptitiously created an AI voice modeled on her reflected poorly on their efforts to make AI a more trusted technology. 

 

New balance of power

Altman’s status as the most important figure determining Microsoft’s AI strategy is becoming less certain, thanks to the arrival of Suleyman and his team.

Suleyman was a co-founder of DeepMind, the trailblazing AI company that was bought by Google and became the engine of its artificial intelligence efforts. Altman, along with Elon Musk, launched OpenAI as a nonprofit in 2015 partly to ensure that the future of AI was not explored in secret and controlled by Google.

Suleyman left DeepMind to help start Inflection in 2022, joining forces with LinkedIn co-founder Hoffman, one of OpenAI’s earliest investors and a board member. Altman was frustrated that Hoffman had started a competitive venture, said people familiar with the matter. Hoffman resigned from OpenAI’s board not long after he started Inflection.

Inflection’s attempt to popularize its AI companion, named Pi, wasn’t catching on despite raising $1.3 billion. Microsoft was already a fan of the company—it had invested hundreds of millions into it—when Nadella decided to recruit Suleyman.  

Nadella spent more than a month discussing a potential move with Suleyman, who eventually agreed to come over with most of his team and was given the title of CEO of AI.

Microsoft insiders say the internal politics and the balance of power between the longtime rivals Suleyman and Altman have been confusing. The Inflection co-founder is set to be one of the main points of contact between Microsoft and OpenAI, said a person familiar with the matter.

Microsoft has announced that Suleyman’s Microsoft AI organization will be responsible for consumer-facing AI products like Copilots for Bing and Windows. Nadella has internally expressed frustration that Bing’s position as a distant second hasn’t improved as much as he’d hoped despite the AI upgrade, according to people familiar with the matter. Suleyman’s hiring is a gamble to fix that, they said.

 

Mustafa Suleyman at The Wall Street Journal’s WSJ Tech Live Conference in Laguna Beach, Calif., last fall. Suleyman has brought most of his team from Inflection with him to Microsoft. PHOTO: PATRICK T. FALLON/AGENCE FRANCE-PRESSE/GETTY IMAGES
Mustafa Suleyman at The Wall Street Journal’s WSJ Tech Live Conference in Laguna Beach, Calif., last fall. Suleyman has brought most of his team from Inflection with him to Microsoft.  PHOTO: PATRICK T. FALLON/AGENCE FRANCE-PRESSE/GETTY IMAGES

 

Nadella has given Suleyman’s team a large budget and wide latitude to operate. They have absorbed other AI teams. Some long-term Microsoft employees view the Inflection imports as a foreign body; these new employees communicate through Slack rather than the Microsoft-owned Teams tool.

Microsoft said that new and existing teams work together.

Even with Suleyman’s division ascendant, Microsoft has worked to quell speculation there is any friction with OpenAI. At Microsoft’s annual developer conference in May, Nadella stood beneath a giant slide saying, “Microsoft Loves OpenAI,” with the word “loves” represented by a blue heart. Altman was a special surprise guest.

All the change and pressure have weighed on employees. The sprint in particular to launch Copilot for Bing by its February deadline last year was grueling, according to people familiar with the matter. The ongoing push to put AI into more products has caused a sense of burnout from some employees on the project.

Still, Nadella isn’t slowing down. Microsoft’s shares have surged more than 10-fold under his watch, lifting it above Apple for much of this year to make it the largest company in the world by market value. One of his top priorities today is rebranding the Azure cloud as the go-to place for startups. 

He has told his office that whenever he visits a city, he will take meetings that help the company close deals with AI startups. As he has repeatedly emphasized to Microsoft’s employees in all-hands meetings over the last year, the goal is to use AI to vault past rivals Amazon and Google.

In November, Nadella also approved a program giving early-stage startups free access to some of Microsoft’s computing clusters, a strategy meant to win their allegiance in the event they become the next breakout success.

The company has signed deals to bring startups such as Cohere and French startup Mistral AI onto Azure. Both companies are developing large language models that compete with OpenAI. In April, Microsoft invested $1.5 billion in Abu Dhabi-based AI company G42, which will have the company run its software and services on Azure.

Arvind Jain, CEO of Glean, an enterprise AI company, has repeatedly met with Nadella during the Microsoft chief’s recent startup charm offensive. Jain, like many other founders, didn’t initially consider Microsoft a player in the startup game but today runs his AI assistant off Microsoft’s cloud.

“Microsoft makes the effort to connect and reach out,” Jain said. “When we started our team didn’t consider Azure as an option. AI changed that.”

 

An event last month at Microsoft headquarters. Nadella has begun building what amounts to an in-house OpenAI competitor inside Microsoft. PHOTO: CHONA KASINGER/BLOOMBERG NEWS
An event last month at Microsoft headquarters. Nadella has begun building what amounts to an in-house OpenAI competitor inside Microsoft. PHOTO: CHONA KASINGER/BLOOMBERG NEWS

 

Write to Tom Dotan at tom.dotan@wsj.com and Berber Jin at berber.jin@wsj.com

Keywords
You did not use the site, Click here to remain logged. Timeout: 60 second