In 2017, DeepMind's next machine, named AlphaGo Zero, became a master Go player by playing millions of games against itself inside a simulation. It developed game strategies through practice rather than by observing human play. AlphaGo Zero now thrashes the original AlphaGo machine and is unassailable by all human grand masters.
Reinforcement learning isn't just used to play games. Researchers at Warsaw University used reinforcement learning to train bipedal robots to walk more efficiently. The AI that controls the robots varies the combinations of movements made by the robot's motors and experiments with different walking strategies. The robot's AI gains a small electronic reward for strategies that speed the overall efficiency and pace of the walk. With this approach, roboticists achieved more efficient and natural-looking walking motions for their robots. One robot learned to walk almost twice as fast as it could using the best initial walking strategy programmed by its human creator.
AI's ability to learn from experience is used to solve many business problems, including complex optimizations. AIs optimize traffic control systems, industrial chemical reactions, advertising bids, industrial automation, supply chain flow, product design, warehouse operations, inventory levels, yields, trading strategies, wind turbine controls, medication doses, smart grids, and commercial HVAC systems. Reinforcement learning also teaches AIs to drive. Like humans, AIs learn to drive by practicing. They drive real cars in real-world conditions but also drive millions of miles inside realistic software simulations. In part, Tesla AIs learn to drive from sensor data gathered while owners are driving.
Creating and Co-Creating Content
Computers now have the capacity for imagination. Artificial intelligence can compose music, paint pictures, and even write poetry. AI also co-creates content with humans: a partnership of digital intelligence with artists, designers, and engineers.
Most AIs create content using a relatively new AI approach known as Generative Adversarial Networks (GANs). The first GAN was built in 2014 by Ian Goodfellow, then a researcher at the Université de Montréal and now part of the Google Brain project. GANs link two AIs together in a sophisticated version of reinforcement learning where each AI trains the other. The AIs operate in an adversarial context: Each tries to catch the other out. Here's how it works. One AI is trained to create content and the other AI is trained to spot fake/generated content. Think of these AIs as a forger and an art detective. The detective, known as the discriminator AI, is initially trained with many real-world examples of “good” data (real content). The forger, known as a generator AI, tries to fool the discriminator by creating high-quality, realistic content. At first, the content created by the generator AI is terrible and the discriminator easily spots it as “fake.” But the generator steadily improves until eventually the discriminator finds it harder to spot generated content. Over time, each AI gets better at its assigned task. While the relationship between the AIs is adversarial, the net result is that the discriminator acts as a coach to the generator AI, and the generator acts as a coach for the discriminator. Eventually, the generator AI creates incredible, high-quality content: images, videos, speech, music, prose, legal contracts, and engineering designs. GANs have even been used to automate the design of crowns for teeth.
GANs have incredible potential. They will fundamentally change the way we work. Within the next decade, many of you reading this book may partner with GAN-based AIs to co-create content and collaborate on business tasks.
While there are some worrying downsides to generative AI—most notably deepfakes—many applications offer incredible potential. The most powerful example of machines with an imagination today is generative design, a field pioneered by engineering design company Autodesk . Generative design is used extensively in engineering and architectural design. We discuss these applications further in Chapters 14and 15. Generative design uses the imagination and content creation capabilities of GANs to generate hundreds or thousands of alternative design options from a single original design. Designers specify constraints—size, weight, cost, and so on—and the tool generates options and evaluates each one using simulation tools. The designer simply picks the option that best meets their needs—perhaps the one that's cheapest to make, easiest to manufacture, or has the lightest weight.
Generative AI will help to design lighter-weight aircraft, cars that are more resilient to crashes, and stronger, lighter robots. Generative architecture will improve the structural integrity and design of new buildings.
Researchers at the University of California, Berkeley, working in partnership with Glidewell Dental Lab, use GANs to design dental crowns. The AI uses digital x-rays of a patient's upper and lower jaw to design a crown that perfectly fills the gap in the patient's tooth line, optimizes bite contact, and looks aesthetically pleasing. Researchers claim that AI-generated crowns outperform those designed by humans. The approach should speed crown production, reduce costs, and free dentists to spend more time generating revenue by working in patients’ mouths, rather than designing crowns on a CAD machine in a back office.
Generative AI is an example of a broader category of AI that I refer to as “collaborative AI.” Collaborative AIs operate in partnership with humans in a creative process. Humanity's use of tools distinguishes us from most other species. Traditional tools are subordinate—we wield a hammer, drive a car, and program a computer. Collaborative AI changes our relationship with tools. They are no longer subordinate, they now co-create with us. Collaborative AIs aren't just tools, they're partners.
Collaborative AI will co-create visuals for presentations, advertisements, and marketing brochures. Collaborative email software will auto-compose responses. Collaborative management software will co-create plans for complex projects. Many job functions will benefit from collaborative AI in the coming years.
In a fast-moving field, new use categories, beyond the eight listed earlier, are bound to emerge. GANs, a technique that's central to several of these application categories, were invented relatively recently. As research embraces techniques beyond deep learning—cause and effect AI, common sense AI, capsules, and others—artificial intelligence will solve even more business problems than it can today.
AI is a big deal. Every leader should pay close attention. Every organization must understand how AI will shape product development, business operations, customer service, and workforce management.
You don't have to understand how AI works to use it. But such insight can help you to understand the capabilities and limitations of today's technology. While the following description is designed to be accessible to nontechnical types, feel free to skip to the next section if it gets too far into the weeds for you.
Neural Networks, Training, and Models
Neural networks underpin most of today's artificial intelligence. They operate quite differently from traditional digital computers. Traditional computers are glorified adding machines. Neural nets are organized more like the highly interconnected structures found in our brains.
Neural nets are made up of connected “nodes,” which act like neurons. Each node holds a numerical value. Unlike binary computers that work with zeros and ones, each node can have a range of values; the range depends on the application. Nodes are arranged into layers. The first layer is known as the input layer and the final layer is known as the output layer. All of the layers in between are known as hidden layers (see Figure 1.1).
Читать дальше