This Post Has 7 Comments

1. Thought-provoking
   The Coming Wave: Technology, Power, and the Twenty-first Century’s Greatest Dilemma by Mustafa Suleyman“Mustafa Suleyman” examines the future of Artificial Intelligence (AI): the good, the bad and the scary in realistic terms. Co-founder and CEO of Inflection AI and cofounder of DeepMind, Mustafa Suleyman takes the readers on a ride to the future of AI and its implications. This thought-provoking 500-page book includes fourteen chapters broken out by the following four parts: I. Homo Technologicus, II. The Next Wave, III. States of Failure, and IV. Through the Wave.Positives:1. Well-researched an insightful book. Suleyman has the expertise and experience to write such a book.2. Artificial Intelligence (AI) is a fascinating topic, specifically whether containment is possible.3. The book flows very well and it’s accessible. The reader is not expected to have expertise in the area to understand it.4. Clearly defines the key topic of the book, the wave. “So, what is a wave? Put simply, a wave is a set of technologies coming together around the same time, powered by one or several new general-purpose technologies with profound societal implications.”5. Goes over the history of technological waves. “One major study pegged the number of general-purpose technologies that have emerged over the entire span of human history at just twenty-four, naming inventions ranging from farming, the factory system, the development of materials like iron and bronze, through to printing presses, electricity, and of course the internet. There aren’t many of them, but they matter; it’s why in the popular imagination we still use terms like the Bronze Age and the Age of Sail.”6. Defines the most important topic in the book, containment. “Containment is the overarching ability to control, limit, and, if need be, close down technologies at any stage of their development or deployment.” “Technical containment refers to what happens in a lab or an R&D facility. In AI, for example, it means air gaps, sandboxes, simulations, off switches, hard built-in safety and security measures—protocols for verifying the safety or integrity or uncompromised nature of a system and taking it offline if needed.”7. The two technologies threatening to surpass our own intelligence. “The coming wave of technology is built primarily on two general-purpose technologies capable of operating at the grandest and most granular levels alike: artificial intelligence and synthetic biology.”8. Describes breakthroughs in AI. “The breakthrough moment took nearly half a century, finally arriving in 2012 in the form of a system called AlexNet. AlexNet was powered by the resurgence of an old technique that has now become fundamental to AI, one that has supercharged the field and was integral to us at DeepMind: deep learning.”9. Interesting observations and predictions. “In the words of an eminent computer scientist, “It seems totally obvious to me that of course all programs in the future will ultimately be written by AIs, with humans relegated to, at best, a supervisory role.”10. The often-used term Singularity defined. “Over the last decade, intellectual and political elites in tech circles became absorbed by the idea that a recursively self-improving AI would lead to an “intelligence explosion” known as the Singularity.”11. Examines synthetic biology. “Companies such as DNA Script are commercializing DNA printers that train and adapt enzymes to build de novo, or completely new, molecules. This capability has given rise to the new field of synthetic biology—the ability to read, edit, and now write the code of life.”12. Looks at other transformative technologies that are part of the wider wave. “Amazon’s “first fully autonomous mobile robot,” called Proteus, can buzz around warehouses in great fleets, picking up parcels. Equipped with “advanced safety, perception, and navigation technology,” it can do this comfortably alongside humans. Amazon’s Sparrow is the first that can “detect, select, and handle individual products in [its] inventory.””13. Describes the quest for quantum supremacy. “In 2019, Google announced that it had reached “quantum supremacy.” Researchers had built a quantum computer, one using the peculiar properties of the subatomic world.”14. Describes the four features that define the coming wave. “The coming wave is, however, characterized by a set of four intrinsic features compounding the problem of containment. First among them is the primary lesson of this section: hugely asymmetric impact. You don’t need to hit like with like, mass with mass; instead, new technologies create previously unthinkable vulnerabilities and pressure points against seemingly dominant powers.”15. Explores containment issues. “However, any discussion of containment has to acknowledge that if or when AGI-like technologies do emerge, they will present containment problems beyond anything else we’ve ever encountered. Humans dominate our environment because of our intelligence. A more intelligent entity could, it follows, dominate us.”16. The race for AI supremacy between China and the U.S. “China is already ahead of the United States in green energy, 5G, and AI and is on a trajectory to overtake it in quantum and biotech in the next few years. The Pentagon’s first chief software officer resigned in protest in 2021 because he was so dismayed by the situation. “We have no competing fighting chance against China in 15 to 20 years. Right now, it’s already a done deal; it is already over in my opinion,” he told the Financial Times.”17. Statements that resonate. “Science has to be converted into useful and desirable products for it to truly spread far and wide. Put simply: most technology is made to earn money.”18. Examines the implications of this coming wave and democracy. “A meta-analysis published in the journal Nature reviewed the results of nearly five hundred studies, concluding there is a clear correlation between growing use of digital media and rising distrust in politics, populist movements, hate, and polarization.”19. Cyber threats examined. “Today’s cyberattacks are not the real threat; they are the canary in the coal mine of a new age of vulnerability and instability, degrading the nation-state’s role as the sole arbiter of security.”20. The dangers of highest of high tech in the hands of a few. “This raises the prospect of totalitarianism to a new plane. It won’t happen everywhere, and not all at once. But if AI, biotech, quantum, robotics, and the rest of it are centralized in the hands of a repressive state, the resulting entity would be palpably different from any yet seen.”21. Describes varieties of catastrophe. “AI is both valuable and dangerous precisely because it’s an extension of our best and worst selves.”22. Describes keys to containment. “Deft regulation, balancing the need to make progress alongside sensible safety constraints, on national and supranational levels, spanning everything from tech giants and militaries to small university research groups and start-ups, tied up in a comprehensive, enforceable framework.”23. Defines the key problem of the twenty-first century. “The central problem for humanity in the twenty-first century is how we can nurture sufficient legitimate political power and wisdom, adequate technical mastery, and robust norms to constrain technologies to ensure they continue to do far more good than harm.”24. Lists the ten steps to containment. “There’s a clear must-do here: encourage, incentivize, and directly fund much more work in this area. It’s time for an Apollo program on AI safety and biosafety.”25. Notes and a link to the bibliography provided.Negatives:1. If you have watched Suleyman’s YouTube Videos there is very little new here.2. Emphasis of speculation over technical details. I wanted more details; if the purpose is to keep the book accessible such details can be included in an appendix.3. Redundancy.4. Lack visual supplementary material: charts, diagrams, and sketches to complement the narrative.5. Lacks a formal bibliography.In summary, this is an important topic a plea of sorts to global leadership and subject matter experts to watch this issue carefully and to take the proper precautions to contain the worst of AI’s potential. Suleyman makes clear that AI has potential for much good but also to catastrophe if humanity loses containment. The Coming Wave of AI and synthetic biology creates immense challenges for humanity, are we ready for it? An excellent, provocative book. I highly recommend it!Further suggestions: “Superintelligence” by Nick Bostrom, “The Age of AI” by Matt Ridley, “AGI: Age of Superintelligence” by Richard A. Mann,“The Singularity Is Near” and “How to Create a Mind” by Ray Kurzweil, “Our Final Invention” by James Barrat, “Surviving AI” by Calum, “ Chace, “When Computers Can Think” by Anthony Berglas, “What to Think About Machines That Think” edited by John Brockman, and “Rise of the Robots” by Martin Ford.

   Reply

2. [book review] The Coming Wave by Mustafa Suleyman
   I was apprehensive about the rapid pace of AI development and its potential societal impacts. While some concern remains, the book “The Coming Wave” by Mustafa Suleyman, co-founder of two major contemporary AI companies Google DeepMind and Inflection AI, offers a glimmer of hope.Suleyman predicts that “AI has been climbing the ladder of cognitive abilities for decades, and it now looks set to reach human-level performance across a very wide range of tasks within the next three years” (9). Published in 2023, this prognosis gives me pause as a college student. Will emerging technologies automate the white-collar jobs that leverage human cognitive skills?Suleyman’s unease extends beyond career disruption. He worries that swift improvements in technologies like robotics, quantum computing, nuclear fusion, and especially AI and synthetic biology will profoundly transform society.Historically, the proliferation of transformative innovations has become self-perpetuating. As Suleyman notes, “As demand soared, costs plummeted. One analysis estimates that the introduction of the printing press in the fifteenth century caused a 340-fold decrease in the price of a book, further driving adoption and yet more demand” (30).He observes this pattern recurrently, most recently with smartphones saturating the global consumer market in just a few years: “Now the number of computers, smartphones, and connected devices is estimated at 14 billion. It took smartphones a few years to go from niche product to utterly essential item for two-thirds of the planet” (33).The problem with new technology is that often the sweeping impacts of new technologies are unintended even by their creators. As Suleyman writes, “Gutenberg just wanted to make money printing Bibles. Yet his press catalyzed the Scientific Revolution and the Reformation, and so became the greatest threat to the Catholic Church since its establishment” (35).He continues: “What’s different about the coming wave is how quickly it is being embedded, how globally it spreads, how easily it can be componentized into swappable parts, and just how powerful and able all broad its applications could be” (112). While innovations like AI can be leveraged for social good, vulnerabilities remain for misuse and unintended consequences.What drives leading technologists and scientists to advance capabilities so rapidly, even when risks are apparent? Beyond financial incentives, Suleyman points to status-seeking and ego: “Scientists and technologists are all too human. They crave status, success, and a legacy. … AI scientists and engineers are among the best-paid people in the world, and yet what really gets them out of bed is the prospect of being first to a breakthrough or seeing their name on a landmark paper” (140).Reading this gave me pause for self-reflection. I’ve envisioned starting my own company primarily for financial success. However, if I’m honest with myself, ego also motivates my ambition – the desire for recognition, influence, and fame.This was a surprising personal insight. I had seen myself as independent and indifferent to others’ opinions. Yet I likely harbor an underlying craving for status, rooted in a childhood lacking leadership opportunities. I perhaps even envied the popularity of others then in unconscious ways.From an evolutionary view, it’s natural to seek elevated standing. Higher status can confer greater access to resources, furthering the core purpose of survival and reproduction. My own social programming probably tapped into these innate drives without conscious awareness. Suleyman’s book helped illuminate these hidden motivations.Back to the book, statistics on pandemic misinformation were striking: “Early in the COVID-19 pandemic a blizzard of disinformation had deadly consequences. A Carnegie Mellon study analyzed more than 200 million tweets discussing COVID-19 at the height of the first lockdown. Eighty-two percent of influential users advocating for “reopening America” were bots” (172).As a regular X (formerly Twitter) user, the notion that viral spread could be manufactured horrifies me. I could grasp Suleyman’s apprehension – deception scaled globally, programmed automatically by AI.So how can we prepare for The Coming Wave?Suleyman focuses more on societal precautions than personal guidance, at least that’s how I felt. Investing in leading tech firms seems prudent: “NVIDIA’s share price rose 1,000 percent in the five years after AlexNet” (130). “Those huge centralized coming-wave firms (Google, Apple, Amazon, etc) I just mentioned? They likely end up bigger, richer, and more entrenched than businesses in the past” (190).However, even experts make poor predictions sometimes: “Early in the decade IBM’s president, Thomas J. Watson, had allegedly (and notoriously) said, “I think there is a world market for about five computers” (32). “Only a few isolated researchers like Geoffrey Hinton and Yann LeCun kept them going through a period when the word “neural” was so controversial that researchers would deliberately remove it from their papers. It seemed impossible in the 1990s, but neural networks came to dominate AI. And yet it was also LeCun who said AlphaGo was impossible just days before it made its first big breakthrough. That’s no discredit to him; it just shows that no one can ever be sure of anything at the research frontier” (130).So Suleyman’s outlook may also prove inaccurate. Still, his book left me pensive yet grounded about the future.

   Reply

3. Os autores se esmeraram em proporcionar ao leitor uma análise realmente multifacetada do que realmente está por trás de tecnologias convergentes, onde, sem dúvida alguma a IA tem uma espécie de papel central, como indutor de ouras como as biotecnologias e computação quântica. Apesar do cenário meticulosamente construído de forma aterradora em dados momentos, considero essencial conhecer a grande sobreposição de ondas tecnoeconômicas (ao estilo Carlota Perez) que estão por erodir ainda mais, as fronteiras das nações, privacidade e democratização do acesso a tecnologias com potencial tão profundo. Não é um livro de tecnicalidades. Vale a pena, apesar de soar um pouco repetitivo no argumento global do livro e de poder ser percebido como um continuum do livro do fórum econômico mundial que toca no mesmo diapasão.

   Reply

4. Mustafa Suleyman tackles the questions swirling around powerful new technologies like AI head on. It’s a compelling read (I couldn’t put it down after I started). While it makes big claims it is always thorough about building the case and marshaling the evidence (there are nearly 30 pages of notes and references). The writing is rooted in his personal experience as an AI entrepreneur, and is both a wake-up call to the coming world and an in-depth analysis of what is happening right now. Highly recommended.

   Reply

5. very informative and detailed, gives a clear picture of the advantages but also of the perils of AI

   Reply

6. Aviso al lector desprevenido. Este es un gran libro, pero no es una novela. Es un libro lleno de información y pensamientos fundamentales sobre todo el desarrollo de Inteligencia Artificial, pero su lectura en ocasiones es ardua. Está bien escrito, informativo y con lenguaje comprensible. Tiene mucha información, explicada fácil. Muy buena explicación sobre cómo está evolucionando la tecnología, los problemas que se vienen por delante, la evolución previsible de AI, los peligros que trae y las posibilidades de control. Aunque está bien escrito, lo está en un lenguaje corporativo, lo que lo hace serio, pero no siempre atrapante.

   Reply

7. Mustafa Suleyman and Michael Bhaskar have written an excellent book, “The Coming Wave.” Unlike many authors who project unbridled optimism, the authors strike two notes simultaneously: one of inevitability and the other of caution and concern.They divided the book into four sections, which they call ‘Homo Technoligicus,’ ‘The Next Wave,’ ‘States of Failure,’ and ‘Through the Wave.’They devote the first section to explaining how waves of technological innovation have transformed humanity for thousands of years. Even the slightest pause will convince anyone of this truism. Since we fashioned stone tools centuries ago, humans have innovated, changing the world and society.The next wave will create changes at an exponential rate, a topic they discuss. When I was a child, we did not possess direct dialing telephones, and now the mobile phone often appears to extend our brains. They discuss artificial intelligence and its impact–now and in the future. A person growing up now will live a different life than we do today. When will machine intelligence overtake human intelligence? Most people cannot perform the most straightforward calculations and resort to a calculator. No one knows of Trachtenberg’s system of speed mathematics anymore!The book’s third section focuses on the dangers of this advancing wave of technology: misinformation, disinformation, cyberwar, and the changing nature of war, amongst others. Yet, as the authors emphasize, technological advances are improving our lives–at least, the lives of those with access to the benefits. Technology does not benefit a starving person.Unlike most authors who present us with an overtly sunny view of these advancements, Mustafa Suleyman and Michael Bhaskar acknowledge that the sunlight warms us but can also burn us. The book’s fourth section focuses on the necessity for responsible containment. It proposes ten steps (or means) by which governments, society, and corporations can work together to contain the dangers this new ‘machine technology’ poses to society while retaining the benefits.They end with a provocative question: how will the nature and meaning of humanity change in the coming decades?The book is excellent, well-written, and accessible to everyone, including the lay reader. It is a book that many people must read to educate themselves on current and future developments in AI and synthetic biology. People must read the book now. In five years, it will be outdated.

   Reply