NNuggets
BookmarksCollections
  • About Us
  • Terms of use
  • Privacy policy
  • Disclaimer
  • Copyright & Takedown Policy
  • Community Guidelines
  • Cookie Policy
  • Contact

© 2026 Nuggets

NuggetsMarket PulseCollections

On this page

Speakers & Credentials

  • Speakers & Credentials
  • 1. Executive Summary
  • 2. Chronological Table of Contents
  • 3. Detailed Thematic Summary
  • The Reference Vault
  • 4. Data & Figures
  • 5. Core Frameworks & Mental Models
  • 6. Anecdotes
  • 7. References & Recommendations
  • 8. The Bottomline (by AI)

On this page

  • Speakers & Credentials
  • 1. Executive Summary
  • 2. Chronological Table of Contents
  • 3. Detailed Thematic Summary
  • The Reference Vault
  • 4. Data & Figures
  • 5. Core Frameworks & Mental Models
  • 6. Anecdotes
  • 7. References & Recommendations
  • 8. The Bottomline (by AI)
Geopolitics/May 24, 2026/16 min read/youtube.com

The Dawn of AI Warfare: A Conversation with Katrina Manson | Center for Strategic & International Studies

Source
Source
Watch on YouTube ↗

"Targetry is no substitute for strategy." - Jim Mattis (paraphrased by Katrina Manson) [00:08:50]

"I hate to admit it, but atrocities are possible in the era of AI." - Unnamed Former Defense Official [00:11:03]

"AI [is] a bag of potato chips... it wasn't producing the results, it was frustrating him, computer vision wasn't delivering." - []

References

  1. Original source (youtube.com)

Disclaimer: Orignal content owned by or sourced from third parties. It does not represent the views of 'Nuggets' platform or it's team. AI is used extensively across this platform including for summaries. Accuracy is not guaranteed, there can be mistakes. Any info or content on this platform is not a financial, legal, or investment advice. Do your own research. Refer for complete disclosures:- Terms of Use · Full Disclaimer

Related nuggets

Jun 2, 2026

Kalshi Monthly Volume - Politics ($M) | Chart of the Day | Coatue

Coatue: Kalshi's political volume has scaled dramatically, and the American Power Index KPOW is what that scale enables: a single number gauge of the current balance of political power and where markets expect it to move, which Kalshi bill…

Jun 2, 2026

The BlackBerry Problem |18 May 2026 | The Mistakes Series | Malcolm Gladwell's Revisionist History

"My mistake and naivity was to think that people are were with me so you're flying around the world you're trying to get people on side and you think they're on side but they're not mhm mhm and you get blindsight" Jim Balsillie 00:01:34 ht…

Jun 2, 2026

Partnership Perspectives: Network International | 2 Jun 2026 | Brookfield Perspectives

"Brookfield's the largest infrastructure owner in the world... We drew a pipeline and we showed all the different components of the payments ecosystem on a pipeline and said it's like a pipe that moves any commodity except what it's moving…

Jun 2, 2026

Actions

Reading

Published
May 24, 2026
Read time
16 min read
Progress0%
Drew Cukor (paraphrased by Katrina Manson)
00:22:27

"Accept, accept, accept." - U.S. Military Targeteer (describing the automation bias of algorithmic targeting) [00:14:03]

"If you think about it, there's no reason that drone operators have to be on the ground inside Ukraine; they could be in Germany, they could be in Australia." - Ukrainian Official (quoted by CSIS Host) [00:58:49]

"War [will be] rolling out at speeds faster than humans can think." - Katrina Manson (citing military commanders) [00:32:56]


Speakers & Credentials

  • Katrina Manson: Bloomberg Reporter covering cyber, emerging tech, and national security. Author of Project Maven: A Marine Colonel, His Team, and the Dawn of AI Warfare.
  • CSIS Host (Unnamed in transcript): Policy and national security expert at the Center for Strategic & International Studies (CSIS). Former Congressional oversight staffer for intelligence activities, providing deep institutional context on Pentagon procurement and historical defense strategy.

1. Executive Summary

  • The U.S. military's adoption of AI, catalyzed by Project Maven, has fundamentally transformed the speed and scale of battlefield targeting, increasing target processing capacity from 100 targets a day to a potential 5,000 targets a day using computer vision and LLMs [00:23:58].
  • A severe culture clash exists between the Pentagon's rigid bureaucratic structures, the skeptical pragmatism of the intelligence community, and the overpromising, hyper-iterative culture of Silicon Valley startups [00:19:16].
  • Despite the Department of Defense's official stance on "appropriate levels of human judgment," the practical reality on the frontlines risks severe automation bias ("accept, accept, accept"), where humans become mere rubber stamps for algorithmic outputs operating at speeds faster than human cognition [00:14:03], [00:32:56].
  • Real-world deployments in Ukraine and the Middle East have exposed major vulnerabilities in algorithmic warfare, including devastating failures caused by unpredicted environmental variables (e.g., snow in Ukraine dropping computer vision efficacy to 10%) [00:38:36] and latency issues tied to poor network infrastructure [00:36:36].
  • The future of autonomous warfare is accelerating rapidly toward multi-domain, voice-controlled autonomous drone swarms (the "Hellscape" strategy), raising existential questions about deterrence against peer competitors like China, the viability of the "human in the loop," and the terrifying reality of algorithms fighting algorithms [01:01:53].

2. Chronological Table of Contents

  • [00:04:39] Introduction & The Central Tension of AI in Warfare
  • [00:12:38] DoD Directive 3000.09 and the "Human in the Loop" Illusion
  • [00:16:05] Early Failures: The "Slant Count" and Narrowing AI Utility
  • [00:19:16] Culture Clash: Intel Pragmatists vs. Silicon Valley Optimists
  • [00:23:58] Scaling the Target Deck: 100 to 5,000 Targets a Day
  • [00:36:36] Project Maven in Ukraine: Network Latency and Environmental Algorithm Collapse
  • [00:42:28] Procurement Warfare: Bureaucracy, Data Hoarding, and the Wedding Cake Startup
  • [00:54:51] The Anthropic Dilemma and JADC2 Integration
  • [01:01:20] The Future Arc: Voice-Controlled Swarms and the Replicator Program

3. Detailed Thematic Summary

Historical Precedent & The Tactical Genesis of Algorithmic Warfare

  • The Problem of the Cutting Room Floor: Historically, human analysts were forced to stare at drone monitors for hours, resulting in massive intelligence drop-off and friendly-fire tragedies. Project Maven was birthed not as a grand strategic weapon, but as a tactical solution to flag anomalies (e.g., motorcycles, submarines) in a queue of 50,000 images so humans could look away [00:11:16].
  • Targeting Math & Scaling Asymmetry: Historically, human-driven U.S. forces could process approximately 100 targets a day. By introducing Maven's computer vision, this scaled to 1,000 targets a day. With the integration of Large Language Models (LLMs) to speed up processes, the capacity is projected to reach 5,000 targets a day [00:23:58].
  • The Illusion of Tactical Purity: What began as a tool for operational auditing—intended to protect civilians by clarifying targeting data—has mutated into a strategic posture. Bob Work (former Deputy Defense Secretary) viewed AI as a direct stepping stone to "autonomy at rest" (a digital mission control) and fully autonomous drones [00:06:42].
  • The "Bag of Potato Chips" Reality: In the early 2020s, the internal reality of AI development was bleak. Marine Colonel Drew Cukor internally referred to AI as a "bag of potato chips" because the computer vision simply wasn't delivering results, necessitating a painful wait for transformer architecture to mature [00:22:27].

The Human-in-the-Loop Illusion & Automation Bias

  • Directive 3000.09 Omissions: Department of Defense Directive 3000.09 (the policy on semi-autonomous/autonomous weapons) never actually uses the phrase "human in the loop." It only mandates "appropriate levels of human judgment." Commanders use the phrase "human in the loop" primarily as internal messaging to reassure their own forces [00:12:38].
  • The Gamification of War: The structural reality of AI warfare risks turning targeteers into rubber stamps. Observing an unclassified demo of the Maven Smart System, Manson documented operators simply hitting "accept, accept, accept" as the system fed them targets, moving at a velocity that outpaces human interrogation of the underlying data streams [00:14:03].
  • The "AI Adulting Tasks" Deficit: The Department of Defense has rushed deployment without commensurate risk management. While the DoD granted Gen AI agent access to 3,000,000 personnel, only 26,000 had actually been through the necessary training to understand the limits, biases, and hallucinatory risks of the technology [00:15:24].
  • Rejecting AI for the "Slant Count": In a rare moment of restraint, Special Operations Command (SOCOM) rejected using AI to calculate the "slant count" (estimating civilian casualties prior to a strike). Recognizing the risk of hallucination, commanders refused to stake their careers and human lives on algorithmic probability, restricting the AI solely to tracking motorcycles instead [00:16:05].

The Realities of Modern Conflict: Ukraine, Iran, and the China Deterrence

  • Environmental Algorithm Collapse in Ukraine: When Maven was deployed to assist Ukraine, the AI catastrophically failed. Algorithms trained on Middle Eastern deserts and Philippine jungles collapsed to roughly 10% capability when faced with Ukrainian snow. It required a frantic pivot to feed satellite data to vendors to retrain the models [00:38:36].
  • The Latency Bottleneck: The initial deployment in Ukraine was hindered not just by code, but by physics. Images took 8 seconds to load because data packets were crossing the Atlantic four times. Project Maven had to unilaterally fund and rebuild a direct-to-US network to make the system functional after learning from its use during the Kabul airport withdrawal [00:36:36].
  • Iran vs. China - The Target Deck Discrepancy: The U.S. possesses a decade-deep "target deck" for Iran, allowing AI to efficiently chew through static targets in an environment where the enemy's air defense is decimated [00:24:58]. Conversely, a conflict with a peer competitor like China would force a speed-of-light engagement where algorithmic combat moves faster than human cognition, demanding reliance on unproven autonomy [00:32:56].
  • "Hellscape" and the Autonomous Swarm: Admiral Paparo of INDOPACOM envisions a "hellscape" scenario for Taiwan deterrence: deploying massive autonomous swarms to buy the U.S. a month of time. However, the U.S. appetite for algorithmic error is higher in naval warfare, operating under the grim assumption that "if you miss in a naval scenario, you hit water" [00:39:53].

Culture Clash: The Pentagon vs. Silicon Valley

  • The Procurement Labyrinth: Traditional Pentagon procurement is utterly incompatible with software iteration. The Host described witnessing a physical 20-foot-long paper scroll unrolled on a table just to map the bureaucratic decision tree for defense acquisitions [00:49:49].
  • Recruiting the Wedding Cake AI: Desperate for novel computer vision, Col. Drew Cukor recruited a commercial startup whose algorithm won competitions by perfectly identifying the tiers of a wedding cake and bridal veils, demanding they pivot to identifying objects of war (leading to heavy staff attrition at the company) [00:43:36].
  • Data Hoarding and the Semicircle Blindspot: Silicon Valley engineers were forced to "remote in" to clunky, classified DoD systems because the Pentagon refused to release raw data. This hyper-classification severely degraded capability. For example, AI failed to detect Russian mobile missile launchers because from above they just looked like standard trucks; the AI developers were never cleared to know that Russian forces arrange these specific trucks in a semicircle [00:45:50].
  • The Anthropic Severance: The military is currently facing an impending operational crisis. The core interface of Maven relies heavily on Anthropic's Claude LLM, but the relationship is fraught and the DoD has given itself a strict six-month deadline to sever ties and cease using it, scrambling to find viable alternatives for their 25,000+ deployed accounts [00:54:51].

The Reference Vault

4. Data & Figures

Data PointValueContextTimestamp
Manual Target Processing Capacity100 targets/dayThe baseline U.S. capacity before algorithmic intervention.[00:23:58]
Maven CV Target Capacity1,000 targets/dayThe scaled capacity using Project Maven's computer vision.[00:23:58]
LLM-Enhanced Target Capacity5,000 targets/dayThe projected theoretical limit when combining CV with Generative AI for "find and fix" processes.[00:23:58]
Gen AI Access Footprint3,000,000 personnelThe total number of DoD personnel granted access to generative AI agents.[00:15:24]

5. Core Frameworks & Mental Models

  • Autonomy at Rest vs. Autonomy in Motion [00:06:42]
    • Synthesis: Pushed by former Deputy Defense Secretary Bob Work, this framework delineates the evolution of AI warfare. "Autonomy at rest" refers to digital mission control—using backend software (like Maven) to aggregate sensor data, process targets, and manage logistics safely behind servers. However, this is viewed strictly as a Trojan horse and a stepping stone to "Autonomy in motion": deploying algorithmic decision-making directly onto kinetic drones in the field. The irony is that selling the former as a safe, bureaucratic tool inevitably laid the rails for the existential risk of the latter.
  • The "Slant Count" Risk Calibration [00:16:05]
    • Synthesis: The ultimate test of institutional trust in AI. The "slant count" is the pre-strike estimation of collateral damage (how many civilians are in the blast radius). While technologists believed AI could perfectly calculate this, military commanders flatly rejected it, recognizing that algorithmic hallucinations in this specific framework result directly in war crimes. It serves as a mental model for where the DoD draws the red line between AI as an assistant (tracking motorcycles) versus an arbiter (deciding who lives or dies).
  • Automation Bias & The "Accept, Accept, Accept" Loop [00:14:03]
    • Synthesis: A well-documented psychological framework where humans defer to machine outputs, amplified to terrifying degrees in modern warfare. Because AI systems like Maven process intelligence at velocities that shatter human bandwidth, targeteers are structurally coerced into trusting the black box. The philosophical mandate of a "human in the loop" is hollowed out; the human is no longer exercising judgment, but merely providing biological legal cover for algorithmic execution.
  • Algorithms Fighting Algorithms (Hyper-War) [00:32:56]
    • Synthesis: The terminal state of peer-to-peer conflict (e.g., US vs. China). In this framework, human OODA loops (Observe, Orient, Decide, Act) are physically too slow to compete. War transforms from a clash of human strategy into a high-frequency trading market of violence, where algorithms attempt to poison the data sets of enemy algorithms in real-time. Survival relies entirely on automated industrial capacity and the ability to update software mid-combat without a human ever intervening.
  • "Hellscape" Deterrence [00:39:53]
    • Synthesis: An unclassified moniker for INDOPACOM's strategic operational plan to deter a Chinese invasion of Taiwan. Rather than risking capital ships and human lives immediately, the U.S. would flood the operational theater with thousands of attritable, autonomous, and eventually weaponized drones (air, surface, and sub-surface). The strategic calculus hinges on overwhelming enemy sensors and buying 30 days of time, explicitly accepting higher algorithmic error rates because "missing" in the ocean carries less civilian risk than missing in a city.

6. Anecdotes

  • The Wedding Cake Startup Goes to War [00:43:36]
    • The Narrative: Colonel Drew Cukor boarded an Amtrak to New York to recruit a startup that was winning computer vision competitions. Their commercial use-case? Identifying bridal veils, grooms' suits, and the tiers of a wedding cake. Cukor demanded they pivot their tech to hunt instruments of war.
    • The "Why": Manson tells this story to highlight the sheer asymmetry between the Pentagon's needs and Silicon Valley's culture. Forcing civilian software engineers to suddenly develop targeting matrices led to massive internal strife and resignations, echoing the Google protests, and showing the friction of forcing civilian commercial tech into the kill chain.
  • The Russian Semicircle Blindspot [00:45:50]
    • The Narrative: AI developers were failing to train Maven to identify Russian mobile missile launchers because from satellite imagery, they look identical to basic supply trucks. The algorithm kept failing until frontline troops revealed that Russian missile batteries always park their trucks in a distinct semicircle.
    • The "Why": This highlights the crippling effects of over-classification and data hoarding. Because the Pentagon refused to share tactical context with unclassified civilian developers, the million-dollar algorithms were entirely blind to the obvious human tells of the enemy.
  • The 20-Foot Procurement Scroll [00:49:49]
    • The Narrative: During a Congressional briefing on reforming DoD procurement, officials physically unrolled a 20-foot-long paper blueprint across a massive hearing table just to visually map the bureaucratic decision tree required to buy a single piece of technology.
    • The "Why": The Host used this to validate Cukor's claim that getting Maven off the ground was a "knife fight." The Pentagon's DNA is structurally built to prevent agile software development, making Maven's survival a sheer act of bureaucratic willpower.
  • The Ukrainian Snow Collapse [00:38:36]
    • The Narrative: At the onset of the Ukraine war, Maven was deployed to track Russian assets. It immediately failed, dropping to roughly 10% efficacy. The reason? The algorithms had only ever been trained on visual data from the deserts of the Middle East and the jungles of the Philippines. When confronted with white Ukrainian snow, the computer vision went entirely blind.
    • The "Why": A terrifying proof-of-concept that AI is brittle. It shatters the myth of omnipotent AI, proving that without hyper-local, dynamically updated training data, autonomous systems will catastrophically fail in new operational environments.
  • The Replicator Drone Attacks Its Operator [01:03:25]
    • The Narrative: During tests to develop autonomous drone swarms (related to Replicator initiatives), a U.S. Captain found himself capsized in the water, only to be forced to fend off an autonomous U.S. test drone that had gone rogue and was targeting him on the surface of the water.
    • The "Why": A stark warning against the push for "Autonomy in motion." As the military races to attach kinetic explosives to these platforms, the inability to safely test them without almost killing U.S. personnel highlights the massive danger of fielding algorithms that are not yet stable.

7. References & Recommendations

Institutions & Geopolitical Entities

  • Project Maven / Maven Smart System: The Pentagon's flagship AI program, initially designed for computer vision to analyze drone footage, now evolving into the central node for global targeting and battlefield awareness [00:05:08].
  • NGA (National Geospatial-Intelligence Agency): The intelligence agency that ultimately took custodianship of Project Maven. Cited as the most forward-leaning, tech-friendly agency in the IC, operating a unique unclassified facility in St. Louis to interface directly with industry [00:21:07].
  • SOCOM (Special Operations Command): Discussed as an early adopter of Maven that wisely restricted the AI's use cases (refusing to use it for civilian casualty calculations) to avoid catastrophic hallucinations [00:16:05].
  • CENTCOM (U.S. Central Command): Currently utilizing AI to speed up processes against Iranian targets, serving as the live-fire testing ground for how AI functions in asymmetrical warfare [00:08:20].
  • INDOPACOM (U.S. Indo-Pacific Command): The combatant command tasked with deterring China, relying on unproven concepts like "Hellscape" and massive drone autonomy due to the speed and scale required for a Pacific conflict [00:39:53].
  • 18th Airborne Corps: Mentioned specifically because their military ethicists have raised severe warnings regarding the gamification of war and the dangers of un-auditable AI outputs [00:14:20].

Key Individuals

  • Bob Work: Former Deputy Defense Secretary. Cited as the philosophical architect behind AI in defense, viewing it as a stepping stone to full autonomy and preemptive algorithmic strikes [00:07:12].
  • Drew Cukor: The Marine Colonel who built Project Maven. Highlighted for his ruthless bureaucratic maneuvering (the "knife fight") and his grounded realism (calling early AI a "bag of potato chips") [00:22:14].
  • General Mark Milley: Former Chairman of the Joint Chiefs, referenced for his stark warning that AI is a "Pandora's box" that will inevitably lead to massive civilian casualties in urban warfare [00:09:51].
  • Jim Mattis: Former Defense Secretary, quoted to emphasize that scaling target destruction via AI does not magically create a winning geopolitical strategy [00:08:50].
  • General Chris Donahue: Instrumental in pushing AI warfare through its paces, arguing that AI is necessary solely to prioritize the sheer volume of targets modern war demands [00:24:32].
  • Admiral Samuel Paparo: Commander of INDOPACOM, cited for his reliance on the "Hellscape" doctrine of autonomous drone swarms to deter a Chinese invasion of Taiwan [00:39:53].

Concepts, Policies, and Technology Platforms

  • DoD Directive 3000.09: The official Pentagon policy on autonomous weapons, heavily critiqued for deliberately omitting the phrase "human in the loop" in favor of vague language about "human judgment" [00:12:38].
  • Delta System (Ukraine): Ukraine's homegrown situational awareness platform that provides total informational awareness, allowing drone operators to theoretically strike targets from anywhere on the globe [00:58:49].
  • JADC2 (Joint All-Domain Command and Control): The Pentagon's massive, somewhat ephemeral project to link all sensors and shooters across all domains, which Maven is attempting to integrate into [00:57:43].
  • Replicator Initiative / DAWG (Defense Autonomy Warfare Group): A Pentagon effort to field thousands of attritable drones quickly. Manson notes it is lagging behind schedule and struggling to safely weaponize the voice-controlled drone swarms during testing [01:01:53].

Companies & Private Sector Actors

  • Anthropic: The creators of the Claude LLM, currently deeply embedded in Maven. Referenced because the DoD is attempting to sever ties with the platform within six months, posing a massive operational hurdle [00:54:51].
  • Palantir: The vendor that secured access to frontline forces because they provide the user interface/platform for Maven, succeeding where algorithm developers failed because of their legacy operating model [00:45:14].
  • Microsoft, Amazon, Clarifai: Mentioned as early algorithmic partners for Project Maven that had to navigate the military's chaotic pivot-heavy contracting process [00:50:47].

8. The Bottomline (by AI)

The tactical application of AI in warfare has permanently breached containment, evolving from a back-office analytics tool into the central nervous system of kinetic global conflict. The Pentagon is fundamentally unprepared for the friction of this reality; they are attempting to fight hyper-velocity, software-driven wars using 20th-century paper-based procurement bureaucracies and an undertrained force highly susceptible to automation bias. Watch the DoD’s fast-approaching six-month deadline to rip Anthropic’s architecture out of its systems—if they fail to find a viable replacement, the cognitive engine of U.S. targeting will stall precisely as adversaries like China rapidly accelerate toward fully weaponized, algorithm-driven swarm autonomy.

Full Episode: The AI Industrial Revolution | 2 Jun 2026 | Naval and Nivi

Context: Host Naval Ravikant introduces a roundtable discussion on the "AI Industrial Revolution" with three frontier deep tech and software founders who build their own physical factories and tech infrastructure from first principles rath…

Gen AI Trained Users26,000 personnelThe fraction of the force that has actually completed training to understand AI limits and risks.[00:15:24]
Maven Accounts25,000+ accountsThe current deployment footprint of the Maven Smart System across all combatant commands.[00:54:51]
Algorithm Efficacy Drop (Ukraine)~10% capabilityThe functional collapse of Maven's computer vision when exposed to Ukrainian snow instead of desert sand.[00:38:36]
Latency/Data Travel4x Atlantic CrossingsData packets were bouncing across the Atlantic four times, causing critical 8-second image load delays on the frontlines.[00:36:36]
Data Labeling Budget$700,000,000+Contracts put out by the NGA strictly for the manual labeling of data to feed into military AI.[00:52:16]
Anthropic Severance Timeline6 MonthsThe internal clock the DoD has given itself to stop using Claude inside its AI platforms.[00:55:39]