AI error nearly led the US to a clash with China
The United States nearly launched a military operation to intercept a Chinese vessel in the Middle East due to an erroneous intelligence report prepared with the help of AI. The chatbot incorrectly identified the nature of the cargo, mistaking it for components of a nuclear program. The operation was halted at the last moment after an additional data review.
The United States nearly launched a military operation to intercept a Chinese vessel in the Middle East due to an erroneous intelligence report prepared with the help of artificial intelligence. According to CNN, citing four sources, US military officials took the information so seriously that they began preparing for an interception: armed servicemen were to board the vessel, and military aircraft were already in the air. The operation was stopped shortly before it began when officials further reviewed the report and discovered that an analyst from the Special Operations Command had used a chatbot. The AI incorrectly identified the nature of the materials being transported by the Chinese ship. One source described the information as completely false, while another stated that the incident nearly led to war. The analyst received information about the cargo from the Pacific Special Operations Command in Hawaii and passed it to the chatbot. The AI combined the initial data with open sources and classified signals intelligence, then made an incorrect conclusion. The analyst then used AI again to prepare a standard intelligence report, which was distributed among the military. The incident occurred amid the rapid integration of AI into the US military and intelligence agencies. Sources note that there is no unified system for verifying information obtained through AI, and this case is not the only example of AI "hallucinations" in the intelligence community.