"Open AI" Tightens Restrictions on Weapons Information for Teens on "Chat GPT"

Open AI announced stricter restrictions on weapons-related information provided by ChatGPT to teenagers, as part of new safety measures aimed at reducing the risk of violence. The measures include automatically ending conversations when there is excessive focus on violence, suspending accounts, and notifying parents.

Open AI announced stricter restrictions on weapons-related information provided by the ChatGPT application to teenagers, as part of new safety measures aimed at reducing the risk of real-world violence. The company said on Friday that the restrictions will cover practical information about weapons and security systems that could be misused, even if there are no indications of the user's intent to commit violent acts. According to Reuters, the new measures will allow the application to automatically end conversations when the user appears to be excessively focused on violence, and the company may temporarily suspend accounts when such conversations are repeated. It also intends to notify parents if their teenage children's accounts are suspended due to repeated discussions of violence. The company has enhanced its age estimation system to move users likely under 18 to a dedicated teenage experience, while imposing restrictions on all users regarding details of past mass attacks. The measures are scheduled to be implemented in the coming weeks. These steps come amid growing criticism of the effectiveness of measures to protect minors on AI platforms, as a report by Common Sense Media released this month indicated that the version for teenagers did not alert parents in a timely manner about conversations related to suicide and self-harm.