LIVE
Pedestal AI Secures Seed Funding to Automate Logistics With Intelligent Agents United Launch Alliance Investigates Vulcan Rocket Failure US Southwest Hydropower Output Hits Record Lows Amid Persistent Drought YouTube Updates View Metrics to Include TV Co-Viewing Estimates OpenAI Partners with Chilean Ministry to Advance Public Sector AI Ambience Healthcare Expands Clinical AI Suite for Hospital Operations AI Models Vulnerable to Manipulation in Simulated Warfare Scenarios, Research Shows AWS Highlights Enterprise Governance and AI Workspace Quick Ahead of re:Invent 2026 LoanPro Integrates Amazon Bedrock to Automate Loan Servicing Workflows Google Brings Wallet App to iOS Users Across the United States Pedestal AI Secures Seed Funding to Automate Logistics With Intelligent Agents United Launch Alliance Investigates Vulcan Rocket Failure US Southwest Hydropower Output Hits Record Lows Amid Persistent Drought YouTube Updates View Metrics to Include TV Co-Viewing Estimates OpenAI Partners with Chilean Ministry to Advance Public Sector AI Ambience Healthcare Expands Clinical AI Suite for Hospital Operations AI Models Vulnerable to Manipulation in Simulated Warfare Scenarios, Research Shows AWS Highlights Enterprise Governance and AI Workspace Quick Ahead of re:Invent 2026 LoanPro Integrates Amazon Bedrock to Automate Loan Servicing Workflows Google Brings Wallet App to iOS Users Across the United States

OpenAI Introduces New Image Classifiers and ChatGPT Warnings to Fight Child Sexual Abuse Material

🌐 Work & Society 2 min read 👁 1

OpenAI has rolled out a suite of safety measures, including an advanced image classifier and automated ChatGPT warnings, aimed at detecting and preventing child sexual abuse material.

OpenAI Introduces New Image Classifiers and ChatGPT Warnings to Fight Child Sexual Abuse Material🌐Work & Society

Photo: TechCrunch AI

Key points

  • OpenAI launched an AI-capable image classifier to detect CSAM, providing free API access to select partners.
  • ChatGPT will now display warning screens and issue 24-hour temporary suspensions for users attempting to access child sexualization material.
  • The company is also offering new compliance guidelines for developers and specialized investigative tools for law enforcement.

OpenAI has announced a series of new safeguards designed to combat child sexual abuse material (CSAM) across its platforms. The updates introduce an advanced image classifier built to identify abusive imagery, including content generated by artificial intelligence. To help broader industry efforts, OpenAI is offering free access to this classifier via its API to select companies, developed in partnership with the National Center for Missing and Exploited Children alongside the Tech Coalition and ROOST.

Alongside the backend detection tools, the company is updating ChatGPT with user-facing deterrents. Individuals attempting to prompt the chatbot for inappropriate material involving children will encounter warning screens, receive guidance toward support resources, and face a 24-hour temporary account suspension. Persistent violations will result in permanent account termination. The warning structure and associated guidelines were formulated in collaboration with external groups such as Protect Children and the Lucy Faithfull Foundation.

Furthermore, OpenAI is releasing developer guidelines and equipping law enforcement agencies with specialized investigative tools, plug-ins, and structured training. These measures arrive as the tech industry faces mounting scrutiny regarding safety risks for younger demographics, prompting various platform adjustments over the past year.

What to watch next: Monitor whether other major chatbot developers adopt similar API-sharing initiatives for safety classifiers.

Source TechCrunch AI — techcrunch.com/2026/11/16/openai-releases-a-new-image-classifier-and-ch… ↗

Contact the newsroom

Got a tip, a proposal or a partnership question? Write to us and we will reply shortly.