跳到正文
实时
OpenAI Deployment Safety·· 1 天前

OpenAI CSAM 图像分类器模型卡

OpenAI CSAM Image Classifier Model Card

要点速览

OpenAI 发布了 CSAM 图像分类器模型卡,该模型使用受控、人工标记的图像数据集进行训练和评估,这些数据集符合美国法律以防止儿童性剥削。在线评估的精确度显著低于离线评估,因为在线评估集中的 CSAM 比例远低于离线集,导致少量误报可能超过真实检测数,降低精确度。

正文

2. Model architecture, data, and training

2.2.2 Data handling

We trained and evaluated the classifier using access-controlled, human-labeled image datasets assembled in compliance with U.S. law for purposes of preventing the sexual exploitation of children. Sensitive material was stored and processed in controlled environments, with restricted access. Legal, privacy, security, and reviewer-wellness controls governed both training and data handling.

3.2.1 Understanding precision in online evaluation

At the same thresholds, precision was substantially lower in the online evaluation set than the offline held-out evaluation set. Precision is the share of flagged images that are true positives, and the held-out set contained a much higher proportion of CSAM than we observed in the online evaluation set. When CSAM is rare, even a small fraction of non-CSAM images flagged incorrectly can outnumber true detections. Those false positives increase the total number of flags without increasing the number of true positives, lowering precision.

The online estimates give us a better indication of the mix of flags a human reviewer would see on ChatGPT. Across several rounds of training, we used reviewed examples from earlier online evaluations to improve performance on the types of errors we had identified. Each round also surfaced new patterns of false positives, underscoring the value of reviewing flags from the current classifier.

来源: OpenAI Deployment Safety · deploymentsafety.openai.com