Apple delays launch of child abuse detection tools

Apple is to delay the launch of new tools designed to detect child sexual abuse material (CSAM), saying it wants to take more time to “make improvements” after privacy concerns were raised.

Privacy

The iPhone maker had announced plans to introduce new systems which would detect child sexual abuse imagery when someone tried to upload it to iCloud and report it to authorities. Apple said the process would be done securely and would not regularly scan a user’s camera roll, however, privacy campaigners raised concerns over the plans, with some suggesting the technology could be hijacked by authoritarian governments to look for other types of imagery – something Apple said it would not allow.

The tech giant has now confirmed it’s delaying the rollout following feedback from a number of groups. The company said in a statement:

Last month we announced plans for features intended to help protect children from predators who use communication tools to recruit and exploit them, and limit the spread of child sexual abuse material.

Based on feedback from customers, advocacy groups, researchers and others, we have decided to take additional time over the coming months to collect input and make improvements before releasing these critically important child safety features.

The system works by looking for image matches based on a database of “hashes” – a type of digital fingerprint – of known CSAM images provided by child safety organisations. This process takes place securely on a device when a user attempts to upload images to their iCloud photo library.

It was to be joined by another new feature in the Messages app, which warns children and their parents using linked family accounts when sexually explicit photos are sent or received, with images blocked from view and on-screen alerts; and new guidance in Siri and Search which will point users to helpful resources when they perform searches related to CSAM.

Apple said the two features are not the same and do not use the same technology, adding that it will “never” gain access to communications as a result of the improvements to Messages.