AI ‘Recall’ Feature for Windows Raises Big Privacy Alarms, Microsoft Delays Rollout

The Recall feature, showcased last month, was designed to enhance Microsoft’s AI assistant Copilot by periodically capturing screenshots to create a “photographic memory” of a user’s virtual activity. Nadella described Recall as a significant step toward AI systems that can “instantly see us, hear, reason about our intent and our surroundings.”

In what’s sure to send a chill down the spine of most porn fans and privacy advocates, Recall can search through users’ past activity, including files, photos, emails, and browsing history, as well as the screenshots taken every few seconds. This capability has raised significant privacy concerns.

“This could be a privacy nightmare,” said Dr. Kris Shrishak, an adviser on AI and privacy. “The mere fact that screenshots will be taken during use of the device could have a chilling effect on people.”

Microsoft asserted that privacy was a key consideration in Recall’s design, stating that users would have control over what is captured. For instance, users can opt out of capturing specific websites, and private browsing sessions on Microsoft’s Edge browser will not be recorded.

Anyone who has used a computer in the last decade though knows how persistent tech companies can be at manipulating and tricking their users into “consenting” to privacy disasters.

“People might avoid visiting certain websites and accessing documents, especially confidential documents, when Microsoft is taking screenshots every few seconds,” Dr. Shrishak added.

Daniel Tozer, a data and privacy expert at Keystone Law, likened the system to a dystopian scenario reminiscent of the Netflix program “Black Mirror.” He emphasized the need for a lawful basis to record and display users’ personal information and raised concerns about proprietary or confidential information being recorded without consent.

“How will consent work for people appearing on the screen during a video call or in a photo? User and access controls will be a key issue on which Microsoft will doubtless be focusing,” Tozer said.

Jen Caltrider, who leads a privacy team at Mozilla, pointed out that the feature could allow someone with your password to access your detailed history, raising concerns about law enforcement access or changes in Microsoft’s data usage policies. Microsoft stated that Recall would not moderate or remove screenshots containing sensitive information like passwords or financial account details.

“I wouldn’t want to use a computer running Recall to do anything I wouldn’t do in front of a busload of strangers,” Caltrider said. “That means no more logging into financial accounts, looking up sensitive health information, asking embarrassing questions, or even looking up information about a domestic violence shelter, reproductive health clinic, or immigration lawyer.”

What impact could recall have on adult content viewing on personal computers? It’s safe to say the impact won’t be positive.

On Thursday, Microsoft announced a delay in the broad rollout of Recall, which was initially set to be included with new PCs starting Tuesday. Instead, the feature will be tested by a smaller group of users in the Windows Insider program. These early adopters will supposedly help ensure the feature meets Microsoft’s quality and security standards, according to Pavan Davaluri, Microsoft’s corporate vice president of Windows and devices.

Microsoft unveiled the new AI-enhanced personal computers at its annual Build event last month, amidst growing competition from other major tech companies in the generative AI space. These new AI capabilities in Windows 11 will be available on high-end computers from Microsoft partners, including Acer, Asus, Dell, HP, Lenovo, and Samsung, as well as on Microsoft’s Surface devices.