Canada’s privacy watchdog is expected to release the results of a high-profile investigation into sexually explicit deepfake images generated by the Grok artificial intelligence chatbot, a case that has drawn international attention and intensified calls for stronger regulation of AI-generated content.
The investigation was launched in January by Philippe Dufresne following growing concerns over the creation and distribution of non-consensual sexualized deepfake images through Grok, the AI chatbot developed by xAI and integrated into the social media platform X.
At the time, Dufresne warned that the unauthorized use of personal information to generate deepfakes—including intimate and sexually explicit images—poses serious threats to privacy, dignity, and personal security. He described the rapid growth of AI-generated content as one of the most pressing privacy challenges facing regulators today.
The investigation focused on whether the companies involved complied with Canadian privacy laws when collecting, using, and disclosing personal information for the purpose of generating AI-created images. A key question examined by investigators was whether valid and meaningful consent had been obtained from individuals whose likenesses may have been used to create deepfake content.
Deepfakes are digitally manipulated images, videos, or audio recordings created using artificial intelligence to make it appear that a person said or did something they never actually did. In recent years, sexually explicit deepfakes have emerged as one of the most controversial applications of the technology, raising concerns about harassment, exploitation, reputational harm, and violations of privacy.
The controversy surrounding Grok-generated images sparked a global response. Regulatory authorities in the United Kingdom, the European Union, and the U.S. state of California launched their own investigations into the creation and dissemination of AI-generated sexual content, reflecting growing international concern over the technology’s misuse.
In Canada, the issue has prompted legislative action. The federal government recently introduced new online safety legislation that would make the creation and distribution of non-consensual sexual deepfakes a criminal offence. The proposed measures form part of a broader effort to strengthen protections against online harms, particularly those affecting women, youth, and vulnerable individuals.
The release of the privacy commissioner’s findings is expected to provide important guidance on how existing privacy laws apply to artificial intelligence systems and could influence future regulatory approaches toward AI developers and social media platforms.
The investigation comes at a time when governments worldwide are struggling to balance the benefits of artificial intelligence with growing concerns about misinformation, privacy violations, identity theft, and harmful synthetic content. Legal experts say the findings could establish an important precedent for how AI-generated content is regulated in Canada.
As AI technology becomes increasingly powerful and accessible, policymakers, privacy advocates, and technology companies are facing mounting pressure to develop safeguards that protect individuals from abuse while allowing innovation to continue.
The results of Dufresne’s investigation are expected to be closely watched not only in Canada but also internationally, as governments and regulators work to address the rapidly evolving challenges posed by artificial intelligence and deepfake technology.