UK's Data Protection Watchdog Launches Probe into X and xAI Over Grok AI Sexual Deepfakes
A formal investigation has been launched by the UK's Information Commissioner's Office (ICO) into social media platform X, as well as its parent company xAI, over the misuse of their technology to create and spread indecent deepfakes without users' consent. The probe centers on the Grok AI tool, which was used to generate millions of sexually explicit images in under two weeks.
The ICO has expressed "deeply troubling" concerns about how people's personal data was used to create intimate or sexualized images without their knowledge or consent. The watchdog has questioned whether the necessary safeguards were put in place to prevent such misuse and warned that losing control of personal data can cause immediate and significant harm, particularly when children are involved.
The investigation follows a series of public criticism and regulatory scrutiny X faced after its account was used to mass-produce partially nude images of girls and women. The company has since taken measures to address the issue, but several investigations have followed. The ICO's executive director, William Malcolm, stated that the reports about Grok raise serious questions about how people's data is being used in this way.
If found guilty of breaching the General Data Protection Regulation (GDPR), X could face a fine of up to ยฃ17.5m or 4% of its global turnover, estimated at around $90m based on its recent advertising revenue.
The probe also raises questions about the nature of AI-generated imagery and how it is sourced. Iain Wilson, managing partner at law firm Brett Wilson, described the situation as an "egregious breach of data protection law" if photographs of living individuals were used to generate non-consensual sexual images, particularly when children are involved.
In a separate development, the UK's communications regulator, Ofcom, announced that it was not investigating xAI, which provides the standalone Grok app. However, Ofcom said its investigation into X was still gathering evidence and could take months. The company has been given a "full opportunity to make representations" before the inquiry is concluded.
A cross-party group of MPs has also written to the technology secretary, urging the government to introduce AI legislation to prevent a repeat of the Grok scandal. The proposed legislation would require AI developers to thoroughly assess the risks posed by their products before they are released.
A formal investigation has been launched by the UK's Information Commissioner's Office (ICO) into social media platform X, as well as its parent company xAI, over the misuse of their technology to create and spread indecent deepfakes without users' consent. The probe centers on the Grok AI tool, which was used to generate millions of sexually explicit images in under two weeks.
The ICO has expressed "deeply troubling" concerns about how people's personal data was used to create intimate or sexualized images without their knowledge or consent. The watchdog has questioned whether the necessary safeguards were put in place to prevent such misuse and warned that losing control of personal data can cause immediate and significant harm, particularly when children are involved.
The investigation follows a series of public criticism and regulatory scrutiny X faced after its account was used to mass-produce partially nude images of girls and women. The company has since taken measures to address the issue, but several investigations have followed. The ICO's executive director, William Malcolm, stated that the reports about Grok raise serious questions about how people's data is being used in this way.
If found guilty of breaching the General Data Protection Regulation (GDPR), X could face a fine of up to ยฃ17.5m or 4% of its global turnover, estimated at around $90m based on its recent advertising revenue.
The probe also raises questions about the nature of AI-generated imagery and how it is sourced. Iain Wilson, managing partner at law firm Brett Wilson, described the situation as an "egregious breach of data protection law" if photographs of living individuals were used to generate non-consensual sexual images, particularly when children are involved.
In a separate development, the UK's communications regulator, Ofcom, announced that it was not investigating xAI, which provides the standalone Grok app. However, Ofcom said its investigation into X was still gathering evidence and could take months. The company has been given a "full opportunity to make representations" before the inquiry is concluded.
A cross-party group of MPs has also written to the technology secretary, urging the government to introduce AI legislation to prevent a repeat of the Grok scandal. The proposed legislation would require AI developers to thoroughly assess the risks posed by their products before they are released.