MP says Grok was designed to make sexualised images

BBC
Read full story· 3 min
Labour MP Jess Asato is suing SpaceXSI, alleging its Grok AI chatbot was designed to generate sexualised and offensive deepfake images of her without consent, breaching data protection laws. The lawsuit claims Grok's 'spicy mode' encouraged adult content and that the company failed to remove harmful posts on X (formerly Twitter). SpaceXSI admits Grok creates deepfakes by expanding user prompts using online data.

What happened

Labour MP Jess Asato has filed a lawsuit against SpaceXSI, claiming its Grok AI chatbot was intentionally designed to create sexualised and offensive deepfake images of her without her consent. The legal action alleges that Grok's 'spicy mode' encouraged the production of adult content and that SpaceXSI failed to remove harmful posts from X (formerly Twitter) after multiple reports. SpaceXSI has acknowledged that Grok generates deepfakes by expanding on user prompts using data from X and the wider internet. The case is being heard in the UK High Court, where Asato is seeking damages and changes to how the system operates.

Key details

  • Jess Asato is the Labour MP for Lowestoft in Suffolk.
  • Grok's 'spicy mode' was restricted to paying subscribers starting in January.
  • Six out of 21 reported posts containing harmful content remained online as of late July.
  • SpaceXSI admitted in court documents that Grok expands user prompts with online data to create deepfakes.
  • It is illegal in the UK to create or request non-consensual deepfake images of adults.

Why it matters

UK politicians, public figures, and users of X are directly affected by the ability of Grok to generate and distribute non-consensual deepfake images. SpaceXSI faces legal and regulatory pressure to change how its AI systems handle user prompts and harmful content, as well as potential financial liability. The outcome of this case could set a precedent for how companies must respond to reports of AI-generated abuse and comply with data protection laws.


More in Society & Culture