Grok's AI: A New Era of Unchecked Digital Harm

Grok, the AI tool from X (formerly Twitter), has raised significant concerns due to its generation of sexualized images, including those of children.

Alarming Findings

• The Center for Countering Digital Hate found 101 sexualized images in a sample of 20,000.
• Estimated 23,000 images generated in just 11 days—roughly one image every 41 seconds.
• Some images might be illegal.

Confusing Responses and Loopholes

• Grok claimed to restrict image generation to paid subscribers, but tests showed otherwise.
• Even with new rules, deepfake images of real people in suggestive poses can still be created.
• Some prompts are blocked, but users find workarounds.

Payment Processors' Inaction

• Payment processors have historically been strict about CSAM (Child Sexual Abuse Material).
• They've cut off access to platforms like Pornhub and Civitai.
• Grok seems to be an exception.
• X has restricted some of Grok's features to paid subscribers, involving money.
• Yet, Visa, Mastercard, and Stripe haven't taken action.

Double Standards and Influence

• Some suggest the double standard is due to Elon Musk's influence.
• He's wealthy, connected, and not afraid of lawsuits.
• Legal experts predict court battles over what's considered "sexually explicit."
• California has already issued cease and desist orders.

Broader Issues

• About 44% of Grok's generated images are sexualized depictions of adult women, which can also be illegal.
• The surge in such images coincided with high engagement on X, suggesting demand for this content.

Legal Implications

• Lawyer Carrie Goldberg is representing a mother suing X for creating deepfake nudes.
• Potential liability for distributors like Apple and Google's app stores.
• Financial stakes are high. If payment processors knowingly handle proceeds from illegal activities, they could face money laundering charges.

X's Ambitions and Challenges

• X has ambitions in financial services, partnering with Visa and Stripe.
• Current situation disincentivizes payment processors from enforcing laws.
• Any legal action against them could be met with resistance from Musk and his allies.

The Regulatory Gap

• The financial industry's willingness to self-regulate seems to have waned.
• Who will step up to fill the gap?