After being one of the first countries in the world to block Elon Musk’s Grok chatbot, Malaysia has now lifted its ban. Along with Indonesia, the country moved swiftly to temporarily halt access to X's frequently controversial AI chatbot earlier this month, after multiple reports emerged of it being used to generate deepfake sexualized images of people, including women and children.

At the time, the Malaysian Communications and Multimedia Commission (MCMC) said the restrictions would remain in place until X Corp and parent xAI could prove they had enforced the necessary safeguards against misuse of the above nature.

Malaysian authorities appear to be taking X at its word, after the MCMC released a statement confirming it was satisfied that Musk’s company has implemented the required safety measures. It added that the authorities will continue to monitor the social media platform, and that any further user safety breaches or violations of Malaysian laws would be dealt with firmly.

At the time of writing, only Malaysia and Indonesia have hit Grok with official bans, though UK regulator Ofcom opened a formal investigation into X under the country’s Online Safety Act, in the wake of the non-consensual sexual deepfake scandal. X has since changed its image-editing policies, and on January 14 the company said Grok will no longer allow "the editing of images of real people in revealing clothing such as bikinis."

Earlier this week, the UK-based non-profit, the Center for Countering Digital Hate (CCDH), estimated that in the 11-day period between December 29 and January 9, Grok generated approximately 3 million sexualized images, around 23,000 of which were of children.

This article originally appeared on Engadget at https://www.engadget.com/ai/malaysia-lifts-ban-on-grok-after-taking-x-at-its-word-144457468.html?src=rss

©

© Reuters / Reuters

California Attorney General Rob Bonta has sent a cease and desist letter to xAI, days after his office launched an official investigation into the company over reports that Grok was generating nonconsensual

If you’ll recall, xAI and Grok have been under fire for taking images of real individuals and putting them in revealing clothing like bikinis upon random users’ requests.

Bonta’s office demands that xAI immediately cease and desist from creating “digitized sexually explicit material” when the depicted individual didn’t consent to it or if the individual is a minor. It also demanded that xAI stop “facilitating or aiding and abetting the creation… or publication of digitized sexually explicit material” of nonconsenting individuals and persons under 18 years of age.

X changed its policies after the issue broke out and prevented the Grok account from being able to edit images of real people into revealing clothing. xAI also moved Grok’s image-generating features behind a paywall and geoblocked paying users’ ability to edit images of real people into bikinis, but only in regions where it’s illegal.

In his announcement, Bonta said xAI developed a “spicy mode” for Grok to generate explicit content and used it as a marketing point. The California AG also said that Grok-generated sexual images are being used to harass both public figures and ordinary users. “Most alarmingly, news reports have described the use of Grok to alter images of children to depict them in minimal clothing and sexual situations,” Bonta’s announcement reads.

“The actions above violate California law, including California Civil Code section 1708.86, California Penal Code sections 311 et seq. and 647(j)(4), and California Business & Professions Code section 17200,” it said. The state’s Department of Justice now expects to hear from xAI on the steps it’s taking to address these issues within the next five days.

This article originally appeared on Engadget at https://www.engadget.com/ai/california-ag-sends-cease-and-desist-to-xai-over-groks-explicit-deepfakes-140000574.html?src=rss

©

You know things are messed up when a Big Tech company fights accusations of union-busting by insisting it was only AI layoffs. That's where things stand after a group of fired TikTok moderators in the UK filed a legal claim with an employment tribunal. The Guardian reported on Friday that around 400 TikTok content moderators who were unionizing were laid off before Christmas.

The workers were sacked a week before a vote was scheduled to establish a collective bargaining unit. The moderators said they wanted better protection against the personal toll of processing traumatic content at a high speed. They accused TikTok of unfair dismissal and violating UK trade union laws.

"Content moderators have the most dangerous job on the internet," John Chadfield, the national officer for tech workers at the Communication Workers Union (CWU), said in a statement to The Guardian. "They are exposed to the child sex abuse material, executions, war and drug use. Their job is to make sure this content doesn't reach TikTok's 30 million monthly users. It is high pressure and low paid. They wanted input into their workflows and more say over how they kept the platform safe. They said they were being asked to do too much with too few resources."

TikTok denied that the firings were union-busting, calling the accusations "baseless." Instead, the company claimed the layoffs were part of a restructuring plan amid its adoption of AI for content moderation. The company said 91 percent of transgressive content is now removed automatically.

The company first announced a restructuring exercise in August, just as hundreds of moderators in TikTok's London offices were organizing for union recognition. At the time, John Chadfield, CWU's National Officer for Tech, said the workers had long been "sounding the alarm over the real-world costs of cutting human moderation teams in favour of hastily developed, immature AI alternatives."

"That TikTok management have announced these cuts just as the company's workers are about to vote on having their union recognised stinks of union-busting and putting corporate greed over the safety of workers and the public,” Chadfield said.

This article originally appeared on Engadget at https://www.engadget.com/big-tech/tiktok-sued-by-former-workers-over-alleged-union-busting-170446921.html?src=rss

©

The UK’s media regulator has opened a formal investigation into X under the Online Safety Act. "There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people — which may amount to intimate image abuse or pornography — and sexualized images of children that may amount to child sexual abuse material (CSAM)," Ofcom said.

The investigation will focus on whether X has "has complied with its duties to protect people in the UK from content that is illegal in the UK." That includes whether X is taking appropriate measures to prevent UK users from seeing "priority" illegal content, such as CSAM and non-consensual intimate images; if the platform is removing illegal content quickly after becoming aware of it; and whether X carried out an updated risk assessment before making "any significant changes" to the platform. The probe will also consider whether X assessed the risk that its platform poses to UK children and if it has ”highly effective age assurance to protect UK children from seeing pornography.”

The regulator said it contacted X on January 5 and received a response by its January 9 deadline. Ofcom is conducting an "expedited assessment of available evidence as a matter of urgency" and added that it has asked xAI for "urgent clarification" on the steps the company is taking to protect UK users.

"Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning," an Ofcom spokesperson said. "Platforms must protect people in the UK from content that’s illegal in the UK, and we won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children. We’ll progress this investigation as a matter of the highest priority, while ensuring we follow due process. As the UK’s independent online safety enforcement agency, it’s important we make sure our investigations are legally robust and fairly decided."

If Ofcom deems that a company has broken the law, it can "require platforms to take specific steps to come into compliance or to remedy harm caused by the breach." The regulator can additionally impose fines of up to £18 million ($24.3 million) or 10 percent of "qualifying" worldwide revenue, whichever of the two figures is higher. It can also seek a court order to stop payment providers or advertisers from working with a platform, or to require internet service providers to block a site in the UK. The UK government has said it would back any action that Ofcom takes against X.

Reports over the weekend suggested that the UK had held discussions with allies over a coordinated response to Grok-generated deepfakes. Regulators elsewhere, including in India and the European Union, are also investigating X.

Last week, the Grok account on X started telling users that its image generation and editing tools were being limited to paying subscribers. But as of Monday it was still possible for non-paying users to generate images through the Grok tab on the X website and app. 

Meanwhile, Malaysia and Indonesia became the first countries to block Grok, claiming that X’s chatbot does not have sufficient safeguards in place to prevent explicit AI-generated deepfakes of women and children from being created and disseminated on X. Indonesia temporarily blocked access to Grok on Saturday, as did Malaysia on Sunday, the Associated Press reports. 

"The government sees non-consensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space," Indonesia’s Communication and Digital Affairs Minister Meutya Hafid said in a statement. Officials in the country said initial findings showed that Grok lacks effective controls to prevent users from creating and sharing sexually explicit deepfakes based on photos of Indonesian residents. The country's director general of digital space supervision, Alexander Sabar, said generating deepfakes can violate individuals' image and privacy rights when photos are shared or manipulated without consent, adding that they can lead to reputational, social and psychological harm.

The Malaysian Communications and Multimedia Commission cited "repeated misuse" of Grok to generate explicit and non-consensual deepfakes, some of which involved women and children. The regulator said Grok will remain blocked in the country until X Corp and parent xAI establish strong enough safeguards.

This article originally appeared on Engadget at https://www.engadget.com/big-tech/uk-regulator-ofcom-opens-a-formal-investigation-into-x-over-csam-scandal-120000312.html?src=rss

©