Wednesday, November 6, 2024

iPhone users are creating X-RATED emoji with Apple’s new Genmoji tool – as one jokes ‘this will be censored soon, mark my words’

Must read

It was inevitable that letting people make emoji on demand would lead to a few inappropriate creations.

But as Apple’s Genmoji tool rolls out in beta, it seems the company may have underestimated its customers’ creativity.

Since its release, iPhone users have already started using the AI tool to flood social media with their X-rated creations.

Despite Apple’s safeguards, users’ ‘diabolical’ creations already include everything from guns and drugs to some very suggestive eggplants.

Genmoji allows users to generate custom emoji on their iPhones to share with their friends by providing simple text descriptions.

In some cases, users have had to use their imagination to trick the AI into generating exactly what they are after.

However, a few users report that simply inputting ‘gun’ or ‘weed’ into the search engine has been enough to generate the offending emoji.

Sensing that Apple won’t be too happy with this development, one social media commenter wrote: ‘This will be censored soon, mark my words.’ 

A month after Genmoji was released in beta, iPhone users have been flooding the internet with their X-rated emoji

On X, one commenter shared their Genmoji creation with the caption: 'The power Genmoji gave me'

On X, one commenter shared their Genmoji creation with the caption: ‘The power Genmoji gave me’

The new Genmoji tool lets users create custom emoji but iPhone users have been quick to find ways to trick the system into making inappropriate and suggestive images

The new Genmoji tool lets users create custom emoji but iPhone users have been quick to find ways to trick the system into making inappropriate and suggestive images 

Genmoji is due to be released to the public as part of iOS 18.2 in the coming months but has been made available to developers as part of a beta test.

The AI image-generation system has been built with restrictions to stop users from creating anything too offensive or suggestive.

However, as with almost any AI tool, users were very quick to find ways around those safeguards.

For example, users found asking for images involving ‘aubergines’ would yield an error message saying: ‘No Results – Try describing something different to create a new emoji’.

But determined degenerates soon discovered Gemoji was more than happy to oblige users’ requests for an emoji containing an ‘eggplant’ instead.

In a post on X, formerly Twitter, one iPhone user shared a screenshot of their Genmoji made with the prompt ‘eggplant with water squirting out’.

Sharing their own eggplant emoji on Reddit, one user wrote: ‘I could get used to this.’

Other similarly suggestive examples shared on social media show eggplant and peach emojis being held, licked, eaten and doused in all manner of unspecified fluids.

Social media users found that requests for 'aubergine' emoji were blocked but that Genmoji had no issue making requests for emoji featuring 'eggplants' instead

Social media users found that requests for ‘aubergine’ emoji were blocked but that Genmoji had no issue making requests for emoji featuring ‘eggplants’ instead 

Some social media users have lamented that it won't be long before Apple cracks down on their ability to create X-rated custom emoji

Some social media users have lamented that it won’t be long before Apple cracks down on their ability to create X-rated custom emoji 

Users were surprised how easily they were able to make emoji show cannabis leaves with some creating the symbols by simply searching for 'weed'

Users were surprised how easily they were able to make emoji show cannabis leaves with some creating the symbols by simply searching for ‘weed’ 

Sharing an image on X, one commenter joked that this was a product of ‘the power Genmoji gave me’.

iPhone users have also been quick to share their top tips for getting around the new system’s restrictions.

One commenter wrote: ‘Most of the time you can just type it straight in. Otherwise, you have to get creative and trick it into putting ‘white sauce’ on top of a peach.’

While another joked: ‘The second I saw this announced at WWDC I knew it was just going to be an arms race to see what the most absolutely diabolical thing you can get it to generate is.’

While some of the X-rated combinations have required a little creativity to generate, some have been surprisingly simple.

For example, iPhone users were shocked that they could get Genmoji to create an image of a handgun simply by entering ‘gun’.

Another user said they were able to get Genmoji to create a realistic rifle by entering the term ‘hunting gear’.

This is particularly surprising considering that Apple had previously removed the gun emoji on iOS by replacing it with a plastic water pistol.

Although Apple previously removed the gun emoji, iPhone users found they could make new gun emoji in Genmoji

One user was able to avoid Apple's restrictions by requesting 'hunting gear' (pictured)

Although Apple removed previously removed the gun emoji, iPhone users found they could make new firearms emoji by typing ‘gun’ (left) or ‘hunting gear’ (right) 

iPhone users have been making fun condom emojis within the new AI generation app

One iPhone owner used Genmoji to make an image resembling the recreational party drug 'poppers' (top right)

Users have also been able to generate other items such as condoms (left) and bottles resembling the recreational party drug ‘poppers’ (right)

Similarly, one user reported that they were able to generate an emoji closely resembling a cannabis leaf by requesting ‘weed’.

Other iPhone users have shared images of Genmoji created to resemble poppers, a recreational party drug, as well as cigarettes and condoms.

Some clever users have also made use of Genmoji’s picture function to create emoji of well-known public figures and politicians. 

The AI image-generator lets users create emoji from their contact’s associated pictures by typing their name into the Genmoji description field.

However, as one X user found, by making a fake contact using an image of a celebrity iPhone, users can easily make Genmoji of anyone they want.

On X, a user shared how they were able to make an emoji of Joe Biden eating an ice cream and Donald Trump crying.

But as users share their exploits online, others questioned how long it would be before Apple cracked down on these loopholes.

On Reddit, one user wrote: ‘By the time the rest of us get access, this will be long gone if people post about it.’

Genmoji lets users make emoji of their friends from their associated contact page, a trick that some users have been exploiting to make images of politicians like Trump

By adding a fake contact for Joe Biden, it is easy to create Genmoji of the US President

One user even managed to trick Genmoji into creating images of Donald Trump (left) and Joe Biden (right) by creating fake contact pages using the politicians’ pictures 

‘I think that’s why it’ll be in beta for a long time so Apple can try to block as much of it as they can before release,’ added another.

While one iPhone user joked: ‘Don’t let Apple engineers know this lmao.’

It is not yet clear whether the emoji generated in the beta will be usable after the public release or how strict Apple’s final restrictions will be.

iOS 18.2 is not expected to roll out until late December at the earliest along with other AI features such as Image Playground.

The staggered release is meant to give Apple more time to fine-tune its new products but it could also give them plenty of time to crack down on these user-generated shenanigans.

MailOnline has contacted Apple for comment.  

Latest article