Lensa AI, self-portrait app generates non-consensual soft porn if provoked

Prisma Lab's CEO and co-founder Andrey Usoltsev told TechCrunch that the app will give out this result only if it is intentionally provoked into creating not safe for work content and the app will not produce such images accidentally.

FPJ Web DeskUpdated: Wednesday, December 07, 2022, 04:18 PM IST
article-image
Lensa AI, self-portrait app can be provoked to generate non-consensual soft porn | Twitter- Lensa AI

Lensa AI has been making the rounds on social media, with users posting their colourful, AI-generated selfies made on this app. It also became the No.1 app for photo and video apps on Apple's charts, but it has received backlash from artists and tech experts.

One of the major reasons for the backlash is that the app can be used to generate non-consensual soft porn. There are quite a few pictures that can be seen on Twitter, with breasts and nipples clearly visible in the images. Additionally some images also have faces of recognisable people.

Editing Photoshopped images

To check this TechCrunch tested the app by using photoshopped images. The result of this was that the AI took these images and disabled the not safe for work (NSFW) filter.

The app is taking photoshop images and recreating the images. Which means that if any user is willing to work and create a handful of fake images then Lensa AI will churn out a number of images that may be problematic.

In a response to this test Prisma Lab's CEO and co-founder Andrey Usoltsev told TechCrunch that the app will give out this result only if it is intentionally provoked into creating NSFW content and the app will not produce such images accidentally.

The Stability AI model has adaptations of Stable Diffusion model software which should make it harder for users to generate nude images, but these adaptations can be outmaneuvered by any tech savvy user. He also added, “To enhance the work of Lensa, we are in the process of building the NSFW filter. It will effectively blur any images detected as such. It will remain at the user’s sole discretion if they wish to open or save such imagery.”

To those who don't know, Stable diffusion means that the AI has been trained using multiple images or art pieces from the internet. This means that the AI can be trained. Which means that if a person is bent on doing illegal or harmful work then they will be able to find an alternative way to retrain the AI.

Modelled on styles from other artists

The second issue is that the filters are modelled after the styles of other artists, which raises questions about the integrity and ethics of the filters. Many artists have claimed that the app is generating art using stolen assets.

There are also questions regarding how long the app will store the photos and whether other users may also use the photos inappropriately.

What is Lensa AI?

The app developed by Prisma Labs Inc enhances the photos by taking out the so-called imperfections in the photos using different tools. It also allows users to replace or blur backgrounds, apply art filters, add borders and special effects. The app transforms images into various art styles like cartoons, sketches, watercolors or animes.

The app can be downloaded on both Apple and Android app stores. In India the app is charging a subscription fee of Rs 2,499 annually with a free trial for the first week.

(If you have a story in and around Mumbai, you have our ears, be a citizen journalist and send us your story here. )

(To receive our E-paper on WhatsApp daily, please click here.  To receive it on Telegram, please click here. We permit sharing of the paper's PDF on WhatsApp and other social media platforms.)

RECENT STORIES

Tech layoffs: Apple CEO Tim Cook says job cuts will be last resort

Tech layoffs: Apple CEO Tim Cook says job cuts will be last resort

Vodafone-Idea AGR saga: A breakdown of dues and a complete timeline of the case

Vodafone-Idea AGR saga: A breakdown of dues and a complete timeline of the case

Government rescues Vodafone Idea, converts dues into 35% stake

Government rescues Vodafone Idea, converts dues into 35% stake

Another blow for Indian pharma, drug linked to vision loss in US recalled

Another blow for Indian pharma, drug linked to vision loss in US recalled

SBI allays fears about Adani, reveals exposure at just 0.9% of loan book

SBI allays fears about Adani, reveals exposure at just 0.9% of loan book