Humans Are Reading Copilot Prompts — And They're Horrified

“Who is writing these prompts and who is deciding that basically generating porn is what Copilot is now focused on? It’s hard to take things seriously when my focus has to be what model generated the appropriate bust size or which middle aged woman was put in the appropriate sexually suggestive position,” one contractor said in the thread.

It's not surprising that people are asking Copilot and other AI tools to do things of dubious legality and morality. But it gets worse when humans are left to having to constantly view and judge the prompts and results.

Some of the Copilot contractors complained in the private forum about accepting “tasks” that they unknowingly contained explicit unsafe or even potentially illegal images. “I just came across an image set that consisted of eight upskirt photos,” the contractor wrote, while asking for superiors to add an unsafe content flag to the task. On the same thread, another contractor said they had seen images of “some sort of animal sacrifice,” and a third said they had seen prompts that were for sexual moves and positions.

That's horrible and I would hope Microsoft and other companies looking for content moderation and/or LLM reviewers put more focus on providing support for those who do the work.