ChatGPT used for evil: Fake IT worker resumes, misinfo, and cyber-op assist

Fake IT workers possibly linked to North Korea, Beijing-backed cyber operatives, and Russian malware slingers are among the baddies using ChatGPT for evil, according to OpenAI's latest threat report. The AI giant said it quashed 10 operations using its chatbot to conduct social engineering and cyber snooping campaigns, generate spammy social media content, and even develop a multi-stage malware campaign targeting people and organizations around the globe. Four of the 10 campaigns were likely of Chinese origin, and OpenAI banned all of the ChatGPT accounts associated with the malicious activities. These included accounts linked to "multiple" fake IT worker campaigns, which used the language models to craft application materials for software engineering and other remote jobs. "While we cannot determine the locations or nationalities of the threat actors, their behaviors were consistent with activity publicly attributed to IT worker schemes connected to North Korea (DPRK)," the report said [PDF]. "Some of the actors linked to these recent campaigns may have been employed as contractors by the core group of potential DPRK-linked threat actors to perform application tasks and operate hardware, including within the US." In addition to using AI to create fake, US-based personas with fabricated employment histories (as has been previously documented by OpenAI and other researchers), some of the newer campaigns attempted to auto-generate resumes. Plus, OpenAI detected indicators of op...