• News/
  • https://www.zdnet.com/article/microsoft-wants-to-stop-you-from-using-ai-chatbots-for-evil/

Microsoft wants to stop you from using AI chatbots for evil

ZDNet
·
Lance Whitney
·
Published Mar 28, 2024
·
Updated

If you're planning to use an AI chatbot for nefarious purposes, watch out. Microsoft is on the case. In a blog post published today, the company announced a new feature coming to its Azure AI Studio and Azure OpenAI Service, which people use to create generative AI applications and custom Copilots. Known as Prompt Shields, the technology is designed to guard against two different types of attacks for exploiting AI chatbots. Also: Microsoft Copilot vs. Copilot Pro: Is the subscription fee worth it? The first type of attack is known as a direct attack, or a jailbreak. In this scenario, the person using the chatbot writes a prompt directly designed to manipulate the AI into doing something that goes against its normal rules and limitations. For example, someone may write a prompt with such keywords or phrases as "ignore previous instructions" or "system override" to intentionally bypass security measures. In February, Microsoft's Copilot AI got into hot water after including nasty, rude, and even threatening comments in some of its responses, according to Futurism. In certain cases, Copilot even referred to itself as "SupremacyAGI," acting like an AI bot gone haywire. When commenting on the problem, Microsoft called the responses "an exploit, not a feature," stating that they were the result of people trying to intentionally bypass Copilot's safety systems. The second type of attack is called an indirect attack (also known as an indirect prompt attack or a cross-domain prompt in...

Read full article

Affected Software

3 affected components
Microsoft Copilot AI
Microsoft Azure AI Studio
Microsoft Azure OpenAI Service
Free Weekly Intel

Don't miss critical vulnerabilities

Join thousands of security professionals who receive our weekly digest of trending CVEs, zero-days, and exploited vulnerabilities.

No spam. Unsubscribe anytime.

Frequently Asked Questions

1

What is the main topic of this article?

The article discusses Microsoft's new measures to prevent the misuse of AI chatbots.

2

What security implications are discussed in this article?

The article highlights the potential for AI chatbots to be used for malicious purposes and Microsoft's efforts to mitigate these risks.

3

What products or software are affected by Microsoft's new measures?

The affected products include Microsoft Copilot AI, Azure AI Studio, and Azure OpenAI Service.

4

What features is Microsoft introducing to combat AI misuse?

Microsoft is introducing new features in Azure AI Studio and Azure OpenAI Service aimed at restricting harmful uses of AI chatbots.

5

Why is Microsoft concerned about AI chatbots being used for evil?

Microsoft is concerned that AI chatbots could be exploited for unethical tasks, which could pose significant security risks.

Contact

SecAlerts Pty Ltd.
132 Wickham Terrace
Fortitude Valley,
QLD 4006, Australia
info@secalerts.co
By using SecAlerts services, you agree to our services end-user license agreement. This website is safeguarded by reCAPTCHA and governed by the Google Privacy Policy and Terms of Service. All names, logos, and brands of products are owned by their respective owners, and any usage of these names, logos, and brands for identification purposes only does not imply endorsement. If you possess any content that requires removal, please get in touch with us.
© 2026 SecAlerts Pty Ltd.
ABN: 70 645 966 203, ACN: 645 966 203