❌

Lese-Ansicht

Anthropic Says Users Can't Be Needlessly Cruel to Claude

Anthropic today updated its usage policy (via The Verge) to bar users from subjecting Claude to "sustained and needless abusive or cruel behavior."


Anthropic says the abuse rule is meant to apply only in extreme cases, where users "repeatedly act cruelly" toward the AI models with "no discernible purpose." The rule does not apply to ordinary user frustration, pushback, dark creative themes, or model testing and research.

Claude models are already able to end such conversations with persistently abusive users, and ending the conversation will continue to be the main enforcement tool. When Claude ends a chat, no further messages can be sent in that conversation, but other chats are not affected.

Anthropic initially gave Claude the option to end a conversation in August 2025 while researching AI welfare. At the time, Anthropic said it was unsure whether Claude has moral status, but the company wanted low-cost ways to reduce risks to Claude. Anthropic found that Claude Opus 4 had a "robust and consistent aversion to harm." The model demonstrated a preference against dealing with dangerous tasks, apparent distress when speaking with users seeking abusive conversations, and a tendency to end harmful conversations when allowed to do so.

Anthropic's usage policy has been reorganized to bring together related clauses, and several other rules have changed.

  • Deceptive campaigns - A new section on deceptive campaigns aggregates rules against political and commercial fraud and disinformation, prohibiting fake reviews, astroturfing, fake sites, and bots acting as humans.

  • Elections - A narrower elections section prohibits deceiving voters and interfering with voting.

  • Weapons - Claude can't be used to develop weapons software or components, and a new rule bans modifying biological or chemical agents to increase lethality or transmissibility. Users are also prohibited from using Claude to arm drones and unmanned systems.

  • Law enforcement - Law enforcement rules have been rewritten. Claude can't decide or suggest who to investigate, arrest, charge, or prosecute. Tracking people without consent is not allowed, and there is a new ban on building surveillance tools. Doxxing is also prohibited.

  • Physical actions - A new section on physical actions says that if Claude is controlling hardware that could harm someone, a qualified person has to watch the work and be ready to stop it if needed.

  • Harmful content - There is a new rule that bans creating, sharing, or threatening to share non-consensual intimate imagery and the tools used to make it.


Most of the changes clarify Anthropic's existing rules and are targeted at misuse Anthropic has tracked. Anthropic says it found state media outlets, government propaganda offices, and commercial firms were using Claude to run networks of fake accounts and fabricated news sites, leading to the new deceptive campaigns section.

The new policy takes effect on November 12. More information on the changes can be found on Anthropic's website, as can the full usage policy.
This article, "Anthropic Says Users Can't Be Needlessly Cruel to Claude" first appeared on MacRumors.com

Discuss this article in our forums

  •  

Anthropic's Claude Comes to CarPlay

Anthropic added CarPlay integration to the Claude iOS app, which means Claude users can talk to Claude through their in-car infotainment systems.


Apple added support for third-party chatbots in ‌CarPlay‌ in iOS 26.4. Chatbot apps with ‌CarPlay‌ integration need to add support for a voice control screen, use Apple's designated ‌CarPlay‌ template, and get an entitlement from Apple. Claude can answer voice-based questions hands-free, but the chatbot won't be able to control vehicle or iPhone functions. Users also need to open the Claude app from the ‌CarPlay‌ interface because there is no support for third-party wake words.

The Claude app on ‌CarPlay‌ opens with a "Start a hands-free conversation" screen, with options to start a new chat or access recent chats. There are in-app controls for muting and unmuting and ending and resuming conversations, plus visual cues for when Claude is listening or talking.

‌CarPlay‌ has long supported third-party apps, but Apple has limited the kinds of apps that are available to prevent driving distractions. OpenAI added ‌CarPlay‌ support to the ChatGPT app earlier this year.

Update: This article was updated to note that the Claude ‌CarPlay‌ integration is live.
Related Roundup: CarPlay

This article, "Anthropic's Claude Comes to CarPlay" first appeared on MacRumors.com

Discuss this article in our forums

  •  

AI ≠ AI

From a pure AI perspective, nothing Apple showcased during their WWDC keynote yesterday was particularly groundbreaking. In fact, much of it featured capabilities long since available in other AI tools and services – in some cases, years ago. And guess what? That doesn’t matter. Based on what we saw yesterday, Apple is set to win in AI. At least from a consumer perspective.

M.G. Siegler | „Apple Wins Consumer AI By Default“

Siri AI landet mitten in eine Aufspaltung, die sich schon länger abzeichnet: die Unterscheidung zwischen „Consumer AI“ und „Business AI“.

Endkonsumenten zahlen nicht für Produktivität; anders als Firmen. Auch deshalb verschieben OpenAI und Anthropic ihre Prioritäten auf agentische Workflows. Der klassische Chat-Bot ist kein Geschäft mehr für sie.

Alleinstellungsmerkmal von Siri AI ist der persönliche Kontext, allerdings auch die bewusste Beteiligung und Einbindung der besagten Person.

Leute lieben es etwa, einzukaufen oder die Vorfreude auf eine (Urlaubs-)Entscheidung. Es ist nicht ausschließlich das Misstrauen, ob der Bot die richtige Wahl trifft, sondern der explizite Wunsch, mitzuwirken.

AI, die dabei unter die Arme greift, muss keinesfalls das allerletzte High-End-Modell sein. „Reasoning at Flash-level latency and scale“ wie Gemini 3.5 Flash ist dafür oft mehr als ausreichend. Insbesondere, weil Siri AI vorerst exklusiv auf Systemebene arbeitet und allein durch den Zugriff auf den persönlichen Suchindex mögliche Halluzinationen deutlich minimiert.

  •  
❌