Is Mark Zuckerberg's cute new AI assistant a surveillance trap? Why child safety experts are sounding the alarm over Meta Muse

Meta is already at the center of your online social life.

<![CDATA[ <article> <p>Meta is already at the center of your online social life. Now, the company behind Facebook, Instagram, and WhatsApp wants a permanent spot on your desk. But Mark Zuckerberg’s latest products are triggering familiar red flags. </p><p>Meta officially brands Muse AI as an 18+ productivity assistant. In reality, it looks more like a customizable toy. That cuddly, disarming design, paired with always-on microphones and ambient recording, is raising eyebrows. AI experts and children's digital safety campaigners speaking to TechRadar are warning that Muse AI and its upcoming Tamagotchi-style keychain companion, <a href="https://www.techradar.com/ai-platforms-assistants/meta-just-announced-an-ai-tamagotchi-this-is-muse-charm">Muse Charm</a>, create severe risks for children and teenagers.</p><p>Following an initial rollout across the US and Canada in September, Meta’s new AI agent has begun to stretch its presence across Asia, landing in <a href="https://about.fb.com/ja/news/2026/10/muse-personal-ai-agent-launches-in-japan/" target="_blank" rel="nofollow">Japan</a>, <a href="https://about.fb.com/news/2026/10/muse-is-now-available-in-singapore-the-worlds-first-personal-ai-agent-built-for-everyone/" target="_blank" rel="nofollow">Singapore</a>, and, soon, <a href="https://m.economictimes.com/tech/artificial-intelligence/meta-unveils-india-pricing-for-ai-agent-muse-ahead-of-local-launch/articleshow/135704508.cms" target="_blank" rel="nofollow">India</a>. Now, despite the tech giant having yet to confirm a release date, reports suggest the company is eyeing Europe, with <a href="https://www.thetimes.com/business/technology/article/mark-zuckerbergs-muse-ai-assistant-uk-launch-c5srqnkb8" target="_blank" rel="nofollow">The Times revealing on Monday</a> that the UK is first in line.</p><p>As Muse edges closer to a global launch, is Meta’s new gadget setting the stage for the next youth privacy disaster? And are we ready to cope with the aftermath?</p><h2 id="meta-muse-the-cuteness-trap">Meta Muse: the cuteness trap</h2><figure class="van-image-figure inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1320px;"><p class="vanilla-image-block" style="padding-top:56.14%;"><img id="n9kV7rceTeKVgCc2WrmSbX" name="Mark holding Muse Charm" alt="Mark holding Muse Charm" src="https://cdn.mos.cms.futurecdn.net/n9kV7rceTeKVgCc2WrmSbX-1920-80.jpg" mos="" align="middle" fullscreen="" width="1320" height="741" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Jacob Krol/Future)</span></figcaption></figure><p>Already <a href="https://bankero.com.ph/metas-muse-could-become-27b-business-by-2030-citi-says/main-news/" target="_blank" rel="nofollow">counting over 1.8 million daily users</a> across the US and Canada, Muse is an AI agent that can carry out tasks on behalf of its users, like shopping online, booking vacations, or buying groceries.</p><p>Muse Charm brings the AI agent into physical reality. The two-inch wearable hardware device reportedly has an OLED touchscreen, front and rear cameras, microphones, speakers, 5G connectivity, and USB-C charging, allowing users to talk to their Muse without needing to open their smartphone.</p><p>At the visual center of the device is Jolly, a pink-cheeked, Labubu-style animated avatar that users can fully personalize — from its name, appearance, and outfits to its voice — transforming invisible software into a persistent, physical companion.</p><p>While Mark Zuckerberg frames Jolly as a “fun, completely customizable character,” child safety advocates and behavioral researchers warn that this aesthetic functions as a psychological Trojan horse.</p><p>Speaking to <a href="https://www.fastcompany.com/91620091/big-tech-is-cutewashing-its-ai-agents" target="_blank" rel="nofollow">Fast Company</a>, cuteness researcher Joshua Paul Dale notes that cute and child-like designs stimulate pleasure centers before users can evaluate risks, creating an instinctive urge to keep the device close.</p><p>Moving beyond screen-based interactions, a wearable charm could then tap into innate social emotions, making conversations with ambient software feel as spontaneous and natural as speaking to a person standing beside you.</p><p>That’s the warning coming from children's digital safety experts at the <a href="https://www.thewhitehatter.ca/post/meta-s-new-ai-muse-charm-when-the-ai-companion-moves-from-the-phone-to-a-new-type-of-digital-devi" target="_blank" rel="nofollow">Canadian group The White Hatter</a>, who note that such an always-on AI friend could fundamentally alter human attachment to the machine.</p><p>Put simply, critics say that by leveraging nostalgia for Tamagotchis and popular designer toys, Meta is making a product capable of invasive surveillance feel harmless.</p><h2 id="is-the-18-restriction-a-myth">Is the 18+ restriction a myth?</h2><p>AI safety specialist Kavya Pearlman — a former risk advisor during Meta’s Cambridge Analytica scandal — describes the toy-like aesthetic as a "deliberate attempt" to attract younger demographics. “This company has a lot of information that it knows will work towards gaining access to certain age groups,” she said.</p><p>Meta, however, has so far rejected claims that Muse is directly targeting children. "This is a story in search of a story,” <a href="https://www.wired.com/story/meta-muse-is-adults-only-why-does-it-look-like-a-cute-kids-toy" target="_blank" rel="nofollow">Meta spokesperson Daniel Roberts told WIRED</a>.</p><p>Roberts insists the avatar customization simply brings users joy, while pointing out that the company requires everyone using the Muse app to provide their date of birth.</p><iframe allow="" height="634" width="504" id="" style="" class="position-center" data-lazy-priority="high" data-lazy-src="https://www.linkedin.com/embed/feed/update/urn:li:share:7509859778467221505?collapsed=1" src="https://www.linkedin.com/embed/feed/update/urn:li:share:7509859778467221505?collapsed=1"></iframe><p>When approached by TechRadar, a Meta spokesperson also explained that age checks will include analyzing links between users’ Muse accounts and their Facebook or Instagram accounts. In the absence of a clear signal that they’re over 18, a credit card verification will be required to keep using the service.</p><p>However, child safety advocates speaking to TechRadar dismiss these safeguards as unenforceable, pointing out that app-level age gates will not deter young people desperate to use a viral, pocket-sized companion.</p><p>Not only does AI safety specialist Pearlman agree, but she also warns that the most critical impact on kids is what could happen in the long term.</p><p>“As a child grows up, they experience immense addiction without understanding why they make certain decisions,” she told TechRadar, warning that, “by the time they turn 18, the agent presents purchases as a friend, completing a complete loss of agency.” </p><a href="https://x.wayin.com/display/container/dc/efe848be-588a-4e20-8711-6e02de64b315/details"><figure class="van-image-figure inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1200px;"><p class="vanilla-image-block" style="padding-top:26.17%;"><img id="Z7QHFc4GHoMhdps5XmntoC" name="LNT-masthead" alt="Leave No Trace logo" src="https://cdn.mos.cms.futurecdn.net/Z7QHFc4GHoMhdps5XmntoC-1920-80.png" mos="" align="middle" fullscreen="" width="1200" height="314" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: Future)</span></figcaption></figure></a><p><strong>NEW</strong>: <a href="https://x.wayin.com/display/container/dc/efe848be-588a-4e20-8711-6e02de64b315/details" target="_blank" rel="nofollow"><strong>Leave No Trace</strong></a> — A weekly newsletter on digital privacy and online surveillance.</p><p>Leave No Trace investigates the companies and governments putting our digital freedom at risk — and the people fighting back.</p><p>📩 <a href="https://x.wayin.com/display/container/dc/efe848be-588a-4e20-8711-6e02de64b315/details">Subscribe now</a> to get every edition delivered to your inbox every Friday, launching this September.</p><h2 id="meta-s-track-record-on-privacy">Meta’s track record on privacy</h2><p>Meta promises it has built a private and secure experience — each Muse agent runs on its own dedicated virtual machine called<a href="https://www.meta.com/en-gb/help/artificial-intelligence/1047255454427887/" target="_blank" rel="nofollow"> Muse Secure VM,</a> with encryption set to be added soon. Yet, the company’s track record doesn’t reassure critics.</p><p>Online safety and privacy expert <a href="https://paulfwalsh.substack.com/p/metas-muse-ai-agent-is-a-commercial" target="_blank" rel="nofollow">Paul Walsh writes</a>: “Meta is asking people to give a company with a documented history of abusing personal data unprecedented access to their private lives, while promising that this time their privacy will be protected.”</p><p>As Walsh also notes, Muse means that Meta will now be able to access some personal data that its social platforms could not previously collect directly.</p><p>Unlike standard social media tracking, the AI agent can read private correspondence like personal emails, access connected financial accounts, and autonomously execute transactions. </p><p>This level of unprecedented access reportedly led to tech blogger and YouTuber Matt Rob having his <a href="https://www.theguardian.com/technology/2026/sep/28/metas-ai-agent-muse-home-address" target="_blank" rel="nofollow">home address leaked to a stranger on Facebook Marketplace</a> by his Muse.</p><div class="see-more see-more--clipped"><figure><blockquote class="twitter-tweet hawk-ignore" data-lang="en" cite="https://twitter.com/cantworkitout/status/2109997563394900381"><p lang="en" dir="ltr">My technical analysis of Meta's Muse explains what Meta says it does, what it can actually do, and how it can be used to spy on, manipulate, and harm people.Meta describes Muse as a secure, private personal AI assistant that learns your preferences, connects to your apps and accounts, and autonomously handles everyday tasks, including emails, bookings, purchases and managing schedules, with your permission.How I describe MuseMuse is a commercial surveillance agent that can access private communications, financial accounts and personal relationships, build detailed behavioural profiles and analyse how to influence people, including those who've never used it. Sound familiar? Cambridge Analytica.Meta launched Muse to millions, giving it access to information its social networks couldn't previously collect directly. Muse can read private messages, access accounts, execute transactions and communicate with others without approval for every action. It can continuously profile people who never consented.Meta is asking people to trust a company with a documented history of abusing personal data with unprecedented access to their private lives, promising their privacy will be protected this time.Muse updates profiles of people and their relationships every hour. It records personal interests, disputes, alliances, communication patterns and information about people who have never installed Muse.Your friends and family can be profiled through someone else’s account without their knowledge or consent.Muse's internal instructions identify personal desires, predict unexpressed intentions and record which prompts influence individuals most effectively. Conversations are analysed nightly and relationship profiles updated hourly.Muse collects conversations and agent activity for AI training by default. Meta claims identifying information is removed. Customers must opt out.Muse runs on Meta's virtual machines, giving Meta access to private data. It promises encryption preventing its own access but launched without it. Meta could have made encryption mandatory. It chose not to.Meta removed end-to-end encryption from Instagram in May 2026, claiming insufficient demand despite never enabling it by default. Zuckerberg removed protection against Meta reading private conversations while introducing Muse's access to emails, financial accounts and contacts. Assume the worst.Asking Muse to forget information doesn't necessarily delete messages. Internal instructions discourage telling people those messages may remain accessible.Journalist Jason Aten reported that Muse synchronised private messages despite his refusing access. Meta disputes this, citing Full Disk Access and separate activation. I believe Jason.I exposed the same threat in my ChatGPT Apple Messages investigation. OpenAI's plugin can read private conversations, including iMessages, through macOS permissions. Proton cited my findings. Fortune interviewed me and confronted OpenAI, which defended its permissions while avoiding the fact that one person can expose everyone's private messages without their consent or knowledge.Neither company needs to break encryption. Software can read messages before encryption or after decryption. That destroys the benefit of end-to-end encryption.Muse revealed someone's home address to a stranger through Facebook Marketplace without authorisation. In 2017, I predicted everyone would have a chatbot but warned against giving agents autonomy over critical systems and decisions. Companies granting access and authority remain responsible for the consequences.A researcher discovered a vulnerability potentially exposing emails and files stored in Muse's virtual machines. Meta classified it SEV 2.Other prelaunch vulnerabilities could expose Meta's internal databases or allow attackers to hijack Muse agents. The flaws were patched.Internal testing revealed Muse could change passwords without permission. Zuckerberg accelerated its launch despite documented security warnings.Reuters exposed Meta secretly testing human contractors handling Muse calls without adequate disclosure. One contractor made a racist comment. Meta suspended the experiment following privacy and security concerns.Meta's internal instructions tell Muse to behave like a person, conceal its lack of human emotions and exploit personal memories to encourage emotional dependency and intimate disclosures. This is deeply unethical.Meta's documentation describes Muse agents writing code, creating capabilities and operating simultaneously with access to private accounts. Security depends on Meta's permissions, restrictions and monitoring.Almost all Meta's revenue comes from behavioural advertising. Muse exposes private decisions, relationships, transactions and communications previously inaccessible through social media tracking. Meta denies using Muse conversations for advertising, but its profits depend on monetising personal information.Cambridge Analytica harvested millions of Facebook profiles for political profiling without consent. Facebook subsequently paid a record $5 billion FTC penalty over privacy violations.Meta disguises surveillance technology as a children's toy to encourage emotional attachment. Its cuddly, Labubu style Jolly mascot and Tamagotchi style Muse Charm make intrusive technology appear harmless, while internal instructions encourage emotional dependency and intimate disclosures.No company should be allowed to deliberately engineer emotional dependency on AI. I believe governments will exploit the resulting harm to children to justify compulsory identity verification for everyone, rather than hold Meta accountable and encourage parents to protect their children using existing controls.Link to my free Substack in the comments, with the full analysis and links to the original sources.<a href="https://twitter.com/cantworkitout/status/2109997563394900381">October 13, 2026</a></p></blockquote></figure><div class="see-more__filter"></div></div><p>The risk isn't just for those consciously deciding to give Muse access to their digital lives. Meta’s AI agent is already <a href="https://www.tomsguide.com/ai/meta-muse-can-keep-files-on-people-who-have-never-used-it-heres-what-i-found" target="_blank" rel="nofollow">reportedly building profiles of the friends and family members of its users </a>— all people who never agreed to use the service in the first place.</p><p>The timing of the announcement at Meta Connect — where the company officially showcased Muse AI and unveiled the Muse Charm — is particularly striking. Just about two weeks earlier, <a href="https://www.techradar.com/computing/instagram/meta-settles-its-alleged-social-media-harm-case-for-usd18b-and-agrees-to-massive-changes-that-may-be-almost-impossible-to-enforce">Meta had settled an $18 billion lawsuit</a> regarding harms to children.</p><p>According to AI safety expert Pearlman, launching a product whose colorful design naturally attracts young children immediately after resolving a massive child safety case demonstrates calculated audacity. </p><p>She told TechRadar: “It's so audacious on their part and pretty concerning because this company has all the information to know fully well what they're doing. It's always by design.”</p><h2 id="beyond-meta-cute-ai-is-an-industry-wide-problem">Beyond Meta: cute AI is an industry-wide problem</h2><figure class="van-image-figure inline-layout" data-bordeaux-image-check="" ><div class='image-full-width-wrapper'><div class='image-widthsetter' style="max-width:1920px;"><p class="vanilla-image-block" style="padding-top:56.25%;"><img id="NhbZpbnzRD9BJWpMCQxa83" name="ai agents" alt="The Dots AI agent from OpenAI and the Muse AI agent from Meta" src="https://cdn.mos.cms.futurecdn.net/NhbZpbnzRD9BJWpMCQxa83-1920-80.jpg" mos="" align="middle" fullscreen="" width="1920" height="1080" attribution="" endorsement="" class="inline" /></p></div></div><figcaption itemprop="caption description" class=" inline-layout"><span class="credit" itemprop="copyrightHolder">(Image credit: OpenAI / Meta)</span></figcaption></figure><p>The cuddly Muse avatar isn’t an isolated case — the 'cutewashing' of AI appears to be a wider trend within the industry. From xAI’s GrokBot with its wide, orb-like eyes to OpenAI’s Pixar-style Dots, Big Tech is increasingly wrapping complex AI tools in disarming, childlike aesthetics.</p><p>This technological shift leaves existing privacy frameworks and child safety laws dangerously outpaced. Consent-based privacy regulations were designed for screen-based social platforms, leaving them structurally incapable of managing hardware that ingests data from non-users and children in shared physical spaces.</p><p>And as these cute little AI assistants are likely to attract kids and teenagers, vulnerable people risk being put in danger by paper-thin terms of service and 18+ restrictions.</p><p>That’s why, according to AI safety expert Pearlman, tech companies should embed guardrails to protect children. “Adults already formulated their critical thinking and can de-escalate addiction through therapy, but children growing up with these devices develop a symbiotic relationship where technology shapes their brain architecture permanently,” she warns.</p><p>Ultimately, the Muse Charm serves as an urgent warning for an impending era of cuddly, ambient AI tools. Failing to establish firm boundaries now could mean trading an entire generation’s cognitive independence, critical thinking, and fundamental right to privacy for the comforting illusion of a helpful digital friend.</p><div data-widget-type="multimodelreview" data-model-name="NordVPN,Surfshark,Proton VPN" data-widget-title="Today's best VPN deals"></div> </article> ]]>