{"id":852370,"date":"2025-05-31T04:11:54","date_gmt":"2025-05-31T09:11:54","guid":{"rendered":"https:\/\/newsycanuse.com\/index.php\/2025\/05\/31\/the-download-sycophantic-llms-and-the-ai-hype-index\/"},"modified":"2025-05-31T04:11:54","modified_gmt":"2025-05-31T09:11:54","slug":"the-download-sycophantic-llms-and-the-ai-hype-index","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2025\/05\/31\/the-download-sycophantic-llms-and-the-ai-hype-index\/","title":{"rendered":"The Download: sycophantic LLMs, and the AI Hype Index"},"content":{"rendered":"<div>\n<div>\n<p>Back in April, OpenAI announced it was rolling back an update to its GPT-4o model that made ChatGPT\u2019s responses to user queries too sycophantic.<\/p>\n<p>An AI model that acts in an overly agreeable and flattering way is more than just annoying. It could reinforce users\u2019 incorrect beliefs, mislead people, and spread misinformation that can be dangerous\u2014a particular risk when increasing numbers of young people are using ChatGPT as a life advisor. And because sycophancy is difficult to detect, it can go unnoticed until a model or update has already been deployed.<\/p>\n<p>A new benchmark called Elephant that measures the sycophantic tendencies of major AI models could help companies avoid these issues in the future. But just knowing when models are sycophantic isn\u2019t enough; you need to be able to do something about it. And that\u2019s trickier. <a href=\"https:\/\/www.technologyreview.com\/2025\/05\/30\/1117551\/this-benchmark-used-reddits-aita-to-test-how-much-ai-models-suck-up-to-us\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">Read the full story<\/a>.<\/p>\n<\/div>\n<p><em>\u2014Rhiannon Williams<\/em><\/p>\n<p><strong>The AI Hype Index<\/strong><\/p>\n<p>Separating AI reality from hyped-up fiction isn\u2019t always easy. That\u2019s why we\u2019ve created the AI Hype Index\u2014a simple, at-a-glance summary of everything you need to know about the state of the industry. <a href=\"https:\/\/www.technologyreview.com\/2025\/05\/28\/1117468\/ai-hype-index-college-students-chatgpt-meta-apple-anthropic-grok\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">Take a look at this month\u2019s edition of the index here<\/a>.<\/p>\n<p><strong>The must-reads<\/strong><\/p>\n<p><em>I\u2019ve combed the internet to find you today\u2019s most fun\/important\/scary\/fascinating stories about technology.<\/em><\/p>\n<\/p><\/div>\n<div>\n<div>\n<p><strong>1 Anduril is partnering with Meta to build an advanced weapons system<\/strong><br \/>EagleEye\u2019s VR headsets will enhance soldiers\u2019 hearing and vision. (<a href=\"https:\/\/www.wsj.com\/tech\/meta-army-vr-headsets-anduril-palmer-luckey-142ab72a?st=AFcxj5&#038;reflink=desktopwebshare_permalink\">WSJ<\/a> $)<br \/>+ <em>Palmer Luckey wants to turn \u201cwarfighters into technomancers.\u201d <\/em>(<a href=\"https:\/\/techcrunch.com\/2025\/05\/29\/in-a-victory-for-palmer-luckey-meta-and-anduril-work-on-mixed-reality-headsets-for-the-military\/\">TechCrunch<\/a>)<br \/>+ <em>Luckey and Mark Zuckerberg have buried the hatchet, then. <\/em>(<a href=\"https:\/\/www.businessinsider.com\/zuckerberg-luckey-end-feud-develop-ai-powered-military-tech-2025-5\">Insider<\/a> $)<br \/>+ <em>Palmer Luckey on the Pentagon\u2019s future of mixed reality. <\/em>(<a href=\"https:\/\/www.technologyreview.com\/2024\/10\/28\/1106265\/palmer-luckey-on-the-pentagons-future-of-mixed-reality\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">MIT Technology Review<\/a>)<\/p>\n<p><strong>2 A new Texas law requires app stores to verify users\u2019 ages<br \/><\/strong>It\u2019s following in Utah\u2019s footsteps, which passed a similar bill in March. (<a href=\"https:\/\/www.nytimes.com\/2025\/05\/27\/technology\/apple-google-age-verification-apps-texas.html\">NYT<\/a> $)<br \/>+ <em>Apple has pushed back on the law. <\/em>(<a href=\"https:\/\/edition.cnn.com\/2025\/05\/28\/tech\/texas-apple-google-app-store-age-verification-law\">CNN<\/a>)<\/p>\n<p><strong>3 What happens to DOGE now?<\/strong><br \/>It has lost its leader and a top lieutenant within the space of a week. (<a href=\"https:\/\/www.wsj.com\/politics\/policy\/elon-musk-leaves-trump-next-df990095?mod=tech_lead_pos3\">WSJ<\/a> $)<br \/>+ <em>Musk\u2019s departure raises questions over how much power it will wield without him. <\/em>(<a href=\"https:\/\/www.theguardian.com\/technology\/2025\/may\/29\/elon-musk-trump-doge-adviser-exit\">The Guardian<\/a>)<br \/>+ <em>DOGE\u2019s tech takeover threatens the safety and stability of our critical data. <\/em>(<a href=\"https:\/\/www.technologyreview.com\/2025\/04\/14\/1114988\/doges-tech-takeover-threatens-the-safety-and-stability-of-our-critical-data\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">MIT Technology Review<\/a>)<\/p>\n<\/div>\n<p><strong>4 NASA\u2019s ambitions of a 2027 moon landing are looking less likely<\/strong><br \/>It needs SpaceX\u2019s Starship, which keeps blowing up. (<a href=\"https:\/\/www.washingtonpost.com\/science\/2025\/05\/29\/spacex-starship-launch-nasa-moon-landing\/\">WP<\/a> $)<br \/>+ <em>Is there a viable alternative? <\/em>(<a href=\"https:\/\/www.newscientist.com\/article\/2482339-will-spacexs-starship-rocket-ever-work-and-what-if-it-doesnt\/\">New Scientist<\/a> $)<\/p>\n<p><strong>5 Students are using AI to generate nude images of each other<\/strong><br \/>It\u2019s a grave and growing problem that no one has a solution for. (<a href=\"https:\/\/www.404media.co\/no-one-knows-how-to-deal-with-student-on-student-ai-csam\/\">404 Media<\/a>)<\/p>\n<p><strong>6 Google AI Overviews doesn\u2019t know what year it is<br \/><\/strong>A year after its introduction, the feature is still making obvious mistakes. (<a href=\"https:\/\/www.wired.com\/story\/google-ai-overviews-says-its-still-2024\/\">Wired<\/a> $)<br \/>+ <em>Google\u2019s new AI-powered search isn\u2019t fit to handle even basic queries. <\/em>(<a href=\"https:\/\/www.nytimes.com\/2025\/05\/29\/technology\/personaltech\/google-ai-mode-search.html\">NYT<\/a> $)<br \/>+ <em>The company is pushing AI into everything. Will it pay off? <\/em>(<a href=\"https:\/\/www.vox.com\/technology\/414673\/google-search-ai-mode-chatgpt-gemini\">Vox<\/a>)<br \/>+ <em>Why Google\u2019s AI Overviews gets things wrong. <\/em>(<a href=\"https:\/\/www.technologyreview.com\/2024\/05\/31\/1093019\/why-are-googles-ai-overviews-results-so-bad\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">MIT Technology Review<\/a>)<\/p>\n<p><strong>7 Hugging Face has created two humanoid robots <\/strong><strong>????<\/strong><strong><br \/><\/strong>The machines are open source, meaning anyone can build software for them. (<a href=\"https:\/\/techcrunch.com\/2025\/05\/29\/hugging-face-unveils-two-new-humanoid-robots\/\">TechCrunch<\/a>)<\/p>\n<p><strong>8 A popular vibe coding app has a major security flaw<br \/><\/strong>Despite being notified about it months ago. (<a href=\"https:\/\/www.semafor.com\/article\/05\/29\/2025\/the-hottest-new-vibe-coding-startup-lovable-is-a-sitting-duck-for-hackers\">Semafor<\/a>)<br \/>+ <em>Any AI coding program catering to amateurs faces the same issue. <\/em>(<a href=\"https:\/\/www.theinformation.com\/articles\/downsides-vibe-coding?rc=e7vxeu\">The Information<\/a> $)<br \/>+ <em>What is vibe coding, exactly? <\/em>(<a href=\"https:\/\/www.technologyreview.com\/2025\/04\/16\/1115135\/what-is-vibe-coding-exactly\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">MIT Technology Review<\/a>)<\/p>\n<p><strong>9 AI-generated videos are becoming way more realistic<\/strong><br \/>But not when it comes to depicting gymnastics. (<a href=\"https:\/\/arstechnica.com\/ai\/2025\/05\/ai-video-just-took-a-startling-leap-in-realism-are-we-doomed\/\">Ars Technica<\/a>)<\/p>\n<p><strong>10 This electronic tattoo measures your stress levels<\/strong><br \/>Consider it a mood ring for your face. (<a href=\"https:\/\/spectrum.ieee.org\/electronic-tattoo\">IEEE Spectrum<\/a>)<\/p>\n<\/p><\/div>\n<div>\n<p><strong>Quote of the day<\/strong><\/p>\n<p><strong>\u201cI think finally we are seeing Apple being dragged into the child safety arena kicking and screaming.\u201d<\/strong><\/p>\n<p>\u2014Sarah Gardner, CEO of child safety collective Heat Initiative, tells <a href=\"https:\/\/www.washingtonpost.com\/politics\/2025\/05\/29\/texas-age-verification-social-media-ban\/\">the Washington Post<\/a> why Texas\u2019 new app store law could signal a turning point for Apple.<\/p>\n<p><strong>One more thing<\/strong><\/p>\n<figure><a href=\"https:\/\/www.technologyreview.com\/2022\/04\/13\/1049227\/house-flipping-algorithms-are-coming-to-your-neighborhood\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*|SUBCLASS|*&#038;utm_content=*|DATE:m-d-Y|*\"><img decoding=\"async\" src=\"https:\/\/wp.technologyreview.com\/wp-content\/uploads\/2022\/04\/CD_2010_0322_0528.jpeg?fit=2560,1706\" alt><\/a><\/figure>\n<div>\n<p><strong>House-flipping algorithms are coming to your neighborhood<\/strong>When Michael Maxson found his dream home in Nevada, it was not owned by a person but by a tech company, Zillow. When he went to take a look at the property, however, he discovered it damaged by a huge water leak. Despite offering to handle the costly repairs himself, Maxson discovered that the house had already been sold to another family, at the same price he had offered.<\/p>\n<p>During this time, Zillow lost more than $420 million in three months of erratic house buying and unprofitable sales, leading analysts to question whether the entire tech-driven model is really viable. For the rest of us, a bigger question remains: Does the arrival of Silicon Valley tech point to a better future for housing or an industry disruption to fear? <a href=\"https:\/\/www.technologyreview.com\/2022\/04\/13\/1049227\/house-flipping-algorithms-are-coming-to-your-neighborhood\/?utm_source=the_download&#038;utm_medium=email&#038;utm_campaign=the_download.unpaid.engagement&#038;utm_term=*%7CSUBCLASS%7C*&#038;utm_content=*%7CDATE:m-d-Y%7C*\">Read the full story<\/a>.<\/p>\n<\/div>\n<p><em>\u2014Matthew Ponsford<\/em><\/p>\n<\/p><\/div>\n<p><a href=\"https:\/\/www.technologyreview.com\/2025\/05\/30\/1117620\/the-download-sycophantic-llms-and-the-ai-hype-index\/\" class=\"button purchase\" rel=\"nofollow noopener\" target=\"_blank\">Read More<\/a><br \/>\n Rhiannon Williams<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Back in April, OpenAI announced it was rolling back an update to its GPT-4o model that made ChatGPT\u2019s responses to user queries too sycophantic. An AI model that acts in an overly agreeable and flattering way is more than just annoying. It could reinforce users\u2019 incorrect beliefs, mislead people, and spread misinformation that can be<\/p>\n","protected":false},"author":1,"featured_media":852371,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[24097,144303,46],"tags":[],"class_list":["post-852370","post","type-post","status-publish","format-standard","has-post-thumbnail","category-download","category-sycophantic","category-technology"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/852370","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=852370"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/852370\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/852371"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=852370"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=852370"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=852370"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}