<\/p>\n\n
Event<\/h3>\n
\n
Intelligent Security Summit On-Demand<\/span><\/p>\n
Learn the critical role of AI & ML in cybersecurity and industry specific case studies. Watch on-demand sessions today.<\/span><\/p>\n<\/div>\n

\n Watch Here <\/a>\n <\/p>\n<\/div>\n
<\/body><\/p>\n
That\u2019s because the most efficient and effective deployment mechanism for AI-driven human manipulation is through conversational AI<\/a>. And, over the last year, a remarkable AI technology called Large Language Models (LLMs) has rapidly reached a maturity level. This has suddenly made natural conversational interactions between targeted users and AI-driven software a viable means of persuasion, coercion, and manipulation<\/a>.\u00a0\u00a0<\/p>\n
Of course, AI technologies are already being used to drive influence campaigns<\/a> on social media platforms, but this is primitive compared to where the technology is headed.\u00a0That\u2019s because current campaigns, while described as \u201ctargeted,\u201d are more analogous to spraying buckshot at flocks of birds. This tactic directs a barrage of propaganda or misinformation at broadly defined groups in the hope that a few pieces of influence will penetrate <\/a>the community<\/a>, resonate among its members and spread across social networks<\/a>. <\/p>\n
This tactic is extremely dangerous and has caused real damage to society<\/a>, polarizing communities, spreading falsehoods and reducing trust in legitimate institutions. But it will seem slow and inefficient compared to the next generation of AI-driven influence methods that are about to be unleashed on society.\u00a0<\/p>\n
Real-time AI systems<\/h2>\n
I\u2019m referring to real-time AI systems designed to engage targeted users in conversational interactions and skillfully pursue influence goals with personalized precision. These systems will be deployed using euphemistic terms like Conversational Advertising<\/em><\/a>, Interactive Marketing, <\/em>Virtual Spokespeople<\/em><\/a>, Digital Humans <\/em>or simply AI Chatbots<\/em>. <\/p>\n
But whatever we call them, these systems have terrifying vectors for misuse and abuse. I\u2019m not talking about the obvious danger that unsuspecting consumers may trust the output of chatbots that were trained on data riddled with errors and biases. No, I\u2019m talking about something far more nefarious \u2014 the deliberate manipulation of individuals through the targeted deployment of agenda-driven conversational AI systems that persuade users through convincing interactive dialog. <\/p>\n
Instead of firing buckshot into broad populations, these new AI methods will function more like \u201cheat-seeking missiles\u201d that mark users as individual targets and adapt their conversational tactics in real time, adjusting to each individual personally as they work to maximize their persuasive impact.\u00a0\u00a0<\/p>\n
At the core of these tactics is the relatively new technology of LLMs, which can produce interactive human dialog in real time while also keeping track of the conversational flow and context. As popularized by the launch of ChatGPT in 2022, these AI systems are trained on such massive datasets that they are not only skilled at emulating human language<\/a>, but they have vast stores of factual knowledge, can make impressive logical inferences and can provide the illusion of human-like commonsense. <\/p>\n
When combined with real-time voice generation, such technologies will enable natural spoken interactions between humans and machines that are highly convincing, seemingly rational and surprisingly authoritative.\u00a0<\/p>\n
Emergence of digital humans<\/h2>\n
Of course, we will not be interacting with disembodied voices, but with AI-generated personas that are visually realistic. This brings me to the second rapidly advancing technology that will contribute to the AI Manipulation Problem: Digital humans. This is the branch of computer software aimed at deploying photorealistic simulated people that look, sound, move and make expressions so authentically that they can pass as real humans. <\/p>\n
These simulations can be deployed as interactive spokespeople<\/a> that target consumers through traditional 2D computing via video-conferencing and other flat layouts. Or, they can be deployed in three-dimensional immersive worlds using mixed reality<\/a> (MR) eyewear.\u00a0\u00a0<\/p>\n
While real-time generation of photorealistic humans seemed out of reach just a few years ago, rapid advancements in computing power, graphics engines and AI modeling techniques have made digital humans a viable near-term technology.\u00a0In fact, major software vendors are already providing tools to make this a widespread capability.\u00a0<\/p>\n
For example, Unreal recently launched an easy-to-use tool called Metahuman Creator<\/a>. This is specifically designed to enable the creation of convincing digital humans that can be animated in real-time for interactive engagement<\/a> with consumers.\u00a0Other vendors are developing similar tools.\u00a0<\/p>\n
Masquerading as authentic humans<\/h2>\n
When combined, digital humans and LLMs will enable a world in which we regularly interact with Virtual Spokespeople<\/a> (VSPs) that look, sound and act like authentic persons.\u00a0<\/p>\n
In fact, a 2022 study by researchers from Lancaster University and U.C. Berkeley demonstrated that users are now unable to distinguish between authentic human faces and AI-generated faces. Even more troubling, they determined that users perceived the AI-generated faces as \u201c more trustworthy<\/a>\u201d than real people. <\/p>\n
This suggests two very dangerous trends for the near future.\u00a0First, we can expect to engage AI-driven systems to be disguised as authentic humans, and we will soon lack the ability to tell the difference.\u00a0 Second, we are likely to trust disguised AI-driven systems more than actual human representatives.\u00a0<\/p>\n
Personalized conversations with AI<\/h2>\n
This is very dangerous, as we will soon find ourselves in personalized conversations<\/a> with AI-driven spokespeople that are (a) indistinguishable from authentic humans, (b) inspire more trust than real people, and (c) could be deployed by corporations or state actors to pursue a specific conversational agenda, whether it\u2019s to convince people to buy a particular product or believe a particular piece of misinformation.\u00a0<\/p>\n
And if not aggressively regulated, these AI-driven systems will also analyze emotions<\/a> in real-time using webcam feeds to process facial expressions, eye motions and pupil dilation \u2014 all of which can be used to infer emotional reactions throughout the conversation. <\/p>\n
At the same time, these AI systems will process vocal inflections, inferring changing feelings throughout a conversation. This means that a virtual spokesperson deployed to engage people in an influence-driven conversation will be able to adapt its tactics based on how they respond to every word it speaks, detecting which influence strategies are working and which are not. The potential for predatory manipulation through conversational AI is extreme.\u00a0<\/p>\n
Conversational AI: Perceptive and invasive<\/h2>\n
Over the years, I\u2019ve had people push back on my concerns about Conversational AI, telling me that human salespeople do the same thing by reading emotions and adjusting tactics \u2014 so this should not be considered a new threat. <\/p>\n
This is incorrect for a number of reasons. First, these AI systems will detect reactions that no human salesperson could perceive. For example, AI systems can detect not only facial expressions, but \u201c micro-expressions<\/a>\u201d that are too fast or too subtle for a human observer to notice, but which indicate emotional reactions \u2014 including reactions that the user is unaware of expressing or even feeling. <\/p>\n
Similarly, AI systems can read subtle changes in complexion known as \u201c blood flow patterns<\/a>\u201d on faces that indicate emotional changes no human could detect. And finally, AI systems can track subtle changes in pupil size and eye motions and extract cues about engagement, excitement and other private internal feelings. Unless protected by regulation, interacting with Conversational AI will be far more perceptive and invasive than interacting with any human representative.<\/p>\n
Adaptive and customized conversations<\/h2>\n
Conversational AI will also be far more strategic in crafting a custom verbal pitch. That\u2019s because these systems will likely be deployed by large online platforms that have extensive data profiles about a person\u2019s interests, views, background and whatever other details were compiled over time. <\/p>\n
This means that, when engaged by a Conversational AI system that looks, sounds and acts like a human representative, people are interacting with a platform that knows them better than any human would. In addition, it will compile a database of how they reacted during prior conversational interactions, tracking what persuasive tactics were effective on them and what tactics were not.\u00a0 <\/p>\n
In other words, Conversational AI systems will not only adapt to immediate emotional reactions, but to behavioral traits over days, weeks and years. They can learn how to draw you into conversation, guide you to accept new ideas, push your buttons to get you riled up and ultimately drive you to buy products you don\u2019t need and services you don\u2019t want. They can also encourage you to believe misinformation that you\u2019d normally realize was absurd.\u00a0This is extremely dangerous.\u00a0<\/p>\n
Human manipulation, at scale<\/h2>\n
In fact, the interactive danger of Conversational AI could be far worse than anything we have dealt with in the world of promotion, propaganda or persuasion using traditional or social media. For this reason, I believe regulators<\/a> should focus on this issue immediately, as the deployment of dangerous systems could happen soon. <\/p>\n
This is not just about spreading dangerous content \u2014 it is about enabling personalized human manipulation at scale.\u00a0We need legal protections that will defend our cognitive liberty<\/a> against this threat.\u00a0 <\/p>\n
After all, AI systems can already beat the world\u2019s best chess and poker players. What chance does an average person have to resist being manipulated by a conversational influence campaign that has access to their personal history, processes their emotions in real-time and adjusts its tactics with AI-driven precision? No chance at all.\u00a0<\/p>\n
Louis Rosenberg is founder of Unanimous AI<\/a> and has been awarded more than 300 patents for VR, AR, and AI technologies.<\/em><\/p>\n
\n
DataDecisionMakers<\/h3>\n
Welcome to the VentureBeat community!<\/p>\n
DataDecisionMakers is where experts, including the technical people doing data work, can share data-related insights and innovation.<\/p>\n
If you want to read about cutting-edge ideas and up-to-date information, best practices, and the future of data and data tech, join us at DataDecisionMakers.<\/p>\n
You might even consider\u00a0 contributing an article<\/a>\u00a0of your own!<\/p>\n
Read More From DataDecisionMakers<\/a><\/p>\n<\/div><\/div>\n
Read More<\/a>
\n Louis Rosenberg, Unanimous A.I.<\/p>\n","protected":false},"excerpt":{"rendered":"
When researchers contemplate the risks that AI poses to human civilization, we often reference the \u201ccontrol problem.\u201d This refers to the possibility that an artificial super-intelligence could emerge that is so much smarter than humans that we quickly lose control over it.\u00a0The fear is that a sentient AI with a super-human intellect could pursue goals<\/p>\n","protected":false},"author":1,"featured_media":604890,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4646,30805,46],"tags":[],"class_list":{"0":"post-604889","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-danger","8":"category-profound","9":"category-technology"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/604889","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=604889"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/604889\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/604890"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=604889"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=604889"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=604889"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}