As AI systems become more complex, the importance of stakeholders\u2019 input in decision-making will decrease unless a thoughtful design process is implemented. AI systems can create powerful momentum for businesses, but initial input influences whether a systems\u2019 impact will be positive or negative. For instance, ChatGPT\u2019s designers use\u00a0Reinforcement Learning from Human Feedback\u00a0(RLHF<\/a>) to train the agent to incorporate user feedback into future behavior. <\/p>\n As public feedback accumulates, we will see whether the RLHF approach is effective in addressing ethical issues raised about generative AI<\/a> systems.<\/p>\n Intelligent Security Summit On-Demand<\/span><\/p>\n Learn the critical role of AI & ML in cybersecurity and industry specific case studies. Watch on-demand sessions today.<\/span><\/p>\n<\/div>\n <\/body><\/p>\n Responsible leaders face a fundamental challenge: How do they build stakeholder inclusion and oversight into AI systems and processes? Current stakeholder engagement models exert higher leverage than they are likely to in the long term. <\/p>\n We propose a new way for leading organizations to design stakeholder engagement strategies that will be maximally inclusive and effective at this pivotal moment.<\/p>\n A broad spectrum exists between engaging employees or customers as\u00a0passive stakeholders\u00a0or as\u00a0decision-making partners. But it can be difficult to know where on that spectrum an audience is \u2014 or should be \u2014 at any given point.\u00a0<\/p>\n A model can help us break this spectrum down into observable steps. Consider the ladder model of stakeholder engagement \u2014 first proposed by housing policy analyst Sherry Arnstein<\/a> in 1969 and doubly relevant to our modern dilemma.\u00a0Arnstein\u2019s ladder was initially developed with a political lens, and we have updated it here to fit a business context.\u00a0<\/p>\n On Arnstein\u2019s ladder, stakeholder audiences sit with varying levels of power, from nonparticipation to shared control. At the lowest level, a misaligned decision-maker might provide minimal or inaccurate information to\u00a0manipulate\u00a0stakeholders or only address their emotional responses. Slightly better than this step is providing more thorough one-way flows of information or holding listening sessions with a token sample of stakeholder groups.\u00a0<\/p>\n Left: original stakeholder ladder model from\u00a0<\/em>Arnstein, 1969<\/em><\/a><\/p>\n Right: Ladder redesigned for executives in the age of automation<\/em><\/p>\n As AI systems become more powerful, they also become more complex when it comes to both their technical components and their interactions with other societal structures and systems. This increased complexity can make it difficult to understand and explain an AU system\u2019s inner workings and predict its potential effects on society. <\/p>\n Increasing AI capabilities can induce companies to engage stakeholders at lower levels \u2014 some intentionally and some unintentionally \u2014 so responsible stakeholder engagement will require swimming against this current.<\/p>\n Responsible stakeholder engagement is not only essential to inclusion; it also offers leadership accountability and reduced reputational risk. Inclusive stakeholder management attracts talent, assuages investors and boosts the trust organizations need to survive and grow.<\/p>\n To design and execute a stakeholder management strategy that moves audiences up Arnstein\u2019s ladder toward richer and more impactful engagement, leaders can assess their organizations\u2019 current positions on the ladder and design new strategies. We recommend following these four steps to achieve richer stakeholder engagement: select, educate, evaluate, and integrate.<\/p>\n With input from marketing, investor relations and human resources functions, leaders can closely examine their stakeholder audiences. In preparation for an upcoming decision or roll-out, they can consider what rung of the ladder to target for each group. This will allow them to build trust, reduce uncertainty and understand potential unintended consequences. <\/p>\n They can consider the cognitive diversity within each audience and incorporate \u201cinvisible\u201d stakeholders who will be critical to the organization\u2019s long-term success. This can include future talent, local communities and the environment. The goal of this exercise is not to bring in so many perspectives that decision-making becomes impossible, but rather to make stakeholder priorities explicit and avoid undesired outcomes.<\/p>\n Leaders need to be thoughtful about what level of stakeholder engagement before, during, and after the launch of new systems may be feasible. For example, stakeholder engagement is essential before <\/em>launching a content moderation system, but may be less impactful once the system has begun evaluating content at superhuman speed.<\/p>\n Stakeholder education has always been the first step toward receiving valuable input. This education becomes more important \u2014 and complex \u2014 when it comes to increasingly technology-enabled decisions. Insights from the field of behavioral design may help where clear frameworks exist that move people from \u201cAwareness\u201d to \u201cAlignment\u201d to \u201cAction\/Decision.\u201d<\/p>\n Explaining increasingly complicated, decision-relevant material to highly tailored audiences sounds daunting, and if done manually, may indeed prove prohibitively labor-intensive. Within the AI research community \u2014 a notoriously fast-moving field where it\u2019s increasingly difficult to keep up \u2014 researchers decided to try applying machine learning (ML) to the stakeholder education problem. <\/p>\n One promising technique is creating AI-generated<\/a> newsletters summarizing the field\u2019s latest updates. Organizations of all stripes can explore how ML can benefit stakeholder education (for example, by providing concise, timely materials that people can read comfortably and respond to from their phones). And yet, delivering increasingly complex materials to stakeholders requires designing the message itself. What do leaders tell stakeholders about their role in our decision-making? A few principles can guide us.<\/p>\n First, organizations can provide transparency about stakeholders\u2019 involvement in decisions. It can be easy for stakeholders to\u00a0overestimate<\/a>\u00a0their contribution, especially when digital tools are involved. Responsible leaders can gently\u00a0highlight\u00a0where individuals can provide input without\u00a0overstating\u00a0the impact the information will have.<\/p>\n Secondly, leaders are well-advised to reflect and often refer to their organization\u2019s purpose, mission and values. This practice can prevent value drift and inhibit short-sighted stakeholder engagement tactics that might dilute the relationship over time.\u00a0<\/p>\n Finally, carefully considering timing and approach prepares stakeholders for unexpected advances in AI capabilities. The roles that AI systems play in organizations have shifted radically over the past two years, and the public imagination struggles to keep up. Leading forecasters expect future capabilities to be unrecognizable three years from now. Leaders can invite stakeholders into the discovery process in such a rapid-fire environment and avoid setting expectations that \u201chumans do X, AI systems only do Y.\u201d<\/p>\n Instead of considering stakeholder groups as passive participants, it\u2019s worth considering that their interests and AI system<\/a> abilities are not always complementary. In the past, stakeholders have held power by providing decision-relevant information. With increasing system capabilities, they are no longer needed for the same functions and will have strong incentives to find ways to increase their relevance. <\/p>\n This tension makes the \u201cselection\u201d process of stakeholder engagement strategy delicate, as stakeholders may feel disenfranchised or eager to participate in decision-making.\u00a0<\/p>\n Once leaders have decided which stakeholders to engage at higher rungs of the ladder, they can use a \u201cred-teaming\u201d approach and attempt to poke as many holes in the strategy as possible. The following questions can help.<\/p>\n Finding hidden risks in a stakeholder management plan:<\/p>\n ChatGPT<\/a> solicits user feedback via upvote\/downvote, problem categorization, and an optional comment.\u00a0ChatGPT uses Reinforcement Learning from Human Feedback (RLHF) to improve its performance. RLHF involves providing the system with feedback in the form of positive and negative examples, which the system uses to train its model and improve its ability to make decisions and generate outputs.<\/em><\/p>\n After designing a plan and putting it into action, leaders will encounter a familiar next step: Wading through the reams of input to determine which is actionable and contextual, and which may be well-meaning but out of place. As they consider the channels that stakeholders use to communicate their perspectives and how their contributions will be synthesized, organizations can balance scalable inputs (like surveys) with direct communications where individuals are encouraged to engage more freely (like conversations).<\/p>\n Policymakers experience the challenges of integrating large volumes of feedback daily. In 2016, the British government sought<\/a>\u00a0to improve stakeholder engagement on climate change and other issues. These were problems with profound effects on everyday people who were typically relegated to the bottom of the stakeholder engagement ladder and rarely given a voice. To address this gap, the British government established the Irish Citizens Assembly<\/a> to solicit policy input from a small group of randomly selected citizens. <\/p>\n From selection to education, ensuring that the participants were demographically representative was a stakeholder management feat. But it was the integration piece that proved most challenging. Organizers struggled to cover complex topics in short amounts of time and became overwhelmed by the volume of public submissions. Then, they had to determine how much weight to give the policy reports, since the ordinary citizens hadn\u2019t been elected.<\/p>\n The result, though, was worth it. The assembly strengthened public faith in democracy during a time of intense polarization and fear, and the committee\u2019s report \u201cshaped to a significant degree<\/a>\u201d Ireland\u2019s groundbreaking climate action plan published shortly afterwards. It\u2019s an encouraging story for leaders looking to improve stakeholder representation related to complex, evolving problems associated with AI.<\/p>\n So far, we have discussed stakeholder experience from a single perspective: That of a leader deciding how to engage them. But leaders aren\u2019t limited to a single view, nor should they satisfy themselves with only one.\u00a0<\/p>\n Experimenting with different lenses can offer clarity when considering how to design stakeholders\u2019 experiences. We recommend these three.<\/p>\n UX<\/a> designers consider the individual stakeholder in a given audience. What tools are they interacting with to share their input? What is their experience navigating these tools, and how is their attention being directed?<\/p>\n Board game designers know that influencing individual behavior occurs in the context of group dynamics. How will someone\u2019s choices affect others in their cohort? How can tools (in this case, communications strategy or tactics) be designed to facilitate cooperation toward shared goals?<\/p>\n Macroeconomists consider the external environment. What broader political, social and demographic dynamics affect stakeholder management? This \u201cbig picture\u201d thinking isn\u2019t a replacement for considering individual and group experiences, but it is essential to identify factors that may have broad and lasting effects on leadership strategies.<\/p>\n Managing stakeholder engagement alongside increasingly powerful AI systems is like conducting an orchestra in a hurricane. As capabilities scale, more and more people will find themselves in the crosshairs of leaders\u2019 decisions and look to be heard. At the same time, a rapidly changing environment will push leaders to \u201cdecide first, explain later.\u201d Organizations must take action to combat these forces if they want to ensure that their stakeholder engagement remains meaningful and effective.<\/p>\n Before every system launch or step-change in capabilities, return to the ladder model with your goals in mind. Who will be a part of this decision, and to what extent? Who will be left behind? How can your organization\u2019s core purpose \u2014 its song, so to speak \u2014 come through loud and clear?<\/p>\n Acclaimed composer Darko Butorac<\/a> says it best. \u201cWhen conducting, your job is to create the illusion that your choices are true \u2014 to bring freshness to works that have been played thousands or millions of times and make it sound like an entirely new experience\u2026You\u2019re working with human beings, 80 to 100 musicians in an orchestra. You have to acknowledge their expertise, their passion, and their desire, and the audience is incredibly perceptive if something is clicking or not. Not just playing together but breathing music together.\u201d<\/p>\n By Abhishek Gupta, Steven Mills, Kes Sampanthar and Emily Dardaman<\/em>. <\/p>\n Welcome to the VentureBeat community!<\/p>\n DataDecisionMakers is where experts, including the technical people doing data work, can share data-related insights and innovation.<\/p>\n If you want to read about cutting-edge ideas and up-to-date information, best practices, and the future of data and data tech, join us at DataDecisionMakers.<\/p>\n You might even consider\u00a0contributing an article<\/a>\u00a0of your own!<\/p>\n Read More From DataDecisionMakers<\/a><\/p>\n<\/div><\/div>\nEvent<\/h3>\n
\n Watch Here <\/a>\n <\/p>\n<\/div>\nIntroducing the ladder model of stakeholder engagement<\/h2>\n
![](\"https:\/\/lh3.googleusercontent.com\/LSDVl6bFKLmmwcPUWPF3KY_a4GGodfahMxWI1MyF4A5-7QDEu9rLkOTZwaCQeR_obYevF8aBcd_hu6tRgwibK3Oyt6NIabNok4EFJLl7etDGPMbSdhk-iPFCJrXv0C2LsLfp38lri0kaA68Io_778-NAxlExw7kRVyThoc8jXAbP4rpLaLm18Qo9OPTFtIpkfe-4gtnC_w\")
Climbing the ladder<\/h2>\n
Selection<\/h3>\n
Education<\/h3>\n
Evaluation<\/h3>\n
\n
![](\"https:\/\/lh6.googleusercontent.com\/1rTu_6OCjGLtrfk04NJuIVhRGCFLF3OvD0EKi1x5XX2CD2W-Qc0SUVyP9hoZgJZMStBQlJW5EG7WLYS23_efKR-ScYy3MilgRoGgfNgn3C2p0MoWVm3JnuChWUJCfF9_Kws3E7lVDFa8wuEeNAJAR1R2kQZ03raLhajAXG9BQk8XIOnBiTTchDN5NrIiVT6cAUCgbQhDDQ\")
Integration<\/h3>\n
Stepping back: Considering individual and group experience<\/h2>\n
First-order thinking: Think like a UX designer<\/h3>\n
Second-order thinking: Think like a board game designer<\/h3>\n
Third-order thinking: Think like a macroeconomist<\/h3>\n
Bringing it all together<\/h2>\n
DataDecisionMakers<\/h3>\n
![](\"https:\/\/lh6.googleusercontent.com\/a01IbSe6m9VkhOOY83ubqBDfVLeY2-XErpQPuZrw8OjJBLGc3MDjPDJKcp7hC_Pvl48uzVFdvhMH6bt_Hm7n9Sh4xDc-ckesG-G1n1RBHWwu8iyj5fY2lZ2doaHD4wVENp760bkv8TDl3TME_QWWsjg4KbevP3wdW3awLxN9tSZEPyPCUWNcO6XtFuFTH7SqtkWyHkhEeA\")