{"id":642516,"date":"2023-04-28T10:06:08","date_gmt":"2023-04-28T15:06:08","guid":{"rendered":"https:\/\/news.sellorbuyhomefast.com\/index.php\/2023\/04\/28\/were-afraid-language-models-arent-modeling-ambiguity\/"},"modified":"2023-04-28T10:06:08","modified_gmt":"2023-04-28T15:06:08","slug":"were-afraid-language-models-arent-modeling-ambiguity","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2023\/04\/28\/were-afraid-language-models-arent-modeling-ambiguity\/","title":{"rendered":"We&#x27;re afraid language models aren&#x27;t modeling ambiguity"},"content":{"rendered":"<div id=\"content-inner\">\n<p>  [Submitted on 27 Apr 2023]<\/p>\n<p><a aria-describedby=\"download-button-info\" href=\"http:\/\/arxiv.org\/pdf\/2304.14399\">Download PDF<\/a><\/p>\n<blockquote><p>\n      <span>Abstract:<\/span>  Ambiguity is an intrinsic feature of natural language. Managing ambiguity is<br \/>\na key part of human language understanding, allowing us to anticipate<br \/>\nmisunderstanding as communicators and revise our interpretations as listeners.<br \/>\nAs language models (LMs) are increasingly employed as dialogue interfaces and<br \/>\nwriting aids, handling ambiguous language is critical to their success. We<br \/>\ncharacterize ambiguity in a sentence by its effect on entailment relations with<br \/>\nanother sentence, and collect AmbiEnt, a linguist-annotated benchmark of 1,645<br \/>\nexamples with diverse kinds of ambiguity. We design a suite of tests based on<br \/>\nAmbiEnt, presenting the first evaluation of pretrained LMs to recognize<br \/>\nambiguity and disentangle possible meanings. We find that the task remains<br \/>\nextremely challenging, including for the recent GPT-4, whose generated<br \/>\ndisambiguations are considered correct only 32% of the time in human<br \/>\nevaluation, compared to 90% for disambiguations in our dataset. Finally, to<br \/>\nillustrate the value of ambiguity-sensitive tools, we show that a multilabel<br \/>\nNLI model can flag political claims in the wild that are misleading due to<br \/>\nambiguity. We encourage the field to rediscover the importance of ambiguity for<br \/>\nNLP.<\/p>\n<\/blockquote><\/div>\n<div>\n<h2>Submission history<\/h2>\n<p> From: Alisa Liu [<a href=\"http:\/\/arxiv.org\/show-email\/1a76a841\/2304.14399\">view email<\/a>]<br \/>\n      <br \/><strong>[v1]<\/strong><br \/>\nThu, 27 Apr 2023 17:57:58 UTC (7,649 KB)<\/p>\n<\/div>\n<p><a href=\"https:\/\/arxiv.org\/abs\/2304.14399\" class=\"button purchase\" rel=\"nofollow noopener\" target=\"_blank\">Read More<\/a><br \/>\n Zonia Klemp<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[Submitted on 27 Apr 2023] Download PDF Abstract: Ambiguity is an intrinsic feature of natural language. Managing ambiguity is a key part of human language understanding, allowing us to anticipate misunderstanding as communicators and revise our interpretations as listeners. As language models (LMs) are increasingly employed as dialogue interfaces and writing aids, handling ambiguous language<\/p>\n","protected":false},"author":1,"featured_media":642517,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4105,46,2882],"tags":[],"class_list":{"0":"post-642516","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-language","8":"category-technology","9":"category-were"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/642516","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=642516"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/642516\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/642517"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=642516"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=642516"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=642516"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}