{"id":1734,"date":"2018-12-17T13:27:36","date_gmt":"2018-12-17T18:27:36","guid":{"rendered":"http:\/\/coevolving.com\/blogs\/?p=1734"},"modified":"2018-12-17T18:32:50","modified_gmt":"2018-12-17T23:32:50","slug":"artificial-intelligence-natural-stupidity","status":"publish","type":"post","link":"https:\/\/coevolving.com\/blogs\/artificial-intelligence-natural-stupidity\/","title":{"rendered":"Artificial intelligence, natural stupidity"},"content":{"rendered":"<p>Psychologist <a href=\"https:\/\/news.stanford.edu\/pr\/96\/960605tversky.html\">Amos Tversky<\/a>, with <a href=\"https:\/\/scholar.princeton.edu\/kahneman\">Daniel Kahneman<\/a>, collaborated not on <em>artificial intelligence<\/em>, but on the study of\u00a0<em>natural stupidity<\/em>.\u00a0 Their <a href=\"#tversky-kahneman-1974-judgment\">research into cognitive biases<\/a> eventually became recognized in an emerging field of <a href=\"#kahneman-2003-maps\">behavioral economics<\/a>.\u00a0 In hindsight, I can claim to have <a href=\"#1984-UBC-transcript-DavidIng-PhD-studies\">received an &#8220;A&#8221;<\/a> in a Ph.D. course taught by the\u00a0<a href=\"https:\/\/www.nobelprize.org\/prizes\/economic-sciences\/2002\/kahneman\/facts\/\">winner of a Nobel Prize in economics<\/a>.<\/p>\n<p>In my first cycle of doctoral studies, I was guided at UBC by my supervisor <a href=\"https:\/\/pwias.ubc.ca\/profile\/kenneth-maccrimmon\">Ken MacCrimmon<\/a> into a <a href=\"https:\/\/open.library.ubc.ca\/collections\/ubcpublications\/calendars\/items\/1.0169780#p319z-5r0f:%22psychological%20problems%22\">PSYC546 &#8220;Seminar in Psychology Problems&#8221;<\/a>, which was led by Danny Kahneman.\u00a0 This course was offered shortly after the 1982 publication of the book\u00a0<a href=\"#kahneman-slovic-tversky-1982-judgment\"><em>Judgment under uncertainty: Heuristics and biases<\/em><\/a>, edited by Daniel Kahneman, Paul Slovic, and Amos Tversky.\u00a0 With Kahneman at UBC in Vancouver, and Tversky at Stanford University in the San Francisco Bay Area, the back-and-forth flights to visit each other was frequent.\u00a0 I uncovered more about the relationship between the two psychology professors in reading <a href=\"#lewis-2016-undoing\"><em>The Undoing Project<\/em><\/a>. That book describes a difficult history of university faculty offers, not only around the two collaborators, but also the accommodation of wives <a href=\"https:\/\/www.tc.columbia.edu\/faculty\/bt2158\/\">Barbara Gans Tversky<\/a> and <a href=\"https:\/\/www.edge.org\/anne-treisman-%E2%80%94-1935-2018\">Anne Treisman<\/a>.<\/p>\n<blockquote><p>In late 1977, after Danny had told him that he wasn\u2019t returning to Israel, word spread through academia that Amos Tversky might leave, too.\u00a0 [&#8230;]\u00a0\u00a0Harvard University quickly offered Amos tenure, though it took them a few weeks to throw in an assistant professorship for Barbara. The University of Michigan, which had the advantage of sheer size, scrambled to find four tenured professorships \u2014 and, by making places for Danny, Anne, and Barbara, also snag Amos. The University of California at Berkeley, which left Danny with the clear impression, when he made overtures, that he was too old to be hired, prepared to offer a job to Amos. But no place moved quite so dramatically as Stanford.\u00a0 [&#8230;.]<\/p>\n<p>&#8230; the Stanford Psychology Department went to the Stanford president and said: <em>We have none of the usual paperwork. No recommendations or anything else. Just trust us.<\/em> Stanford made Amos an offer of lifetime employment that afternoon. [&#8230;.]<\/p>\n<p>Stanford showed not the slightest interest in Danny. \u201cThere\u2019s a practical issue,\u201d said [psychology faculty professor Lee] Ross. \u201cDo you want two guys doing the same thing? And the cold fact is we got the full benefit of Danny and Amos just by hiring Amos.\u201d Danny would have loved for them all to go to Michigan, but Amos clearly had no interest in anyplace but Harvard or Stanford. After Harvard and Stanford had ignored him, and Berkeley had let him know that he would not be offered a job, Danny accepted a position beside Anne at the University of British Columbia, in Vancouver. He and Amos agreed they would take turns flying to visit each other every other weekend.\u00a0[<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 11, pp. 222-224]<\/p><\/blockquote>\n<p>In the UBC 1983-1984 Winter Session, I was a doctoral student in Danny Kahneman&#8217;s class .\u00a0 I remember Amos Tversky coming to the class.\u00a0 He led a few discussions.\u00a0 I hadn&#8217;t appreciated that collaboration between the two professors had already effectively ended.<\/p>\n<blockquote><p>At the end of 1979, or perhaps in early 1980, Danny began to talk to a young assistant professor at UBC named Dale Miller, sharing his ideas about the way people compared reality to its alternatives. When Miller asked about Amos, Danny said that they were no longer working together.\u00a0 [&#8230;.]<\/p>\n<p>Amos continued to fly to Vancouver every other week, but there was a new tension between them. Amos clearly wished to believe that they might collaborate as they had before. Danny did not.\u00a0 [<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 11, p. 232]<\/p><\/blockquote>\n<p>And, in the 1983-1984 seminar, I couldn&#8217;t have foreseen the accolades that these professors would later get.<\/p>\n<blockquote><p>Amos was in Israel on a visit in 1984 when he received the phone call telling him that he\u2019d been given a <a href=\"https:\/\/www.macfound.org\/fellows\/239\/\">MacArthur \u201cgenius\u201d grant<\/a>. [&#8230;.]\u00a0 The only work of Amos\u2019s cited in the press release was the work he\u2019d done with Danny. It didn\u2019t mention Danny.\u00a0 [<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 12, p. 236]\u00a0[&#8230;.]<\/p>\n<p>[In 1996], Amos called Danny. He\u2019d just received some news. A growth that doctors had discovered in his eye had just been diagnosed as malignant melanoma. The doctors had scanned his body and found it riddled with cancer. They were now giving him, at best, six months to live. Danny was the second person he\u2019d called with the news. Hearing that, something inside Danny gave. \u201cHe was saying, \u2018We\u2019re friends, whatever you think we are.\u2019\u201d\u00a0[<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 12, p. 255]\u00a0[&#8230;]<\/p>\n<p>Amos told very few people that he was dying, and, to those he did tell, he gave instructions not to spend a lot of time talking to him about it. He received the news in February 1996. From then on he spoke of his life in the past tense.\u00a0 [<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Coda, p. 262]\u00a0[&#8230;]<\/p>\n<p>[Economist Peter]\u00a0Diamond wanted to let Amos know that he was on a very short list for the Nobel Prize in economics, to be awarded in the fall [of 1996]. But the Nobel Prize was awarded only to the living.\u00a0[<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 12, p. 263]\u00a0[&#8230;]<\/p>\n<p>Danny remained at Princeton, where he had gone to escape Amos. [&#8230;] Then, in the fall of 2001, Danny received an invitation to visit Stockholm and speak at a conference. Members of the Nobel Committee would attend, along with leading economists. All the speakers but Danny were economists. Like Danny, they were all pretty obviously under consideration for the prize.\u00a0\u00a0[<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 12, p. 265]\u00a0[&#8230;]<\/p>\n<p>All potential winners were aware of the day the call from Stockholm would come, in the early morning, were it to come at all. On October 9, 2002, Danny\u00a0and Anne sat in their home in Princeton, both waiting and not waiting.\u00a0 [&#8230;.]<\/p>\n<p>Then the phone rang.\u00a0\u00a0[<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 12, pp. 265-266]<\/p><\/blockquote>\n<p>The awarding of the 2002 Nobel Prize in economic sciences to Kahneman was <a href=\"#smith-2002-psychologist\">considered revolutionary<\/a>.\u00a0 Kahneman was an psychologist, <a href=\"#economist-2002-all\">not an economist<\/a>.\u00a0 Recognition of this branch of research within the discipline of economics wouldn&#8217;t be formalized until 2017, with the awarding of the <a href=\"https:\/\/www.nobelprize.org\/prizes\/economic-sciences\/2017\/press-release\/\">Nobel prize in 2017 to Richard Thaler<\/a>.<\/p>\n<blockquote><p>Thaler and Kahneman met in 1977, at Stanford University. Thaler, who had obtained his Ph.D. in 1974, was still finding his way as a researcher, while Kahneman and his fellow-psychologist Amos Tversky had already identified many of the systematic biases that they would become famous for. These included anchoring (the tendency to rely too heavily on initial information); confirmation bias (the tendency to interpret evidence as supporting pre\u00ebxisting beliefs); and loss aversion (feeling the pain of losing ten dollars more intensely than the joy of winning ten dollars). \u201cWe spent a lot of time walking the hills discussing things,\u201d Kahneman recalled of Thaler. \u201cHe already knew a lot of things that didn\u2019t fit in the orthodox economic framework. What he got from us was the theoretical framework to fit them into.\u201d [<a href=\"#cassidy-2017-making\">Cassidy 2017<\/a>]<\/p><\/blockquote>\n<p>Tversky passed away in 1996.\u00a0 The few videos of him (<a href=\"https:\/\/web.stanford.edu\/group\/cslipublications\/cslipublications\/SuppesCorpus\/measurement.html\">in 1981<\/a>) available on the Internet are serious, and don&#8217;t reflect his sense of humour.\u00a0 Yet, web sources back to 2001 claim that Tversky said:<\/p>\n<blockquote><p><strong>My colleagues, they study artificial intelligence; me, I study natural stupidity.<\/strong><\/p><\/blockquote>\n<p>This seems reasonably ascribed to him, but is an undated and unsupported citation.\u00a0 As his legitimacy rose posthumously, that sentence was given more credence in economics [<a href=\"#frank-2011-why\">Frank, 2011<\/a>; <a href=\"#frank-mason-2011-robert\">Frank and Mason, 2011<\/a>].<\/p>\n<p>In 2016, a version of the quote was formally referenced by Michael Lewis back to 1983, in the context of the type of research in which Tversky and Kahneman collaborated:<\/p>\n<blockquote><p>[In the late 1970s, superintendent of the Massachusetts Mental Health Center, Miles Shore] found Danny and Amos together in August 1983, in Anaheim, California, where they were attending the American Psychological Association meeting. Danny was now forty-nine and Amos forty-six. They spoke with Shore together for several hours and then, for several hours more, separately. They walked Miles Shore through the history of the collaboration, starting with their early excitement. \u201cIn the\u00a0 beginning we were able to answer a question that had not been asked,\u201d Amos told him. \u201cWe were able to take psychology out of the contrived laboratory and address the topic from the experiences all around us.\u201d Trying to pin them down on the question they thought they were answering, Shore asked if their work fed into the new and growing field of artificial intelligence. \u201cYou know, not really,\u201d said Amos. \u201c<strong>We study natural stupidity instead of artificial intelligence<\/strong>.\u201d\u00a0\u00a0[<a href=\"#lewis-2016-undoing\">Lewis 2016<\/a>, Chapter 12, pp. 220-221, editorial emphasis added]<\/p><\/blockquote>\n<p>In 2017, Lewis provided a slightly different quotation in an interview, reflecting the playfulness between the psychologists.<\/p>\n<blockquote><p><em>Lewis<\/em>: Danny is a fertile source of ideas. So he\u2019s really generative. And it\u2019s not that Amos isn\u2019t capable of being generative, but Danny is off-the-charts generative. He\u2019s almost the poetic or novelistic mind in the room. And Amos is the diamond cutter. Amos is a pure analytical mind, who sees levels of abstraction in Danny\u2019s ideas and generalizes them and formalizes them, so that they can be tested and expressed in a way that is academically respectable.<\/p>\n<p>But I think what they actually are doing is they\u2019re laughing at stupid things people do.<\/p>\n<p>And Amos was asked once by somebody who said, \u201cDoes the work you and Danny do have any bearing on artificial intelligence?\u201d And Amos said: \u201c<strong>I\u2019m much more interested in natural stupidity than I am in artificial intelligence<\/strong>.\u201d<\/p>\n<p>And I think that they felt that it wasn\u2019t a mocking spirit in which they operated, they were laughing also at themselves. At the sort of thing that they did that struck them as irrational, and they were mining that for gold. They have really a rattle bag of ideas that they end up trying to classify.\u00a0 [<a href=\"#lewis-2017-men\">Lewis 2017<\/a>, 9m25s-10m25s, edited in transcript, emphasis added]<\/p><\/blockquote>\n<p>My career has led me through <em>artificial intelligence<\/em> technologies.\u00a0 Like Tversky and Kahneman, my pursuits could be described as orienting more towards the\u00a0<em>natural stupidity<\/em>\u00a0in human systems.\u00a0 While they worked at the level of psychology of individuals, I&#8217;ve tended more towards the organizational level, often <a href=\"http:\/\/coevolving.com\/commons\/2002_ISSS_46th_186_Ing_Simmonds_Mediating_Spaces\">mediated through collaborative information technologies<\/a>.<\/p>\n<p>When I embarked on graduate studies, my focus was on <em>decision support systems<\/em>, &#8220;a concept of the role of computers within the decision-making process&#8221;, as semi-structured tasks [<a href=\"#keen-1980-decision\">Keen 1980<\/a>].\u00a0 Ken MacCrimmon suggested that at UBC I explore not from the Management Information Systems perspective that I had seen at MIT, but instead alongside his research into <a href=\"#maccrimmon-wehrung-1986-taking\"><em>Taking Risks: The Management of Uncertainty<\/em><\/a>.<\/p>\n<p>I left UBC in 1984, and joined IBM Canada in 1985.\u00a0 This\u00a0 changed my trajectory from academic research towards action and practice, with a strong scholarly foundation in the background.\u00a0 Through the IBM assignments <a href=\"http:\/\/daviding.tumblr.com\/post\/158646002829\/googleplex-in-1988-i-worked-at-1965-charleston\">with <em>Metaphor Computer Systems<\/em> circa 1988<\/a>, and with the <em>IBM Advanced Business Institute<\/em> circa 1999 with <a href=\"http:\/\/www.senseandrespond.com\/s-h-haeckel\/\">Stephan Haeckel<\/a> publishing <em><a href=\"http:\/\/www.senseandrespond.com\/\">Adaptive Enterprise<\/a><\/em>, the technologies of the PC revolution and the Internet led me into another world.\u00a0 Rather than pursuing behavioral economics, I became immersed in the <a href=\"http:\/\/isss.org\/world\/administration\/past_presidents\">systems sciences<\/a>.<\/p>\n<figure style=\"width: 514px\" class=\"wp-caption alignnone\"><a id=\"1984-UBC-transcript-DavidIng-PhD-studies\" href=\"http:\/\/coevolving.com\/images\/1984_UBC_transcript_DavidIng_PhD_studies.pdf\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium\" src=\"http:\/\/coevolving.com\/images\/1984_UBC_transcript_DavidIng_PhD_studies.png\" alt=\"University of British Columbia, Permanent Record, David Ing, August 1984\" width=\"514\" height=\"708\" \/><\/a><figcaption class=\"wp-caption-text\">University of British Columbia, Permanent Record, David Ing, August 1984<\/figcaption><\/figure>\n<h3>References<\/h3>\n<p><a id=\"cassidy-2017-making\"><\/a>Cassidy, John. 2017. \u201cThe Making of Richard Thaler\u2019s Economics Nobel.\u201d <em>The New Yorker<\/em>, October 10, 2017.<a href=\"https:\/\/www.newyorker.com\/news\/john-cassidy\/the-making-of-richard-thalers-economics-nobel\">https:\/\/www.newyorker.com\/news\/john-cassidy\/the-making-of-richard-thalers-economics-nobel<\/a>.<\/p>\n<p><a id=\"economist-2002-all\"><\/a>The Economist. 2002. \u201cAll Too Human,\u201d October 10, 2002. <a href=\"https:\/\/www.economist.com\/finance-and-economics\/2002\/10\/10\/all-too-human\">https:\/\/www.economist.com\/finance-and-economics\/2002\/10\/10\/all-too-human<\/a>.<\/p>\n<p><a id=\"frank-2011-why\"><\/a>Frank, Robert H. 2011. \u201cWhy Worry? It\u2019s Good for You.\u201d <em>New York Times<\/em>, May 14, 2011, sec. Economy. <a href=\"https:\/\/www.nytimes.com\/2011\/05\/15\/business\/economy\/15view.html\">https:\/\/www.nytimes.com\/2011\/05\/15\/business\/economy\/15view.html<\/a>.<\/p>\n<p><a id=\"frank-mason-2011-robert\"><\/a>Frank, Robert H., and Paul Mason. 2011. \u201cRobert H. Frank: The Darwin Economy.\u201d Web Audio. <em>BBC Analysis<\/em>. London School of Economics. <a href=\"https:\/\/www.bbc.co.uk\/programmes\/b0174f06\">https:\/\/www.bbc.co.uk\/programmes\/b0174f06<\/a>.<\/p>\n<p><a id=\"kahneman-slovic-tversky-1982-judgment\"><\/a>Kahneman, Daniel, Paul Slovic, and Amos Tversky, eds. 1982. <em>Judgment under Uncertainty Heuristics and Biases<\/em>. Cambridge University Press. <a href=\"https:\/\/doi.org\/10.1017\/CBO9780511809477\">https:\/\/doi.org\/10.1017\/CBO9780511809477<\/a>.<\/p>\n<p><a id=\"kahneman-2003-maps\"><\/a>Kahneman, Daniel. 2003. \u201cMaps of Bounded Rationality: Psychology for Behavioral Economics.\u201d <em>American Economic Review<\/em> 93 (5): 1449\u201375. <a href=\"https:\/\/doi.org\/10.1257\/000282803322655392\">https:\/\/doi.org\/10.1257\/000282803322655392<\/a>.\u00a0 Alternate search at\u00a0<a href=\"https:\/\/scholar.google.com\/scholar?cluster=7689523659957052863\">https:\/\/scholar.google.com\/scholar?cluster=7689523659957052863<\/a>.<\/p>\n<p><a id=\"keen-1980-decision\"><\/a>Keen, Peter G. W. 1980. \u201cDecision Support Systems\u202f: A Research Perspective.\u201d Working Paper 54. <em>Centre for Information Studies Research<\/em>. Cambridge, MA: MIT Sloan School of Management. <a href=\"http:\/\/dspace.mit.edu\/handle\/1721.1\/47172\">http:\/\/dspace.mit.edu\/handle\/1721.1\/47172<\/a>.<\/p>\n<p><a id=\"lewis-2016-undoing\"><\/a>Lewis, Michael. 2016. The Undoing Project: A Friendship That Changed Our Minds. WW Norton &amp; Company. <a href=\"http:\/\/books.wwnorton.com\/books\/The-Undoing-Project\/\">http:\/\/books.wwnorton.com\/books\/The-Undoing-Project\/<\/a>.<\/p>\n<p><a id=\"lewis-2017-men\"><\/a>Lewis, Michael. 2017. <em>The Men Who Started a Thinking Revolution<\/em> Interview by Stephen J. Dubner. MP3 audio. <a href=\"http:\/\/freakonomics.com\/podcast\/men-started-thinking-revolution\/\">http:\/\/freakonomics.com\/podcast\/men-started-thinking-revolution\/<\/a>.<\/p>\n<p><a id=\"maccrimmon-wehrung-1986-taking\"><\/a>MacCrimmon, Kenneth R., and Donald A. Wehrung. 1986. <em>Taking Risks The Management of Uncertainty<\/em>. New York: The Free Press. <a href=\"http:\/\/archive.org\/details\/takingrisksmanag00macc\">http:\/\/archive.org\/details\/takingrisksmanag00macc<\/a>. Alternative search at\u00a0<a href=\"https:\/\/books.google.com\/books?id=BUK5AAAAIAAJ\">https:\/\/books.google.com\/books?id=BUK5AAAAIAAJ<\/a>.<\/p>\n<p><a id=\"smith-2002-psychologist\"><\/a>Smith, Deborah. 2002. \u201cPsychologist Wins Nobel Prize.\u201d <em>Monitor on Psychology<\/em> 33 (11): 22.\u00a0<a href=\"http:\/\/www.apa.org\/monitor\/dec02\/nobel.aspx\">http:\/\/www.apa.org\/monitor\/dec02\/nobel.aspx<\/a>.<\/p>\n<p><a id=\"tversky-kahneman-1974-judgment\"><\/a>Tversky, Amos, and Daniel Kahneman. 1974. \u201cJudgment under Uncertainty: Heuristics and Biases.\u201d <em>Science<\/em> 185 (4157): 1124\u201331. <a href=\"https:\/\/doi.org\/10.1126\/science.185.4157.1124\">https:\/\/doi.org\/10.1126\/science.185.4157.1124<\/a>.\u00a0 Alternate search at\u00a0<a href=\"https:\/\/scholar.google.com\/scholar?cluster=17040257859216791312\">https:\/\/scholar.google.com\/scholar?cluster=17040257859216791312<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Reading The Undoing Project, by Michael Lewis, reminded me of a PhD course at UBC with Daniel Kahneman and Amos Tversky, before they were recognized as Nobel prize candidates.<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[17,19,14],"tags":[40,503,505,39,501,504,502],"class_list":["post-1734","post","type-post","status-publish","format-standard","hentry","category-economics","category-psychology","category-technologies","tag-amos-tversky","tag-artificial-intelligence","tag-behavioral-economics","tag-daniel-kahneman","tag-kahneman","tag-natural-stupidity","tag-tversky"],"_links":{"self":[{"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/posts\/1734","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/comments?post=1734"}],"version-history":[{"count":23,"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/posts\/1734\/revisions"}],"predecessor-version":[{"id":1757,"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/posts\/1734\/revisions\/1757"}],"wp:attachment":[{"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/media?parent=1734"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/categories?post=1734"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/coevolving.com\/blogs\/wp-json\/wp\/v2\/tags?post=1734"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}