By - CBMM
CBMM Memo No. 019June 10, 2014The Genesis Story Understanding and Story Telling SystemA 21st Century Step toward Artificial IntelligencebyPatrick Henry WinstonAbstract: Story understanding is an important differentiator of human intelligence, perhaps the most importantdifferentiator. The Genesis system was built to model and explore aspects of story understanding using simplyexpressed, 20-100 sentence stories drawn from sources ranging from fairy tales to Shakespeare’s plays. I describeGenesis at work as it reflects on its reading, searching for concepts, reads stories with controllable allegiancesand cultural biases, models personality traits, answers basic questions about why and when, notes concept onsets,anticipating trouble, calculates similarity using concepts, models question-driven interpretation, aligns similarstories for analogical reasoning, develops summaries, and tells and persuades using a reader model. I conclude withthoughts on how Genesis would describe people in pictures and video, thus engaging with the CBMM challengeproblem.This work was supported, in part, by the Center for Brains, Minds andMachines (CBMM), funded by NSF STC award CCF - 1231216.
Vision: a distinguishing difference and a shared substrateMarvin Minsky published Steps toward Artificial Intelligence a little more than 50 years ago (1961). Now, half acentury later, Deep Blue, Watson, and Siri amaze everyone and stand as testaments to engineering skill, but theapplications dreamed of in 1961 remain far from realized: No language system has the common sense required to understand what it is reading and the implications thatflow from common sense understanding. No vision system understands the visual world well enough to report instances of more than a handful of the 48actions cited in DARPA’s 2010 Mind’s Eye BAA.Why are there no such systems? I think it is because we remain ignorant of how our species is different fromothers, and we remain ignorant of how the differences are enabled by a shared substrate.In this white paper, I focus on story understanding, which I believe is the key difference between us and all otherprimates, living and extinct. I catalog our work on story-understanding tools, describing some of the capabilitiesof our Genesis story-understanding system.Steps: Specify behavior, develop representations, build GenesisIt is evident that we learn a great deal about life from stories, which include fairy and folk tales, religious parables,ethnic narratives, entertainment, news, history, literature, and experience. It is also evident that we learn a greatdeal professionally from case studies in law, business, medicine, defense, diplomacy, science, and engineering.To understand how we understand and learn from stories, I believe we must first specify the behavior we wantto model, then develop a suite of constraint exposing representations, then build our Genesis story understandingsystem so as to test our ideas. I believe success will lead to understanding human intelligence and to paradigmshifting engineering practice built on that understanding.What Genesis modelsI have elaborated on our perspective in a trilogy: The Strong Story Hypothesis and the Directed Perception Hypothesis (2011) introduces two key hypotheses about human intelligence and ties story telling to directed perception;The Right Way (2012b) emphasizes mythological steps; and The next 50 years: A personal view (2012a) focuseson asking the right questions about how we are different from other primates and how we are the same.My purpose here is to add to those previous papers an account of what the Genesis system now models by wayof reading, deliberating, reflecting, cultural bias, personality understanding, question answering, onset detection,similarity measurement, similarity based retrieval, question driven interpretation, analogical interpretation, readeraware story telling, persuasion, and summary.Genesis reads stories, common sense rules, and concept descriptionsWe of the Genesis Group spend a lot of time with a short summary of Macbeth. Shakespeare, in general, tells usabout the human condition, his plays constitute a good anvil for hammering out story understanding ideas.Macbeth is a thane and Macduff is a thane. Lady Macbeth is evil and greedy. Duncan is the king, andMacbeth is Duncan’s successor. Duncan is an enemy of Cawdor. Macduff is an enemy of Cawdor. Duncanis Macduff’s friend. Macbeth defeated Cawdor. Duncan becomes happy because Macbeth defeatedCawdor. Witches had visions and danced. Macbeth talks with Witches. Witches make predictions.Witches astonish Macbeth. Macbeth becomes Thane of Cawdor. Duncan rewarded Macbeth becauseDuncan became happy. Macbeth wants to become king because Lady Macbeth persuaded Macbeth towant to become the king. Macbeth invites Duncan to dinner. Duncan goes to bed. Duncan’s guardsbecome drunk and sleep. Macbeth murders Duncan. Macbeth murders guards. Macbeth becomes king.Malcolm and Donalbain flee. Macbeth’s murdering Duncan leads to Macduff’s fleeing to England. Then,Macduff’s fleeing to England leads to Macbeth’s murdering Lady Macduff. Macbeth hallucinates at a1
dinner. Lady Macbeth says he hallucinates often. Everyone leaves. Macbeth’s murdering Duncan leadsto Lady Macbeth’s becoming distraught. Lady Macbeth has bad dreams. Lady Macbeth thinks she hasblood on her hands. Lady Macbeth kills herself. Birham Wood is a forest. Burnham Wood goes toDunsinane. Macduff’s army attacks Macbeth’s castle. Macduff curses Macbeth. Macbeth refuses tosurrender. Macduff kills Macbeth. The end.I noted early on that what works for Macbeth works also for other kinds of conflict. All of the infrastructureand much of the knowledge developed to deal with Macbeth transferred over to our work on the Estonia-Russiacyber war of 2007.Estonia built Estonia’s computer networks. Estonia insulted Russia because Estonia relocated a warmemorial. Russia wanted to harm Estonia. Someone attacked Estonia’s computer networks after Estoniaharmed Russia. Russia attacked Estonia’s computer networks. The attack on Estonia’s computer networksincluded the jamming of the web sites. The jamming of the sites showed that someone did not respectEstonia. Estonia created a center to study computer security. Estonia believed other states would supportthe center. The end.The Estonia-Russia cyber war is much like other conflicts. Dealing, for example, with the Congo civil war ina retrieval experiment introduced no challenges.Genesis deploys common sense rules to develop basic understanding07:46:09 EDT 13-Apr-2014Demonstrate ViewsRead AboutControls Start viewerExpertsElaboration graph InspectorSourcesResults SummaryStoryMacbeth/revengeRules: 39Inferences: 64Lady Macbethis Macbeth'swife.Macbeth is LadyMacbeth'shusband.Macbeth is LadyMacbeth'srelation.Lady Macbethis Macbeth'sfriend.Lady Macduffis Macduff'swife.Macduff is LadyMacduff'shusband.Lady Macbethis Macbeth'srelation.Macbeth is LadyMacbeth's friend.Macduff isCawdor'senemy.Macduff isDuncan'sfriend.Macduff is LadyMacduff's relation.Lady Macduffis Macduff'sfriend.Duncan isCawdor'senemy.Duncan isMacduff'sfriend.Lady Macduffis Macduff'srelation.Macduff is LadyMacduff's friend.Duncanis a king.Lady Macbethis Macbeth'srelation.Macbeth is LadyMacbeth's friend.Macbeth isDuncan'ssuccessor.Macbeth is LadyMacbeth'srelation.Lady Macbethis happy.DuncanrewardsMacbeth.Lady Macbethpersuades Macbethto want to becomeking.Macbethwants tobecome ethharmsDuncan.Macbethharms ady msDuncan.MacbethangersMacduff.Lady Macbethkills herself.Lady Macbethharms herself.Lady Macbethharms Lady Macduffbecomesunhappy.Macbethangers LadyMacduff.Macduffbecomesunhappy.Lady MacbethangersMacbeth.Macduff th.Concepts: 14Discoveries: 9Explicit elements: 43Inferred elements: 38Total elements: 81Story reading time: 4.9 secTotal time elapsed: 13.9 secMacbethangersMacduff.Lady Macduffis Macduff'srelation.Macduff is LadyMacduff's friend.Macduff is LadyMacduff's relation.Lady Macduffis Macduff'sfriend.Macduffflees toEngland.Lady Macbethbecomesdistraught.Macbethmurders LadyMacduff.Macbethharms LadyMacduff.MacbethharmsMacduff.Macbethharms uff.MacbethharmsDuncan.Lady MacbethharmsMacbeth.Macduffharms LadyMacbeth.Lady Macduffbecomesdead.Lady ngeSuccessAnswered prayerMistake because unh.Mistake because har.Mistake because har.Pyrrhic victoryPyrrhic victorySuicide100%Elaboration graphFigure 1: Genesis produces elaboration graphs, as shown for a summary of Macbeth. Common sense rules connect explicitand inferred elements of the story. (This figure is included at high resolution in the electronic version of this document.)Genesis uses Boris Katz’s START (1997) system to translate Genesis English into an inner language of relationsand events. Genesis then uses common sense to build an elaboration graph as shown in figure 1. Elements inyellow are established by inference rules as indicated by black connecting lines. The story itself supplies theelements in white, orange, and blue.Explanation rules tie elements in orange to other elements. In reading a story, we humans seek explanations,and if none is offered, we assume connections that may hold, but not with sufficient regularity to be added by2
inference rules. In Macbeth, the story itself supplies no explicit reason why Macbeth murders Duncan and noinference rule supplies a reason, so an explanation rule connects the murder to Macbeth’s wanting to be king,Macbeth’s being Duncan’s successor, and Duncan’s being king.Leads-to expressions connect elements in blue to other elements. These are supplied by expressions in thestory, such as Macbeth’s murdering Duncan leads to Macduff’s fleeing to England. Such expressions indicatewhen two elements are known to be connected but the exact causal path is not known, or at least not supplied.Genesis reflects on its reading, searching for conceptsOnce Genesis builds the elaboration graph, Genesis uses ordinary search to find instances of concept patterns.In figure 2, Genesis notes a revenge pattern because Macbeth’s harming Macduff leads to Macduff’s harmingMacbeth. In figure 3, Genesis notes a Pyrrhic victory pattern because Macbeth’s actions at first make him happy,but then lead to his own harm.07:51:26 EDT 13-Apr-2014Demonstrate ViewsRead AboutControls Start viewerExpertsElaboration graph acduff.Results SummaryStoryMacduffharmsMacbeth.Macduff killsMacbeth.Inspector ViewsControls Start viewerExpertsElaboration graph InspectorSourcesResults SummaryStoryMacbeth/revengeRules: 39Lady Macbethis Macbeth'swife.Macbeth is LadyMacbeth'shusband.Macbeth is LadyMacbeth's relation.Lady Macbethis Macbeth'sfriend.Lady Macduffis Macduff'swife.Macduff is LadyMacduff'shusband.Lady Macbethis Macbeth'srelation.Macbeth is LadyMacbeth's friend.Macduff isCawdor'senemy.Macduff isDuncan'sfriend.Macduff is LadyMacduff's relation.Lady Macduffis Macduff'sfriend.Duncan isCawdor'senemy.Duncan isMacduff'sfriend.Lady Macduffis Macduff'srelation.Macduff is LadyMacduff's friend.Duncanis a king.Lady Macbethis Macbeth'srelation.Macbeth is LadyMacbeth's friend.Macbeth isDuncan'ssuccessor.Macbeth is LadyMacbeth's relation.Lady Macbethis happy.DuncanrewardsMacbeth.Lady MacbethpersuadesMacbeth to wantto become king.Macbeth wants tobecome ethharmsDuncan.Macbethharms ady msDuncan.MacbethangersMacduff.LadyMacbethkills herself.Lady Macbethharms herself.Lady Macbethharms Lady Macduffbecomesunhappy.Macbethangers LadyMacduff.Macduffbecomesunhappy.Lady MacbethangersMacbeth.Macduff th.Inferences: 64Concepts: 14Discoveries: 9Explicit elements: 43Inferred elements: 38Total elements: 81Story reading time: 6.2 secTotal time elapsed: 15.7 secMacbethangersMacduff.Lady Macduffis Macduff'srelation.Macduff is LadyMacduff's friend.Macduff is LadyMacduff's relation.Lady Macduffis Macduff'sfriend.Macduffflees toEngland.Lady Macbethbecomesdistraught.Macbethmurders LadyMacduff.Macbethharms LadyMacduff.MacbethharmsMacduff.Macbethharms uff.MacbethharmsDuncan.Lady MacbethharmsMacbeth.Macduffharms LadyMacbeth.Lady Macduffbecomes dead.Lady Macbethbecomes ered pra.Mistake beca.Mistake beca.Mistake beca.Pyrrhic victoryPyrrhic victorySuicide100%Elaboration graphFigure 2: Genesis finds concept patterns by searching the elaboration graph. Here, Genesis shows revenge elements in greenin the Elaboration graph panel provides a close-up view in the Inspector panel.Once Genesis builds the elaboration graph, Genesis uses ordinary search to find instances of concept patterns.In figure 2, Genesis notes a revenge pattern because Macbeth’s harming Macduff leads to Macduff’s harmingMacbeth. In figure 3, Genesis notes a Pyrrhic victory pattern because Macbeth’s actions at first make him happy,but then lead to his own harm.Our first work on concept patterns appeared in the MEng thesis of David Nackoul (2010).3
07:43:58 EDT 13-Apr-2014Demonstrate ViewsRead AboutControls Start viewerExpertsElaboration graph InspectorSourcesMacbethwants tobecome king.MacbethmurdersDuncan.Duncanis a king.Macbethbecomesking.Results SummaryMacbethbecomeshappy.StoryMacduffflees toEngland.Macbethmurders LadyMacduff.Macbethharms ff.Macduff killsMacbeth.MacduffharmsMacbeth.Macbeth isDuncan'ssuccessor.Lady Macduffis Macduff'sfriend.Inspector ViewsControls Start viewerExpertsElaboration graph InspectorSourcesResults SummaryStoryMacbeth/revengeRules: 39Lady Macbeth isMacbeth's wife.Macbeth is LadyMacbeth's husband.Macbeth is LadyMacbeth's relation.Lady Macbeth isMacbeth's friend.Lady Macduff isMacduff's wife.Macduff is LadyMacduff's husband.Lady Macbeth isMacbeth's relation.Macbeth is LadyMacbeth's friend.Macduff isCawdor'senemy.Macduff isDuncan'sfriend.Macduff is LadyMacduff's relation.Lady Macduff isMacduff's friend.Duncan isCawdor'senemy.Duncan isMacduff'sfriend.Lady Macduff isMacduff's relation.Macduff is LadyMacduff's friend.Duncan isa king.Lady Macbeth isMacbeth's relation.Macbeth is LadyMacbeth's friend.Macbeth isDuncan'ssuccessor.Macbeth is LadyMacbeth's relation.Lady Macbeth isMacbeth's friend.Lady Macduff isMacduff's relation.Macduff is LadyMacduff's friend.Macduff is LadyMacduff's relation.Lady Macduff isMacduff's canrewardsMacbeth.Lady Macbeth persuadesMacbeth to want to become king.Inferences: 64Macbethwants tobecome ethharmsDuncan.Macbethharms ady Macbethbecomes thangersMacduff.Lady Macbethkills herself.Lady Macbethharms herself.Lady Macbethharms Lady Macduffbecomesunhappy.Lady Macbethangers Macbeth.Macduff killsMacbeth.Macbethangers eth.MacduffharmsMacbeth.Concepts: 14Discoveries: 9Explicit elements: 43Inferred elements: 38Total elements: 81Story reading time: 4.9 secTotal time elapsed: 13.9 secMacbethangersMacduff.Macduff flees toEngland.Lady Macbethbecomesdistraught.Macbeth murders Lady Macduff.MacbethharmsMacduff.Macbethharms LadyMacduff.MacbethharmsMacduff.Macbethharms an.Lady Macbethharms Macbeth.Macduffharms LadyMacbeth.Lady Macduffbecomes dead.Lady Macbethbecomes ered prayerMistake because unh.Mistake because har.Mistake because har.Pyrrhic victoryPyrrhic victorySuicide100%Elaboration graphFigure 3: Genesis extracts the pyrrhic victory elements from the full elaboration graph.Genesis reads stories with controllable allegiances and cultural biasesGenesis’s interpretation depends on the common sense rules, concept patterns supplied, and biases of the reader.In figure 4, the 2007 cyber war between Estonia and Russia is viewed as misguided revenge buy a reader friendlyto Estonia; the same cyber war is viewed as teaching Estonia a lesson by a reader friendly to Russia.Similarly, in figure 5, an Eastern reader of Macbeth is more likely than a Western reader to see Macduff’skilling of Macbeth situationally, as a consequence of the situation Macduff is in; a Western reader is more like tosee the same killing dispositionally, as a consequence of insanity.The most ambitious examples of cultural influence appear in the MEng thesis of Wolfgang Victor Yarlott(2014), who demonstrated Genesis at work on selected folktales from Native American Crow culture.Genesis models personality traitsGenesis notes what various sorts of people do, which enables Genesis to infer personality traits on the basis ofwhat people do, which enables Genesis to use personality traits to explain acts.In figure 6, Genesis notes early in the Macbeth story that Macduff assaults someone, a characteristic of viciouspeople, leading Genesis to consider Macduff to be vicious. Then, thinking that Macduff is vicious, Genesis explainsMacduff’s killing of Macbeth as a consequence of anger and Macduff’s vicious nature.Our first work on personality traits appeared in the MEng thesis of Susan Song (2012).Genesis answers basic questions about why and whenGenesis answers questions on various levels. As shown in figure 7, Genesis answers questions about cyber war byreciting elaboration graph elements connected to the target event and by noting how target events are embeddedin concepts. Additionally, as shown in figure 8, Genesis answers questions using personality traits associated withthe target event.Genesis notes concept onsets, anticipating troubleConcepts generally involve leads-to relations. Noting the first part of a leads-to relation provides early warning ofpossible evolutions. As shown in figure 9, the potential for revenge, misguided retaliation, and mistake are noted4
07:54:08 EDT 13-Apr-2014Demonstrate ViewsRead AboutControls Start viewerExpertsElaboration graph InspectorEstonia doesn'trespect Russia.Russia wantsto harmEstonia.Russia wants todamagecomputernetworks.Russia a believescomputernetworks arevaluable.Someone attackscomputer networks.Estonia esults SummaryRussiaharmsEstonia.StoryEstonia doesn'trespect Russia.Russia wantsto harmEstonia.Russia wants todamagecomputernetworks.Russia a believescomputernetworks arevaluable.Someone attackscomputer networks.Estonia rmsEstonia.Russia ismy friend.Estonia ismy friend.Inspector ViewsControls Start viewerExpertsElaboration graph InspectorSourcesResults SummaryStoryEstonia/revengeEstonia/lessonRules: 33Rules: 33Estonia believescomputer networksare valuable.Estonia buildscomputer networks.Inferences: 19Concepts: 14Estonia ownscomputernetworks.Estoniarelocates warmemorial.Estonia insultsRussia.Estonia harmsRussia.Estonia angersRussia.Estonia doesn'trespect Russia.Russia wantsto harmEstonia.Estonia ismy friend.Discoveries: 5Russia wants todamage computernetworks.Russia attackscomputer networks.Someone attackscomputer networks.Russia wants toatta
Macbeth murders Duncan. Macbeth murders guards. Macbeth becomes king. . we assume connections that may hold, but not with sufficient regularity to be added by 2. inference rules. In Macbeth, the story itself supplies no explicit reason why Macbeth murders Duncan and no . queen. Macbeth happy. Macbeth harms Duncan. Macbeth Macduff. harms .
Crash Course on Basic Statistics Marina Wahl, marina.w4hl@gmail.com University of New York at Stony Brook November 6, 2013. 2. . 7 The t-Test 19 8 Regression 23 9 Logistic Regression 25 10 Other Topics 27 11 Some Related Questions 29 3. 4 CONTENTS. Chapter 1 Basic Probability 1.1 Basic De nitions
–2– AFNI Analysis of Functional NeuroImages Developed to provide an environment for FMRI data analyses § And a platform for development of new software AFNI refers to both the program of that name and the entire package of external programs and plugins (more than 200) Important principles in the development of AFNI: §
Vendors will be on hand with models, kits and refreshments for sale. To The PoinT Chesapeake Bay Maritime Museum Spring 2010 CBMM volunteer Roger Galvin’s skills as a Master Gardener are being utilized on the Museum’s campus. A temporary pond will be built for demonstrations and competition at the Maritime Model Boat Expo in May.
Enhance life through learning President's Letter Dear Lifelong Learners, Welcome to the 2018 Fall semester! Please join us on Thursday, September 13th, from 4-6 pm for our Preview Party in the Van Lennep Auditorium. We'll introduce our new course leaders, and enjoy a lively social time with hors d'oeuvres from Piazza.
Tulang-tulang atau cadaver yang digunakan untuk mempelajari ilmu anatomi ini adalah bagian tubuh manusia , YANG TIDAK BOLEH DIPERMAINKAN. Previllage menggunakan cadaver dan tulang guna mempelajari ilmu anatomi hanya dapat dipertanggung jawabkan, jika kita menggunakan kesempatan itu dengan maksud dan tujuan yang suci. 2. Dalam mempelajari cadaver dan tulang kita harus selalu ingat bahwa .
Zoo Animal Nutrition IV Zoo Animal Nutrition IV (2009) was edited by M. Clauss, A. Fidgett, G. Janssens, J.-M. Hatt, T. Huisman, J. Hummel, J. Nijboer, A. Plowman. Filander Verlag, Fürth ISBN-13: 978-3-930831-72-2 To obtain a copy of the book, contact Filander Verlag at info@filander.de Dierenfeld, E. S. Conservation collaborations: nutrition .
classes of concrete listed in Table 501-03, Concrete Mixtures, except Class F. Type IP or SM blended cement replaces the portland cement/pozzolan portion of the designed mix in Class DP, G, GG, or HP concrete. When using Type IP or SM blended cement in Class DP and HP concrete, an addition of Microsilica §711-11 is required. b. Type SF. Blended Portland Cement (Type SF), may be used in Class .
Careers in the allied health professions. Caring, compassionate, committed. Make a difference with a career in health . Welcome. A career for you There are more than 350 roles in health, and many of them are part of a wider . team which works alongside other health professionals for the benefit of patients and the public. As well as the NHS itself, a great many large and smaller organisations .
