Cognitive Graph for Multi-Hop Reading Comprehension at Scale
2021-04-07 2021-04-09
来源:ACL 2019
机构:清华 唐杰 + 阿里
任务:多跳 MRC(hotpot QA)
动机:分成 system1 (隐式抽取)和 system2(显式推断)
先说说 system1 和 system2:之前在唐建的 talk 里面听说过这个概念,当时他用贝叶斯那套做 logical reasoning,没听懂,这篇文章才终于搞明白这个故事。真是一个好故事啊!our brains first retrieve relevant information following attention via an implicit, unconscious and intuitive process called System 1, based on which another explicit, conscious and controllable reasoning process, System 2, is then conducted. System 1 could provide resources according to requests, while System 2 enables diving deeper into relational information by performing sequential thinking in the working memory, which is slower but with human-unique rationality. 从这段话上乍一看, sys1 与 sys2 不就正好是我 DocRE 四部曲分类中的二三两步嘛!
方法:可是他的做法却不是这样(和我那个四部曲不一样,但是和他 sys1 sys2 的故事还是挺相符的),整体是一个迭代的方法。System 1 extracts question-relevant entities and answer candidates from paragraphs and encodes their semantic information. System 2 then conducts the reasoning procedure over the graph, and collects clues to guide System 1 to better extract next-hop entities.