论文笔记 – Inductive Relation Prediction by BERT

Hanwen Zha, Zhiyu Chen, and Xifeng Yan, “Inductive Relation Prediction by BERT”, arXiv 2103.07102v1

1 简介

• 姓名：BERTRL
• 机构：UCSB
• 任务：Inductive logical reasoning in KG completion
• 流派：BERT-based
• 动机：Grail 只用了边上的关系信息，这篇文章用 BERT，就用上了文本的信息和预训练的先验知识
• 方法：拼接 [reasoning path with prompt; entity pair] 输入 BERT，[CLS] 分类, e.g. Take Figure 1 as an example. It could be “[CLS] Question: Franklin Roosevelt work at what ? Is the correct answer Washington D.C. ? [SEP] Context: Franklin Roosevelt president of USA; Washington D.C. capital of USA;” Each individual path will form a training/inference instance. 
• 性能：在 FB15k-237 & NELL-995 大幅超过 SOTA, 在 WN18RR 与 SOTA comparable (作者说 FB15k-237 & NELL-995 have more relations and are associated with open-world knowledge (learned by BERT) compared with WN18RR)
• 短评：BERT yyds，GCN 滚出 NLP！