Affiliations: [a] School of Computer and Information Technology, Shanxi University, Taiyuan, Shanxi, China | [b] Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education, Shanxi University, Taiyuan, Shanxi, China | [c] Department of Computer Science and Technology, Tongji University, Jiading, Shanghai, China
Correspondence:
[*]
Corresponding author: Xiaoying Gao, Department of Computer Science and Technology, Tongji University, Jiading, Shanghai, China. E-mail: [email protected].
Abstract: Question Answering based on Tabular and Textual data is a novel task proposed in recent years in the field of QA. At present, most QA systems return answers from a single data form, such as knowledge graphs, tables, texts. However, hybrid data including structured and unstructured data is quite pervasive in real life instead of a single form. Recent research on TAT-QA mainly suffers from the higher error of extracting supporting evidences from both tabular and textual content. This paper aimed to address the problem of failure evidence extraction from more complex and realistic hybrid data. We first proposed two types of metrics to evaluate the performance of evidence extraction on hybrid data, i.e. wrong evidence ratio (WER) and missing evidence ratio (MER). Then we utilize a candidate extractor to obtain supporting evidence related to the question. Third, an origin selector is designed to determine from where the question’s answer comes. Finally, the loss of origin selector is fused to the final loss function, which can improve the evidence extraction performance. Experimental results on the TAT-QA dataset showed that our proposed model outperforms the best baseline in terms of F1, WER and MER, which proves the effectiveness of our model.
Keywords: Question answering on tabular and textual data, Wrong Evidence Ratio, Missing Evidence Ratio, multi-head attention
