Anomaly detection in trade declarations using deep learning techniques: A risk-assessment approach to identify misclassification and incorrect valuation
Affiliations: Census and Statistics Department, Hong Kong, China
Correspondence:
[*]
Corresponding author: Benjamin Chan, Census and Statistics Department, Wanchai Tower, 12 Harbour Road, Wan Chai, Hong Kong, China. Tel.: +852 2582 4973; E-mail: [email protected].
Abstract: In Hong Kong, merchandise trade statistics are compiled based on the commodity information given on the trade declarations submitted by traders. Due to the complexity of the standardised commodity classification system (i.e. Hong Kong Harmonized System, or HKHS in short), there are often reporting errors, especially in the commodity codes and quantities. With around 20 million declarations received annually, the availability of this big data source motivates us to adopt deep learning techniques to detect the reporting errors. This paper proposes a mechanism consisting of three deep learning models for checking the commodity code, quantity and value, which offers an end-to-end solution to data quality assurance for declarations. The results show that the proposed mechanism could enhance the accuracy of error detection, which is conducive to improving the quality of trade statistics. With the use of text analytics techniques, the mechanism could fully utilise free-text commodity descriptions declared by traders to check the accuracy of the declared information comprehensively. It also overcomes some limitations of the traditional rule-based models. The whole study demonstrates the potential of using deep learning approach in quality assurance of existing statistical systems for official statistics.
Keywords: Merchandise trade statistics, data quality assurance, deep learning, text analytics, uncertainty quantification
