Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Article type: Research Article
Authors: Asthana, Amit; * | Dwivedi, Sanjay K.
Affiliations: Department of Computer Science, Babasaheb Bhimrao Ambedkar University, Lucknow, India
Correspondence: [*] Corresponding author: Amit Asthana, Department of Computer Science, Babasaheb Bhimrao Ambedkar University, Lucknow, 226025, India. E-mail: [email protected].
Abstract: Understanding machine translation (MT) quality is becoming more and more important as MT usage continues to rise in the translation industry. The acceptance of MT output based on their performance and, ultimately, how acceptable the translators actually are, have received relatively less attention so far. MT plays a vital role in CLIR systems and their retrieval efficiency is directly proportional to the translation accuracy of the queries. The varied meanings of words, sentences carrying multiple interpretations, and differing grammatical structures across languages contribute to the complexity of the MT task. The lack of structural constraints and the presence of ambiguity further compound the complications especially in case of web queries. The objective of this work is to assess the accuracy of free online translators in translating Hindi web queries. The accuracy of the translators has been evaluated on various metrics, i.e., BLEU, NIST, METEOR, hLepor, CHRF and GLEU. Our findings indicate that the translation accuracy for longer queries is higher than the shorter ones. Overall Google translator’s performance has been found the best while Systran performs the worst with 42.06% performance difference between the two. The present work intends to help researchers in further evaluating and analyzing the MT systems specially in context of web query translation, ultimately leading to improved translation quality and retrieval accuracy in CLIR.
Keywords: Machine translation, evaluation metrics, Hindi web query
DOI: 10.3233/JIFS-235532
Journal: Journal of Intelligent & Fuzzy Systems, vol. Pre-press, no. Pre-press, pp. 1-10, 2024
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
[email protected]
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office [email protected]
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
如果您在出版方面需要帮助或有任何建, 件至: [email protected]