Visual Genome is a dataset connecting structured image information with English language. We present ``Hindi Visual Genome'', a multimodal dataset consisting of text and images suitable for English-Hindi multimodal machine translation task and multimodal research. We have selected short English segments (captions) from Visual Genome along with associated images and automatically translated them to Hindi with manual post-editing which took the associated images into account. We prepared a set of 31525 segments, accompanied by a challenge test set of 1400 segments. This challenge test set was created by searching for (particularly) ambiguous English words based on the embedding similarity and manually selecting those where the image helps to resolve the ambiguity. Our dataset is the first for multimodal English-Hindi machine translation, freely available for non-commercial research purposes. Our Hindi version of Visual Genome also allows to create Hindi image labelers or other practical tools. Hindi Visual Genome also serves in Workshop on Asian Translation (WAT) 2019 Multi-Modal Translation Task.
Filter by Year
Filter by Author
P. D. Gujrati (8)
Manish Shrivastava (7)
Umapada Pal (5)
Partha Pratim Roy (5)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Manish Shrivastava (7)
Umapada Pal (5)
Partha Pratim Roy (5)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Iti Mathur (4)
Nisheeth Joshi (4)
Ram Sarkar (3)
Akash Mohta (3)
Pushpak Bhattacharyya (3)
Dipak kumar Basu (3)
Mita Nasipuri (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Nibaran Das (3)
Dipak Kumar Basu (3)
Sahil Swami (3)
Subhadip Basu (3)
Mahantapas Kundu (3)
B.B. Chaudhuri (2)
Raj Nath Patel (2)
Mohd Zeeshan Ansari (2)
U. Pal (2)
Shweta Nigam (2)
Prakash B. Pimpale (2)
Bidisha Samanta (2)
Rekha Jain (2)
MD. Saiful Islam (2)
Rajat Singh (2)
Nurendra Choudhary (2)
Sabir Ismail (2)
Syed Sarfaraz Akhtar (2)
Richa Sharma (2)
Md. Saiful Islam (2)
Siva Reddy (1)
Vivek Kr Verma (1)
Anoop Namboodiri (1)
Minesh Mathew (1)
Evan Askanazi (1)
Md. Hanif Seddiqui (1)
Syed S. Akhtar (1)
Vaishali Sharma (1)
Sudeshna Sarkar (1)
Md Saddam Hossain (1)
Devendra Sachan (1)
Neeraj Battan (1)
Vinay Singh (1)
Rajasree M S (1)
A. K. A. Azad (1)
Asif Ekbal (1)
Vasudeva Varma (1)
Shashi Pal Singh (1)
Vijayan K. Asari (1)
Md. Ataur Rahman (1)
Manojna K. S. S (1)
Tark M. Taha (1)
Utpal Sharma (1)
Stephan Vogel (1)
Sreelekha. S (1)
Nikita Moghe (1)
T.S. Naveen (1)
Md. Rafiqul Islam (1)
Shruti Tyagi (1)
M Rema (1)
Souvik Bhowmick (1)
Preethi Jyothi (1)
Animesh Mukherjee (1)
Jahid Hassan (1)
Paheli Bhattacharya (1)
Saurabh Singh (1)
Sagar S. Rane (1)
Pawan Goyal (1)
Prasenjit Majumder (1)
Sushma Yalamanchili (1)
Sakshi Gupta (1)
Vineet Chaitanya (1)
Mirzanur Rahman (1)
Vishwajeet Kumar (1)
N Masha (1)
Sanjay Saha (1)
Simon King (1)
Abdul Hannan (1)
D. Meenakshy (1)
Rohit Mishra (1)
Abhipsa Basu (1)
S. M. Kamruzzaman (1)
Comma seperated list of Authors (1)
Prithwish Mukherjee (1)
Mallikarjun Hangarge (1)
Madan Gopal Jhanwar (1)
Manju Manuel (1)
Minhaz Uddin Ahmed (1)
Irina Temnikova (1)
Sandip Modha (1)
Priya Rani (1)
M Abdul Rahiman (1)
Raveesh Motlani (1)
Jasabanta Patro (1)
P. P. Aung (1)
Arpita Das (1)
N.V. Neeba (1)
Ameya Prabhu (1)
Mahmudul Hasan (1)
Tasmin Afroz (1)
Nadir Durrani (1)
Akshar Bharati (1)
Md Arshad Ali (1)
Raveena R Kumar (1)
M Sasikumar (1)
Md. Nawab Yousuf Ali (1)
Shubham Tripathi (1)
Mimisha Nesan (1)
Md. Fahad Hasan (1)
Somnath Roy (1)
Ritika Agarwal (1)
Ching Y. Suen (1)
Kaustubh Bhattacharyya (1)
S. Sphoorthy Reddy (1)
Lukáš Neumann (1)
Ashis Kumar Mandal (1)
Deepti Chopra (1)
Monojit Choudhury (1)
Dipti M. Sharma (1)
Pawanesh Abrol (1)
Dipaloke Saha (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Sreelekha S (1)
Piyush Bansal (1)
Lubna Khan (1)
Andrea Corsi (1)
P.J. Narayanan (1)
Aditya Joshi (1)
Pramod Pandey (1)
Dipti Mishra Sharma (1)
Arnav Sharma (1)
Anirudh Dahiya (1)
Uma Shanker Tiwary (1)
Bharath A (1)
G Manoj Kumar (1)
S.S. Ravi Kiran (1)
Md Zahangir Alom (1)
Bidyut B. Chaudhuri (1)
Srikanth Doddamani (1)
T. V. Prasad (1)
Manish Srivastava (1)
Shahjalal Ahmed (1)
Nicola Nobile (1)
Tanvir Ahmad (1)
Girish Nath Jha (1)
Peheding Sidike (1)
Mitesh M. Khapra (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Shikha Kabra (1)
Bajibabu Bollepalli (1)
Shaikh Muhammad Allayear (1)
Arijit Mukherjee (1)
M.B. SUKHASWAMI (1)
Mohit Jain (1)
S. V. A. V. Prasad (1)
Chun Lei He (1)
Baharul Islam (1)
Sree Harsha Ramesh (1)
P. SEETHARAMULU (1)
R SaidasS. (1)
S. Padmavathi (1)
Shamim Ripon (1)
Abdul Rahiman M (1)
Rajeev Sangal (1)
Soumen Chakrabarti (1)
Ahmad Musleh (1)
Md. Shopon (1)
ARUN K. PUJARI (1)
Nitigya Sambyal (1)
Ishita Bindlish (1)
Tushar Patnaik (1)
M. Kameswara Rao (1)
Amir Sadeghi (1)
Shabbir Ahmad (1)
Juhi Ameta (1)
U. Pal ; B.B. Chaudhuri (1)
K. C. Santosh (1)
Amba P. Kulkarni (1)
Nayan Jyoti Kalita (1)
Preslav Nakov (1)
Rajmohan Pardeshi (1)
Jiří Matas (1)
M S Rajasree (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Pranjal Das (1)
Rohit Sinha (1)
Ondřej Bojar (1)
Shikhar Kr. Sarma (1)
Md. Abul Kalam Azad (1)
Kandarpa Kumar Sarma (1)
Shrikant Malviya (1)
Ankit Kumar (1)
Srikanth Ronanki (1)
M. R. Amin (1)
Radhika Mamidi (1)
Osama Alsaad (1)
Akanksha Gehlot (1)
Shrey Dutta (1)
Sufal Das (1)
Atul Kr. Ojha (1)
Purnendu Banerjee (1)
Nitish Joshi (1)
Ajai Kumar (1)
Shantipriya Parida (1)
Siddhartha Arora (1)
S. Madhvanath (1)
Kalyanee Kanchan Baruah (1)
Suman Banerjee (1)
Bilkis Jamal Ferdosi (1)
Rikta Sen (1)
M.N.S.S.K. Pavan Kumar (1)
R Meenakshi (1)
A. Hassan (1)
Malik Waqas Sagheer (1)
Ganji Sreeram (1)
Avirup Bhattacharyya (1)
John Everatt (1)
Bradley P. Lambeth Jr (1)
Kamlesh Sharma (1)
Satya Ranjan Dash (1)
Deepak Gupta (1)
More
Nisheeth Joshi (4)
Ram Sarkar (3)
Akash Mohta (3)
Pushpak Bhattacharyya (3)
Dipak kumar Basu (3)
Mita Nasipuri (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Nibaran Das (3)
Dipak Kumar Basu (3)
Sahil Swami (3)
Subhadip Basu (3)
Mahantapas Kundu (3)
B.B. Chaudhuri (2)
Raj Nath Patel (2)
Mohd Zeeshan Ansari (2)
U. Pal (2)
Shweta Nigam (2)
Prakash B. Pimpale (2)
Bidisha Samanta (2)
Rekha Jain (2)
MD. Saiful Islam (2)
Rajat Singh (2)
Nurendra Choudhary (2)
Sabir Ismail (2)
Syed Sarfaraz Akhtar (2)
Richa Sharma (2)
Md. Saiful Islam (2)
Siva Reddy (1)
Vivek Kr Verma (1)
Anoop Namboodiri (1)
Minesh Mathew (1)
Evan Askanazi (1)
Md. Hanif Seddiqui (1)
Syed S. Akhtar (1)
Vaishali Sharma (1)
Sudeshna Sarkar (1)
Md Saddam Hossain (1)
Devendra Sachan (1)
Neeraj Battan (1)
Vinay Singh (1)
Rajasree M S (1)
A. K. A. Azad (1)
Asif Ekbal (1)
Vasudeva Varma (1)
Shashi Pal Singh (1)
Vijayan K. Asari (1)
Md. Ataur Rahman (1)
Manojna K. S. S (1)
Tark M. Taha (1)
Utpal Sharma (1)
Stephan Vogel (1)
Sreelekha. S (1)
Nikita Moghe (1)
T.S. Naveen (1)
Md. Rafiqul Islam (1)
Shruti Tyagi (1)
M Rema (1)
Souvik Bhowmick (1)
Preethi Jyothi (1)
Animesh Mukherjee (1)
Jahid Hassan (1)
Paheli Bhattacharya (1)
Saurabh Singh (1)
Sagar S. Rane (1)
Pawan Goyal (1)
Prasenjit Majumder (1)
Sushma Yalamanchili (1)
Sakshi Gupta (1)
Vineet Chaitanya (1)
Mirzanur Rahman (1)
Vishwajeet Kumar (1)
N Masha (1)
Sanjay Saha (1)
Simon King (1)
Abdul Hannan (1)
D. Meenakshy (1)
Rohit Mishra (1)
Abhipsa Basu (1)
S. M. Kamruzzaman (1)
Comma seperated list of Authors (1)
Prithwish Mukherjee (1)
Mallikarjun Hangarge (1)
Madan Gopal Jhanwar (1)
Manju Manuel (1)
Minhaz Uddin Ahmed (1)
Irina Temnikova (1)
Sandip Modha (1)
Priya Rani (1)
M Abdul Rahiman (1)
Raveesh Motlani (1)
Jasabanta Patro (1)
P. P. Aung (1)
Arpita Das (1)
N.V. Neeba (1)
Ameya Prabhu (1)
Mahmudul Hasan (1)
Tasmin Afroz (1)
Nadir Durrani (1)
Akshar Bharati (1)
Md Arshad Ali (1)
Raveena R Kumar (1)
M Sasikumar (1)
Md. Nawab Yousuf Ali (1)
Shubham Tripathi (1)
Mimisha Nesan (1)
Md. Fahad Hasan (1)
Somnath Roy (1)
Ritika Agarwal (1)
Ching Y. Suen (1)
Kaustubh Bhattacharyya (1)
S. Sphoorthy Reddy (1)
Lukáš Neumann (1)
Ashis Kumar Mandal (1)
Deepti Chopra (1)
Monojit Choudhury (1)
Dipti M. Sharma (1)
Pawanesh Abrol (1)
Dipaloke Saha (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Sreelekha S (1)
Piyush Bansal (1)
Lubna Khan (1)
Andrea Corsi (1)
P.J. Narayanan (1)
Aditya Joshi (1)
Pramod Pandey (1)
Dipti Mishra Sharma (1)
Arnav Sharma (1)
Anirudh Dahiya (1)
Uma Shanker Tiwary (1)
Bharath A (1)
G Manoj Kumar (1)
S.S. Ravi Kiran (1)
Md Zahangir Alom (1)
Bidyut B. Chaudhuri (1)
Srikanth Doddamani (1)
T. V. Prasad (1)
Manish Srivastava (1)
Shahjalal Ahmed (1)
Nicola Nobile (1)
Tanvir Ahmad (1)
Girish Nath Jha (1)
Peheding Sidike (1)
Mitesh M. Khapra (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Shikha Kabra (1)
Bajibabu Bollepalli (1)
Shaikh Muhammad Allayear (1)
Arijit Mukherjee (1)
M.B. SUKHASWAMI (1)
Mohit Jain (1)
S. V. A. V. Prasad (1)
Chun Lei He (1)
Baharul Islam (1)
Sree Harsha Ramesh (1)
P. SEETHARAMULU (1)
R SaidasS. (1)
S. Padmavathi (1)
Shamim Ripon (1)
Abdul Rahiman M (1)
Rajeev Sangal (1)
Soumen Chakrabarti (1)
Ahmad Musleh (1)
Md. Shopon (1)
ARUN K. PUJARI (1)
Nitigya Sambyal (1)
Ishita Bindlish (1)
Tushar Patnaik (1)
M. Kameswara Rao (1)
Amir Sadeghi (1)
Shabbir Ahmad (1)
Juhi Ameta (1)
U. Pal ; B.B. Chaudhuri (1)
K. C. Santosh (1)
Amba P. Kulkarni (1)
Nayan Jyoti Kalita (1)
Preslav Nakov (1)
Rajmohan Pardeshi (1)
Jiří Matas (1)
M S Rajasree (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Pranjal Das (1)
Rohit Sinha (1)
Ondřej Bojar (1)
Shikhar Kr. Sarma (1)
Md. Abul Kalam Azad (1)
Kandarpa Kumar Sarma (1)
Shrikant Malviya (1)
Ankit Kumar (1)
Srikanth Ronanki (1)
M. R. Amin (1)
Radhika Mamidi (1)
Osama Alsaad (1)
Akanksha Gehlot (1)
Shrey Dutta (1)
Sufal Das (1)
Atul Kr. Ojha (1)
Purnendu Banerjee (1)
Nitish Joshi (1)
Ajai Kumar (1)
Shantipriya Parida (1)
Siddhartha Arora (1)
S. Madhvanath (1)
Kalyanee Kanchan Baruah (1)
Suman Banerjee (1)
Bilkis Jamal Ferdosi (1)
Rikta Sen (1)
M.N.S.S.K. Pavan Kumar (1)
R Meenakshi (1)
A. Hassan (1)
Malik Waqas Sagheer (1)
Ganji Sreeram (1)
Avirup Bhattacharyya (1)
John Everatt (1)
Bradley P. Lambeth Jr (1)
Kamlesh Sharma (1)
Satya Ranjan Dash (1)
Deepak Gupta (1)