This paper attempt to study the effectiveness of text representation schemes on two tasks namely: User Aggression and Fact Detection from the social media contents. In User Aggression detection, The aim is to identify the level of aggression from the contents generated in the Social media and written in the English, Devanagari Hindi and Romanized Hindi. Aggression levels are categorized into three predefined classes namely: `Non-aggressive`, `Overtly Aggressive`, and `Covertly Aggressive`. During the disaster-related incident, Social media like, Twitter is flooded with millions of posts. In such emergency situations, identification of factual posts is important for organizations involved in the relief operation. We anticipated this problem as a combination of classification and Ranking problem. This paper presents a comparison of various text representation scheme based on BoW techniques, distributed word/sentence representation, transfer learning on classifiers. Weighted $F_1$ score is used as a primary evaluation metric. Results show that text representation using BoW performs better than word embedding on machine learning classifiers. While pre-trained Word embedding techniques perform better on classifiers based on deep neural net. Recent transfer learning model like ELMO, ULMFiT are fine-tuned for the Aggression classification task. However, results are not at par with pre-trained word embedding model. Overall, word embedding using fastText produce best weighted $F_1$-score than Word2Vec and Glove. Results are further improved using pre-trained vector model. Statistical significance tests are employed to ensure the significance of the classification results. In the case of lexically different test Dataset, other than training Dataset, deep neural models are more robust and perform substantially better than machine learning classifiers.
Filter by Year
Filter by Author
P. D. Gujrati (8)
Manish Shrivastava (7)
Umapada Pal (5)
Partha Pratim Roy (5)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Manish Shrivastava (7)
Umapada Pal (5)
Partha Pratim Roy (5)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Iti Mathur (4)
Nisheeth Joshi (4)
Ram Sarkar (3)
Akash Mohta (3)
Pushpak Bhattacharyya (3)
Dipak kumar Basu (3)
Mita Nasipuri (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Nibaran Das (3)
Dipak Kumar Basu (3)
Sahil Swami (3)
Subhadip Basu (3)
Mahantapas Kundu (3)
B.B. Chaudhuri (2)
Raj Nath Patel (2)
Mohd Zeeshan Ansari (2)
U. Pal (2)
Shweta Nigam (2)
Prakash B. Pimpale (2)
Bidisha Samanta (2)
Rekha Jain (2)
MD. Saiful Islam (2)
Rajat Singh (2)
Nurendra Choudhary (2)
Sabir Ismail (2)
Syed Sarfaraz Akhtar (2)
Richa Sharma (2)
Md. Saiful Islam (2)
Siva Reddy (1)
Vivek Kr Verma (1)
Anoop Namboodiri (1)
Minesh Mathew (1)
Evan Askanazi (1)
Md. Hanif Seddiqui (1)
Syed S. Akhtar (1)
Vaishali Sharma (1)
Sudeshna Sarkar (1)
Md Saddam Hossain (1)
Devendra Sachan (1)
Neeraj Battan (1)
Vinay Singh (1)
Rajasree M S (1)
A. K. A. Azad (1)
Asif Ekbal (1)
Vasudeva Varma (1)
Shashi Pal Singh (1)
Vijayan K. Asari (1)
Md. Ataur Rahman (1)
Manojna K. S. S (1)
Tark M. Taha (1)
Utpal Sharma (1)
Stephan Vogel (1)
Sreelekha. S (1)
Nikita Moghe (1)
T.S. Naveen (1)
Md. Rafiqul Islam (1)
Shruti Tyagi (1)
M Rema (1)
Souvik Bhowmick (1)
Preethi Jyothi (1)
Animesh Mukherjee (1)
Jahid Hassan (1)
Paheli Bhattacharya (1)
Saurabh Singh (1)
Sagar S. Rane (1)
Pawan Goyal (1)
Prasenjit Majumder (1)
Sushma Yalamanchili (1)
Sakshi Gupta (1)
Vineet Chaitanya (1)
Mirzanur Rahman (1)
Vishwajeet Kumar (1)
N Masha (1)
Sanjay Saha (1)
Simon King (1)
Abdul Hannan (1)
D. Meenakshy (1)
Rohit Mishra (1)
Abhipsa Basu (1)
S. M. Kamruzzaman (1)
Comma seperated list of Authors (1)
Prithwish Mukherjee (1)
Mallikarjun Hangarge (1)
Madan Gopal Jhanwar (1)
Manju Manuel (1)
Minhaz Uddin Ahmed (1)
Irina Temnikova (1)
Sandip Modha (1)
Priya Rani (1)
M Abdul Rahiman (1)
Raveesh Motlani (1)
Jasabanta Patro (1)
P. P. Aung (1)
Arpita Das (1)
N.V. Neeba (1)
Ameya Prabhu (1)
Mahmudul Hasan (1)
Tasmin Afroz (1)
Nadir Durrani (1)
Akshar Bharati (1)
Md Arshad Ali (1)
Raveena R Kumar (1)
M Sasikumar (1)
Md. Nawab Yousuf Ali (1)
Shubham Tripathi (1)
Mimisha Nesan (1)
Md. Fahad Hasan (1)
Somnath Roy (1)
Ritika Agarwal (1)
Ching Y. Suen (1)
Kaustubh Bhattacharyya (1)
S. Sphoorthy Reddy (1)
Lukáš Neumann (1)
Ashis Kumar Mandal (1)
Deepti Chopra (1)
Monojit Choudhury (1)
Dipti M. Sharma (1)
Pawanesh Abrol (1)
Dipaloke Saha (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Sreelekha S (1)
Piyush Bansal (1)
Lubna Khan (1)
Andrea Corsi (1)
P.J. Narayanan (1)
Aditya Joshi (1)
Pramod Pandey (1)
Dipti Mishra Sharma (1)
Arnav Sharma (1)
Anirudh Dahiya (1)
Uma Shanker Tiwary (1)
Bharath A (1)
G Manoj Kumar (1)
S.S. Ravi Kiran (1)
Md Zahangir Alom (1)
Bidyut B. Chaudhuri (1)
Srikanth Doddamani (1)
T. V. Prasad (1)
Manish Srivastava (1)
Shahjalal Ahmed (1)
Nicola Nobile (1)
Tanvir Ahmad (1)
Girish Nath Jha (1)
Peheding Sidike (1)
Mitesh M. Khapra (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Shikha Kabra (1)
Bajibabu Bollepalli (1)
Shaikh Muhammad Allayear (1)
Arijit Mukherjee (1)
M.B. SUKHASWAMI (1)
Mohit Jain (1)
S. V. A. V. Prasad (1)
Chun Lei He (1)
Baharul Islam (1)
Sree Harsha Ramesh (1)
P. SEETHARAMULU (1)
R SaidasS. (1)
S. Padmavathi (1)
Shamim Ripon (1)
Abdul Rahiman M (1)
Rajeev Sangal (1)
Soumen Chakrabarti (1)
Ahmad Musleh (1)
Md. Shopon (1)
ARUN K. PUJARI (1)
Nitigya Sambyal (1)
Ishita Bindlish (1)
Tushar Patnaik (1)
M. Kameswara Rao (1)
Amir Sadeghi (1)
Shabbir Ahmad (1)
Juhi Ameta (1)
U. Pal ; B.B. Chaudhuri (1)
K. C. Santosh (1)
Amba P. Kulkarni (1)
Nayan Jyoti Kalita (1)
Preslav Nakov (1)
Rajmohan Pardeshi (1)
Jiří Matas (1)
M S Rajasree (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Pranjal Das (1)
Rohit Sinha (1)
Ondřej Bojar (1)
Shikhar Kr. Sarma (1)
Md. Abul Kalam Azad (1)
Kandarpa Kumar Sarma (1)
Shrikant Malviya (1)
Ankit Kumar (1)
Srikanth Ronanki (1)
M. R. Amin (1)
Radhika Mamidi (1)
Osama Alsaad (1)
Akanksha Gehlot (1)
Shrey Dutta (1)
Sufal Das (1)
Atul Kr. Ojha (1)
Purnendu Banerjee (1)
Nitish Joshi (1)
Ajai Kumar (1)
Shantipriya Parida (1)
Siddhartha Arora (1)
S. Madhvanath (1)
Kalyanee Kanchan Baruah (1)
Suman Banerjee (1)
Bilkis Jamal Ferdosi (1)
Rikta Sen (1)
M.N.S.S.K. Pavan Kumar (1)
R Meenakshi (1)
A. Hassan (1)
Malik Waqas Sagheer (1)
Ganji Sreeram (1)
Avirup Bhattacharyya (1)
John Everatt (1)
Bradley P. Lambeth Jr (1)
Kamlesh Sharma (1)
Satya Ranjan Dash (1)
Deepak Gupta (1)
More
Nisheeth Joshi (4)
Ram Sarkar (3)
Akash Mohta (3)
Pushpak Bhattacharyya (3)
Dipak kumar Basu (3)
Mita Nasipuri (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Nibaran Das (3)
Dipak Kumar Basu (3)
Sahil Swami (3)
Subhadip Basu (3)
Mahantapas Kundu (3)
B.B. Chaudhuri (2)
Raj Nath Patel (2)
Mohd Zeeshan Ansari (2)
U. Pal (2)
Shweta Nigam (2)
Prakash B. Pimpale (2)
Bidisha Samanta (2)
Rekha Jain (2)
MD. Saiful Islam (2)
Rajat Singh (2)
Nurendra Choudhary (2)
Sabir Ismail (2)
Syed Sarfaraz Akhtar (2)
Richa Sharma (2)
Md. Saiful Islam (2)
Siva Reddy (1)
Vivek Kr Verma (1)
Anoop Namboodiri (1)
Minesh Mathew (1)
Evan Askanazi (1)
Md. Hanif Seddiqui (1)
Syed S. Akhtar (1)
Vaishali Sharma (1)
Sudeshna Sarkar (1)
Md Saddam Hossain (1)
Devendra Sachan (1)
Neeraj Battan (1)
Vinay Singh (1)
Rajasree M S (1)
A. K. A. Azad (1)
Asif Ekbal (1)
Vasudeva Varma (1)
Shashi Pal Singh (1)
Vijayan K. Asari (1)
Md. Ataur Rahman (1)
Manojna K. S. S (1)
Tark M. Taha (1)
Utpal Sharma (1)
Stephan Vogel (1)
Sreelekha. S (1)
Nikita Moghe (1)
T.S. Naveen (1)
Md. Rafiqul Islam (1)
Shruti Tyagi (1)
M Rema (1)
Souvik Bhowmick (1)
Preethi Jyothi (1)
Animesh Mukherjee (1)
Jahid Hassan (1)
Paheli Bhattacharya (1)
Saurabh Singh (1)
Sagar S. Rane (1)
Pawan Goyal (1)
Prasenjit Majumder (1)
Sushma Yalamanchili (1)
Sakshi Gupta (1)
Vineet Chaitanya (1)
Mirzanur Rahman (1)
Vishwajeet Kumar (1)
N Masha (1)
Sanjay Saha (1)
Simon King (1)
Abdul Hannan (1)
D. Meenakshy (1)
Rohit Mishra (1)
Abhipsa Basu (1)
S. M. Kamruzzaman (1)
Comma seperated list of Authors (1)
Prithwish Mukherjee (1)
Mallikarjun Hangarge (1)
Madan Gopal Jhanwar (1)
Manju Manuel (1)
Minhaz Uddin Ahmed (1)
Irina Temnikova (1)
Sandip Modha (1)
Priya Rani (1)
M Abdul Rahiman (1)
Raveesh Motlani (1)
Jasabanta Patro (1)
P. P. Aung (1)
Arpita Das (1)
N.V. Neeba (1)
Ameya Prabhu (1)
Mahmudul Hasan (1)
Tasmin Afroz (1)
Nadir Durrani (1)
Akshar Bharati (1)
Md Arshad Ali (1)
Raveena R Kumar (1)
M Sasikumar (1)
Md. Nawab Yousuf Ali (1)
Shubham Tripathi (1)
Mimisha Nesan (1)
Md. Fahad Hasan (1)
Somnath Roy (1)
Ritika Agarwal (1)
Ching Y. Suen (1)
Kaustubh Bhattacharyya (1)
S. Sphoorthy Reddy (1)
Lukáš Neumann (1)
Ashis Kumar Mandal (1)
Deepti Chopra (1)
Monojit Choudhury (1)
Dipti M. Sharma (1)
Pawanesh Abrol (1)
Dipaloke Saha (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Sreelekha S (1)
Piyush Bansal (1)
Lubna Khan (1)
Andrea Corsi (1)
P.J. Narayanan (1)
Aditya Joshi (1)
Pramod Pandey (1)
Dipti Mishra Sharma (1)
Arnav Sharma (1)
Anirudh Dahiya (1)
Uma Shanker Tiwary (1)
Bharath A (1)
G Manoj Kumar (1)
S.S. Ravi Kiran (1)
Md Zahangir Alom (1)
Bidyut B. Chaudhuri (1)
Srikanth Doddamani (1)
T. V. Prasad (1)
Manish Srivastava (1)
Shahjalal Ahmed (1)
Nicola Nobile (1)
Tanvir Ahmad (1)
Girish Nath Jha (1)
Peheding Sidike (1)
Mitesh M. Khapra (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Shikha Kabra (1)
Bajibabu Bollepalli (1)
Shaikh Muhammad Allayear (1)
Arijit Mukherjee (1)
M.B. SUKHASWAMI (1)
Mohit Jain (1)
S. V. A. V. Prasad (1)
Chun Lei He (1)
Baharul Islam (1)
Sree Harsha Ramesh (1)
P. SEETHARAMULU (1)
R SaidasS. (1)
S. Padmavathi (1)
Shamim Ripon (1)
Abdul Rahiman M (1)
Rajeev Sangal (1)
Soumen Chakrabarti (1)
Ahmad Musleh (1)
Md. Shopon (1)
ARUN K. PUJARI (1)
Nitigya Sambyal (1)
Ishita Bindlish (1)
Tushar Patnaik (1)
M. Kameswara Rao (1)
Amir Sadeghi (1)
Shabbir Ahmad (1)
Juhi Ameta (1)
U. Pal ; B.B. Chaudhuri (1)
K. C. Santosh (1)
Amba P. Kulkarni (1)
Nayan Jyoti Kalita (1)
Preslav Nakov (1)
Rajmohan Pardeshi (1)
Jiří Matas (1)
M S Rajasree (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Pranjal Das (1)
Rohit Sinha (1)
Ondřej Bojar (1)
Shikhar Kr. Sarma (1)
Md. Abul Kalam Azad (1)
Kandarpa Kumar Sarma (1)
Shrikant Malviya (1)
Ankit Kumar (1)
Srikanth Ronanki (1)
M. R. Amin (1)
Radhika Mamidi (1)
Osama Alsaad (1)
Akanksha Gehlot (1)
Shrey Dutta (1)
Sufal Das (1)
Atul Kr. Ojha (1)
Purnendu Banerjee (1)
Nitish Joshi (1)
Ajai Kumar (1)
Shantipriya Parida (1)
Siddhartha Arora (1)
S. Madhvanath (1)
Kalyanee Kanchan Baruah (1)
Suman Banerjee (1)
Bilkis Jamal Ferdosi (1)
Rikta Sen (1)
M.N.S.S.K. Pavan Kumar (1)
R Meenakshi (1)
A. Hassan (1)
Malik Waqas Sagheer (1)
Ganji Sreeram (1)
Avirup Bhattacharyya (1)
John Everatt (1)
Bradley P. Lambeth Jr (1)
Kamlesh Sharma (1)
Satya Ranjan Dash (1)
Deepak Gupta (1)