This paper attempt to study the effectiveness of text representation schemes on two tasks namely: User Aggression and Fact Detection from the social media contents. In User Aggression detection, The aim is to identify the level of aggression from the contents generated in the Social media and written in the English, Devanagari Hindi and Romanized Hindi. Aggression levels are categorized into three predefined classes namely: `Non-aggressive`, `Overtly Aggressive`, and `Covertly Aggressive`. During the disaster-related incident, Social media like, Twitter is flooded with millions of posts. In such emergency situations, identification of factual posts is important for organizations involved in the relief operation. We anticipated this problem as a combination of classification and Ranking problem. This paper presents a comparison of various text representation scheme based on BoW techniques, distributed word/sentence representation, transfer learning on classifiers. Weighted $F_1$ score is used as a primary evaluation metric. Results show that text representation using BoW performs better than word embedding on machine learning classifiers. While pre-trained Word embedding techniques perform better on classifiers based on deep neural net. Recent transfer learning model like ELMO, ULMFiT are fine-tuned for the Aggression classification task. However, results are not at par with pre-trained word embedding model. Overall, word embedding using fastText produce best weighted $F_1$-score than Word2Vec and Glove. Results are further improved using pre-trained vector model. Statistical significance tests are employed to ensure the significance of the classification results. In the case of lexically different test Dataset, other than training Dataset, deep neural models are more robust and perform substantially better than machine learning classifiers.
Filter by Year
Filter by Author
P. D. Gujrati (8)
Manish Shrivastava (7)
Partha Pratim Roy (5)
Umapada Pal (5)
Iti Mathur (4)
Nisheeth Joshi (4)
Manish Shrivastava (7)
Partha Pratim Roy (5)
Umapada Pal (5)
Iti Mathur (4)
Nisheeth Joshi (4)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Subhadip Basu (3)
Nibaran Das (3)
Mita Nasipuri (3)
Dipak Kumar Basu (3)
Ankush Khandelwal (3)
Kamal Sarkar (3)
Dipak kumar Basu (3)
Akash Mohta (3)
Sahil Swami (3)
Ram Sarkar (3)
Mahantapas Kundu (3)
Pushpak Bhattacharyya (3)
Bidisha Samanta (2)
MD. Saiful Islam (2)
Richa Sharma (2)
Prakash B. Pimpale (2)
Sabir Ismail (2)
Nurendra Choudhary (2)
Mohd Zeeshan Ansari (2)
Raj Nath Patel (2)
Shweta Nigam (2)
Rekha Jain (2)
Md. Saiful Islam (2)
Rajat Singh (2)
U. Pal (2)
Syed Sarfaraz Akhtar (2)
B.B. Chaudhuri (2)
Simon King (1)
M Sasikumar (1)
G Manoj Kumar (1)
Saurabh Singh (1)
Mitesh M. Khapra (1)
Jasabanta Patro (1)
Vaishali Sharma (1)
A. Hassan (1)
Comma seperated list of Authors (1)
T. V. Prasad (1)
Nayan Jyoti Kalita (1)
Shahjalal Ahmed (1)
Manish Srivastava (1)
Abdul Hannan (1)
Rohit Mishra (1)
Madan Gopal Jhanwar (1)
Vishwajeet Kumar (1)
Arijit Mukherjee (1)
Nikita Moghe (1)
Md Zahangir Alom (1)
Md. Nawab Yousuf Ali (1)
Mirzanur Rahman (1)
Sree Harsha Ramesh (1)
Nitish Joshi (1)
Ajai Kumar (1)
Arnav Sharma (1)
Uma Shanker Tiwary (1)
S. Padmavathi (1)
Radhika Mamidi (1)
Minesh Mathew (1)
Sandip Modha (1)
Priya Rani (1)
Bajibabu Bollepalli (1)
N.V. Neeba (1)
Prithwish Mukherjee (1)
Rajmohan Pardeshi (1)
Pawanesh Abrol (1)
Lukáš Neumann (1)
Osama Alsaad (1)
Srikanth Doddamani (1)
Kandarpa Kumar Sarma (1)
Ching Y. Suen (1)
Sreelekha. S (1)
A. K. A. Azad (1)
P. SEETHARAMULU (1)
Sreelekha S (1)
Siddhartha Arora (1)
Md. Rafiqul Islam (1)
Amir Sadeghi (1)
Md Arshad Ali (1)
S. Sphoorthy Reddy (1)
Purnendu Banerjee (1)
S.S. Ravi Kiran (1)
Piyush Bansal (1)
Mallikarjun Hangarge (1)
Ankit Kumar (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Vijayan K. Asari (1)
S. Madhvanath (1)
Md. Abul Kalam Azad (1)
Vineet Chaitanya (1)
Amba P. Kulkarni (1)
Md. Hanif Seddiqui (1)
Minhaz Uddin Ahmed (1)
D. Meenakshy (1)
Sufal Das (1)
P.J. Narayanan (1)
Anirudh Dahiya (1)
Niloy Ganguly (1)
Tark M. Taha (1)
Souvik Bhowmick (1)
Prasenjit Majumder (1)
M.B. SUKHASWAMI (1)
Raveena R Kumar (1)
John Everatt (1)
R SaidasS. (1)
Abdul Rahiman M (1)
Neeraj Battan (1)
Ganji Sreeram (1)
Manju Manuel (1)
Vivek Kr Verma (1)
Nadir Durrani (1)
Md. Ataur Rahman (1)
Kalyanee Kanchan Baruah (1)
Sanjay Saha (1)
Siva Reddy (1)
Animesh Mukherjee (1)
Soumen Chakrabarti (1)
N Masha (1)
Md. Fahad Hasan (1)
Dipti M. Sharma (1)
Manojna K. S. S (1)
Shikha Kabra (1)
Juhi Ameta (1)
Anoop Namboodiri (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Bidyut B. Chaudhuri (1)
Avirup Bhattacharyya (1)
Nitigya Sambyal (1)
Satya Ranjan Dash (1)
Asif Ekbal (1)
T.S. Naveen (1)
Jahid Hassan (1)
Shashi Pal Singh (1)
Ahmad Musleh (1)
M Abdul Rahiman (1)
Mahmudul Hasan (1)
Srikanth Ronanki (1)
Bilkis Jamal Ferdosi (1)
Lubna Khan (1)
P. P. Aung (1)
Kamlesh Sharma (1)
Dipaloke Saha (1)
Rajasree M S (1)
Deepti Chopra (1)
M. R. Amin (1)
Girish Nath Jha (1)
Shubham Tripathi (1)
K. C. Santosh (1)
M S Rajasree (1)
Shrikant Malviya (1)
Shaikh Muhammad Allayear (1)
Tushar Patnaik (1)
Aditya Joshi (1)
Sakshi Gupta (1)
Baharul Islam (1)
Ishita Bindlish (1)
Preethi Jyothi (1)
Md. Shopon (1)
Vasudeva Varma (1)
Tanvir Ahmad (1)
Ritika Agarwal (1)
Mimisha Nesan (1)
S. V. A. V. Prasad (1)
Utpal Sharma (1)
ARUN K. PUJARI (1)
Vinay Singh (1)
Mohit Jain (1)
Chun Lei He (1)
Sudeshna Sarkar (1)
Atul Kr. Ojha (1)
M.N.S.S.K. Pavan Kumar (1)
Rohit Sinha (1)
Jiří Matas (1)
Irina Temnikova (1)
Pranjal Das (1)
Devendra Sachan (1)
Rikta Sen (1)
Bharath A (1)
Sushma Yalamanchili (1)
M. Kameswara Rao (1)
Suman Banerjee (1)
Dipti Mishra Sharma (1)
Ondřej Bojar (1)
Somnath Roy (1)
Monojit Choudhury (1)
Preslav Nakov (1)
Stephan Vogel (1)
S. M. Kamruzzaman (1)
Kaustubh Bhattacharyya (1)
M Rema (1)
Deepak Gupta (1)
Bradley P. Lambeth Jr (1)
Pawan Goyal (1)
Akanksha Gehlot (1)
Tasmin Afroz (1)
Sagar S. Rane (1)
Arpita Das (1)
U. Pal ; B.B. Chaudhuri (1)
R Meenakshi (1)
Syed S. Akhtar (1)
Raveesh Motlani (1)
Peheding Sidike (1)
Pramod Pandey (1)
Ashis Kumar Mandal (1)
Shikhar Kr. Sarma (1)
Shabbir Ahmad (1)
Shruti Tyagi (1)
Md Saddam Hossain (1)
Akshar Bharati (1)
Rajeev Sangal (1)
Shantipriya Parida (1)
Abhipsa Basu (1)
Nicola Nobile (1)
Evan Askanazi (1)
Shamim Ripon (1)
Shrey Dutta (1)
Malik Waqas Sagheer (1)
Rezwana Sharmeen (1)
Andrea Corsi (1)
Paheli Bhattacharya (1)
Ameya Prabhu (1)
More
C.V. Jawahar (4)
Subhadip Basu (3)
Nibaran Das (3)
Mita Nasipuri (3)
Dipak Kumar Basu (3)
Ankush Khandelwal (3)
Kamal Sarkar (3)
Dipak kumar Basu (3)
Akash Mohta (3)
Sahil Swami (3)
Ram Sarkar (3)
Mahantapas Kundu (3)
Pushpak Bhattacharyya (3)
Bidisha Samanta (2)
MD. Saiful Islam (2)
Richa Sharma (2)
Prakash B. Pimpale (2)
Sabir Ismail (2)
Nurendra Choudhary (2)
Mohd Zeeshan Ansari (2)
Raj Nath Patel (2)
Shweta Nigam (2)
Rekha Jain (2)
Md. Saiful Islam (2)
Rajat Singh (2)
U. Pal (2)
Syed Sarfaraz Akhtar (2)
B.B. Chaudhuri (2)
Simon King (1)
M Sasikumar (1)
G Manoj Kumar (1)
Saurabh Singh (1)
Mitesh M. Khapra (1)
Jasabanta Patro (1)
Vaishali Sharma (1)
A. Hassan (1)
Comma seperated list of Authors (1)
T. V. Prasad (1)
Nayan Jyoti Kalita (1)
Shahjalal Ahmed (1)
Manish Srivastava (1)
Abdul Hannan (1)
Rohit Mishra (1)
Madan Gopal Jhanwar (1)
Vishwajeet Kumar (1)
Arijit Mukherjee (1)
Nikita Moghe (1)
Md Zahangir Alom (1)
Md. Nawab Yousuf Ali (1)
Mirzanur Rahman (1)
Sree Harsha Ramesh (1)
Nitish Joshi (1)
Ajai Kumar (1)
Arnav Sharma (1)
Uma Shanker Tiwary (1)
S. Padmavathi (1)
Radhika Mamidi (1)
Minesh Mathew (1)
Sandip Modha (1)
Priya Rani (1)
Bajibabu Bollepalli (1)
N.V. Neeba (1)
Prithwish Mukherjee (1)
Rajmohan Pardeshi (1)
Pawanesh Abrol (1)
Lukáš Neumann (1)
Osama Alsaad (1)
Srikanth Doddamani (1)
Kandarpa Kumar Sarma (1)
Ching Y. Suen (1)
Sreelekha. S (1)
A. K. A. Azad (1)
P. SEETHARAMULU (1)
Sreelekha S (1)
Siddhartha Arora (1)
Md. Rafiqul Islam (1)
Amir Sadeghi (1)
Md Arshad Ali (1)
S. Sphoorthy Reddy (1)
Purnendu Banerjee (1)
S.S. Ravi Kiran (1)
Piyush Bansal (1)
Mallikarjun Hangarge (1)
Ankit Kumar (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Vijayan K. Asari (1)
S. Madhvanath (1)
Md. Abul Kalam Azad (1)
Vineet Chaitanya (1)
Amba P. Kulkarni (1)
Md. Hanif Seddiqui (1)
Minhaz Uddin Ahmed (1)
D. Meenakshy (1)
Sufal Das (1)
P.J. Narayanan (1)
Anirudh Dahiya (1)
Niloy Ganguly (1)
Tark M. Taha (1)
Souvik Bhowmick (1)
Prasenjit Majumder (1)
M.B. SUKHASWAMI (1)
Raveena R Kumar (1)
John Everatt (1)
R SaidasS. (1)
Abdul Rahiman M (1)
Neeraj Battan (1)
Ganji Sreeram (1)
Manju Manuel (1)
Vivek Kr Verma (1)
Nadir Durrani (1)
Md. Ataur Rahman (1)
Kalyanee Kanchan Baruah (1)
Sanjay Saha (1)
Siva Reddy (1)
Animesh Mukherjee (1)
Soumen Chakrabarti (1)
N Masha (1)
Md. Fahad Hasan (1)
Dipti M. Sharma (1)
Manojna K. S. S (1)
Shikha Kabra (1)
Juhi Ameta (1)
Anoop Namboodiri (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Bidyut B. Chaudhuri (1)
Avirup Bhattacharyya (1)
Nitigya Sambyal (1)
Satya Ranjan Dash (1)
Asif Ekbal (1)
T.S. Naveen (1)
Jahid Hassan (1)
Shashi Pal Singh (1)
Ahmad Musleh (1)
M Abdul Rahiman (1)
Mahmudul Hasan (1)
Srikanth Ronanki (1)
Bilkis Jamal Ferdosi (1)
Lubna Khan (1)
P. P. Aung (1)
Kamlesh Sharma (1)
Dipaloke Saha (1)
Rajasree M S (1)
Deepti Chopra (1)
M. R. Amin (1)
Girish Nath Jha (1)
Shubham Tripathi (1)
K. C. Santosh (1)
M S Rajasree (1)
Shrikant Malviya (1)
Shaikh Muhammad Allayear (1)
Tushar Patnaik (1)
Aditya Joshi (1)
Sakshi Gupta (1)
Baharul Islam (1)
Ishita Bindlish (1)
Preethi Jyothi (1)
Md. Shopon (1)
Vasudeva Varma (1)
Tanvir Ahmad (1)
Ritika Agarwal (1)
Mimisha Nesan (1)
S. V. A. V. Prasad (1)
Utpal Sharma (1)
ARUN K. PUJARI (1)
Vinay Singh (1)
Mohit Jain (1)
Chun Lei He (1)
Sudeshna Sarkar (1)
Atul Kr. Ojha (1)
M.N.S.S.K. Pavan Kumar (1)
Rohit Sinha (1)
Jiří Matas (1)
Irina Temnikova (1)
Pranjal Das (1)
Devendra Sachan (1)
Rikta Sen (1)
Bharath A (1)
Sushma Yalamanchili (1)
M. Kameswara Rao (1)
Suman Banerjee (1)
Dipti Mishra Sharma (1)
Ondřej Bojar (1)
Somnath Roy (1)
Monojit Choudhury (1)
Preslav Nakov (1)
Stephan Vogel (1)
S. M. Kamruzzaman (1)
Kaustubh Bhattacharyya (1)
M Rema (1)
Deepak Gupta (1)
Bradley P. Lambeth Jr (1)
Pawan Goyal (1)
Akanksha Gehlot (1)
Tasmin Afroz (1)
Sagar S. Rane (1)
Arpita Das (1)
U. Pal ; B.B. Chaudhuri (1)
R Meenakshi (1)
Syed S. Akhtar (1)
Raveesh Motlani (1)
Peheding Sidike (1)
Pramod Pandey (1)
Ashis Kumar Mandal (1)
Shikhar Kr. Sarma (1)
Shabbir Ahmad (1)
Shruti Tyagi (1)
Md Saddam Hossain (1)
Akshar Bharati (1)
Rajeev Sangal (1)
Shantipriya Parida (1)
Abhipsa Basu (1)
Nicola Nobile (1)
Evan Askanazi (1)
Shamim Ripon (1)
Shrey Dutta (1)
Malik Waqas Sagheer (1)
Rezwana Sharmeen (1)
Andrea Corsi (1)
Paheli Bhattacharya (1)
Ameya Prabhu (1)