Expert Detection In Question Answer Communities

Document Type : Original Article

Authors

Computer Engineering Dept., Sharif University of Technology, Tehran, Iran

Abstract

Community Question Answering has a crucial role in almost all societies nowadays. It is important for the owners of a community to be able to make it better and more reliable. One way to achieve this, is to find the users who have more knowledge, expertise, experience and skill and can well share their knowledge with others (which we call experts and aim to encourage them to be more active in the website). One method to use is to identify expert users, and whenever a new question is asked, we suggest this question to them to check and answer if its in their area of expertise. One way to encourage users to post replies, is to use gameplay techniques such as assigning points and badges to users. But as we will discuss, this method does not always detect expert users well, because some users will try to have small and insignificant but numerous activities that will make them gain a lot of points, however they are not experts. In this study, we examine the methods by which experts in a question-and-answer system can be found, and try to evaluate and compare these methods, use their ideas and positive points, and add our own new ideas to a new way of finding them. We used some ideas such as profile making for users, categorize users’ expertise, A-Priori algorithm and showed that neural networks method results the best for the purpose of expert detection.

Keywords


  • Yuan, Y. Zhang, J. Tang, W. Hall, and J. B. Cabotà, “Expert finding in community question answering: a review”, Artificial Intelligence Review, vol. 53, no. 2, pp. 843-874, 2020.
  • Wei, J. He, K. Chen, Y. Zhou, and Z. Tang, “Collaborative filtering and deep learning based recommendation system for cold start items”, Expert Systems with Applications, vol. 69, pp. 29-39, 2017.
  • Tian, W. Ng, J. Cao, and S. McIntosh, “Geek talents: Who are the top experts on github and stack overflow?”, CMC-COMPUTERS MATERIALS & CONTINUA, vol. 61, no.2, pp.465-479, 2019.
  • Ghasemi, R. Fatourechi, and S. Momtazi, “User embedding for expert finding in community question answering”, ACM Transactions on Knowledge Discovery from Data (TKDD), vol. 15, no. 4, pp.1-16, 2021.
  • Zhao, Q. Yang, D. Cai, X. He, and Y. Zhuang, “Expert Finding for Community-Based Question Answering via”, in Ijcai, vol 15, 2016, pp. 3000-3006.
  • D. Nobari, M. Neshati, and S. S. Gharebagh, “Quality-aware skill translation models for expert finding on StackOverflow”, Information Systems, vol. 87, p. 101413, 2020.
  • Sumanth, and K. Rajeshwari, “Discovering Top Experts for Trending Domains on Stack Overflow”, Procedia computer science, vol. 143, pp. 333-340, 2018.
  • Panichella, G. Canfora, and, A. Di Sorbo, “Won't We Fix this Issue? Qualitative characterization and automated identification of wontfix issues on GitHub”, Information and Software Technology, vol. 139, p. 106665, 2021.
  • Bhanu, and J. Chandra, “Exploiting response patterns for identifying topical experts in stackoverflow”, in Eleventh International Conference on Digital Information Management (ICDIM), IEEE, 2016, pp. 139-144.
  • A. Oliveira, M. Viggiato, D. Pinheiro, and E. Figueiredo, “Mining Experts from Source Code Analysis: An Empirical Evaluation”, Journal of Software Engineering Research and Development, vol. 9, pp. 1-16, 2021.
  • Liu, H. Shen, and L. Yu, “Question quality analysis and prediction in community question answering services with coupled mutual reinforcement”, IEEE Transactions on Services Computing,, vol. 10, no. 2, pp. 286-301, 2015.
  • Bozzon, M. Brambilla, S. Ceri, M. Silvestri, and G. Vesci, ‘March. Choosing the right crowd: expert finding in social networks’, In Proceedings of the 16th international conference on extending database technology, 2013, pp. 637-648.
  • Srba, M. Grznar, and M. Bielikova, “Utilizing non-qa data to improve questions routing for users with low qa activity in cqa”, in he 2015 IEEE/ACM international conference on advances in social networks analysis and mining 2015, 2015, pp. 129-136.
  • Wang, J. Sun, H. Lin, H. Dong, and S. Zhang, “Convolutional neural networks for expert recommendation in community question answering”, Science China Information Sciences, vol. 60, no. 11, pp. 102-110, 2017.
  • Cifariello, P. Ferragina, and M. Ponza, “Wiser: A semantic approach for expert finding in academia based on entity linking”, Information Systems, vol. 82, pp.1-16, 2019.
  • Amato, G. Cozzolino, and G. Sperlì, “A hypergraph data model for expert-finding in multimedia social networks”, Information, vol. 10, no. 6, p.183, 2019.
  • Zhao, J. Cheng, N. Chen, F. Xiong, and P. Cheng, “A Novel Expert Finding System for Community Question Answering”, Complexity, 2020.
  • Yang, and S. Manandhar, “Tag-based expert recommendation in community question answering”, in EEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014), IEEE, 2014, pp. 960-963.
  • Zhao, L. Zhang, X. He, W. Ng, “Expert finding for question answering via graph regularized matrix completio”, IEEE Transactions on Knowledge and Data Engineering, vol. 27, no. 4, pp. 993-1004, 2014.
  • Yuan, Y. Zhang, J. Tang, W. Hall, and J. B. Cabotà, “Expert finding in community question answering: a review”, Artificial Intelligence Review, vol. 53, no. 2, pp.843-874, 2020.
  • Miri, and H. Beigy, “Expert Finding in Community Question Answering”, 6th Iran Web conf, 2020.
  • Z. Liu, and J. Jansen, “Predicting potential responders in social Q&A based on non-QA features”, CHI'14 Extended Abstracts on Human Factors in Computing Systems, 2014, pp. 2131-2136.
  • van Dijk, M. Tsagkias, and M. de Rijke, “Early detection of topical expertise in community”, in the 38th international ACM SIGIR conference on research and development in information retrieval, 2015, pp. 995-998.
  • Wang, D. M. German, T. H. Chen, Y. Tian, and A. E. Hassan, “Is reputation on Stack Overflow always a good indicator for users' expertise? No!”, n 2021 IEEE International Conference on Software Maintenance and Evolution (ICSME), IEEE, 2021, pp. 614-618. IEEE
  • S. Faisal, A. Daud, A. U. Akram, and R. A. Abbasi, N. R. Aljohani, and I. Mehmood, “Expert ranking techniques for online rated forums”, Computers in Human Behavior, vol. 100, p. 168-176, 2019.
  • Lock, and P. Redmond, “Embedded experts in online collaborative learning: A case study”, The Internet and Higher Education, vol. 48, p. 100773, 2021.
  • K. Roy, J. P. Singh, and A. Nag, “Finding Active Expert Users for Question Routing in Community Question Answering Sites”, Machine Learning and Data Mining in Pattern Recognition, Springer, 2018, 440-451.
  • Movshovitz-Attias, Y. Movshovitz-Attias, P. Steenkiste, and C. Faloutsos, “Analysis of the reputation system and user contributions on a question answering website: Stackoverflow”, in 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013, IEEE, 2013, 886-893.
  • L. Lin, Y. L. Chen, and H. Y. Kao, “Question difficulty evaluation by knowledge gap analysis in question answer communities”, in IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014), IEEE, 2014, pp. 336-339.
  • Liu, H. Shen, and L. Yu, “Question quality analysis and prediction in community question answering services with coupled mutual reinforcement”, IEEE Transactions on Services Computing,, vol. 10, no. 2, pp. 286-301, 2015.
  • Thiagarajan, G. Manjunath, and M. Stumptner, “Finding experts by semantic matching of user profiles”, Doctoral dissertation, CEUR-WS, 2008.
  • Shen, W. Shen, and X. Fan, “Recommending experts in Q&A communities by weighted HITS algorithm”, International Forum on Information Technology and Applications, vol. 2, pp. 151-154, 2009.
  • Riahi, Z. Zolaktaf, M. Shafiei, and E. Milios, “Finding expert users in community question answering”, in the 21st International Conference on World Wide Web, 2012, pp. 791-798.
  •  
  •  Hamed Salimian is a PhD student in computer engineering at Sharif University of Technology. He has received his M.Sc and B.Sc degree in computer engineering as well from Sharif and Kharazmi university. His area of interests include machine learning, data mining, financial markets analysis and software engineering.
  •  MohammadAmin Fazli received his BSc in hardware engineering and MSc and PhD in software engineering from Sharif University of Technology, in 2009, 2011 and 2015 respectively. He is currently a faculty member at Sharif University of Technology and R&D head at Sharif’s Intelligent Information Solutions Center. His research interests include Game Theory, Combinatorial Optimization, Computational Business and Economics, Graphs and Combinatorics, Complex networks and Dynamical Systems.
  •  Jafar Habibi, Associate Professor at Computer Engineering Department of Sharif University of Technology, has received his PhD degree in computer science from Manchester University in 1998. His area of interests include: Software Engineering, Software Architecture and Evolution, Simulation and Performance Evaluation, Social and Complex Networks, Information Systems and Enterprise Architecture.
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •