TY - JOUR
T1 - ProficiencyRank
T2 - Automatically ranking expertise in online collaborative social networks
AU - Jimenez, Sergio
AU - Silva, Fabio N.
AU - Dueñas, George
AU - Gelbukh, Alexander
N1 - Publisher Copyright:
© 2021
PY - 2022/4
Y1 - 2022/4
N2 - Users of online collaborative social networks (e.g., StackExchange, Yahoo! Answers, and Yask, among others) are distributed across a continuous range of expertise, ranging from beginners to experts. However, only a minority of users contribute to their communities by posting questions and answers, while the majority (lurkers) only contribute by voting up or down on others’ posts. Since current methods for ranking expertise are based mainly on user submitted posts, their results are limited to that minority. We introduce ProficiencyRank, a wrapping method on top of PageRank that leverages voting information to determine user expertise for both contributors and lurkers. We validated our method to measure the proficiency of English Language Learners in the Yask social network. The new data set is naturally annotated with self-assessments of proficiency given by the users themselves, providing ground truth for all users. Experimental validation showed that ProficiencyRank produces a meaningful ranking of users that overcame various baselines based on intrinsic and extrinsic information. We conclude that this technology can benefit these communities by expanding the coverage of user expertise/reputation measurement and providing a re-ranking method for the expert finding task.
AB - Users of online collaborative social networks (e.g., StackExchange, Yahoo! Answers, and Yask, among others) are distributed across a continuous range of expertise, ranging from beginners to experts. However, only a minority of users contribute to their communities by posting questions and answers, while the majority (lurkers) only contribute by voting up or down on others’ posts. Since current methods for ranking expertise are based mainly on user submitted posts, their results are limited to that minority. We introduce ProficiencyRank, a wrapping method on top of PageRank that leverages voting information to determine user expertise for both contributors and lurkers. We validated our method to measure the proficiency of English Language Learners in the Yask social network. The new data set is naturally annotated with self-assessments of proficiency given by the users themselves, providing ground truth for all users. Experimental validation showed that ProficiencyRank produces a meaningful ranking of users that overcame various baselines based on intrinsic and extrinsic information. We conclude that this technology can benefit these communities by expanding the coverage of user expertise/reputation measurement and providing a re-ranking method for the expert finding task.
KW - Expert finding
KW - Expert ranking
KW - Language proficiency
KW - Online collaborative social networks
KW - PageRank
UR - http://www.scopus.com/inward/record.url?scp=85121966074&partnerID=8YFLogxK
U2 - 10.1016/j.ins.2021.11.067
DO - 10.1016/j.ins.2021.11.067
M3 - Artículo
AN - SCOPUS:85121966074
SN - 0020-0255
VL - 588
SP - 231
EP - 247
JO - Information Sciences
JF - Information Sciences
ER -