2015 VEWSAWikipediaVandalEarlyWarnin

(Kumar et al., 2015) ⇒ Srijan Kumar, Francesca Spezzano, and V.S. Subrahmanian. (2015). “VEWS: A Wikipedia Vandal Early Warning System.” In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2015). ISBN:978-1-4503-3664-2 doi:10.1145/2783258.2783367

Subject Headings:

Notes

Cited By

Quotes

Author Keywords

Behavior modeling; data mining; early detection; vandal detection; wikipedia

Abstract

We study the problem of detecting vandals on Wikipedia before any human or known vandalism detection system reports flagging potential vandals so that such users can be presented early to Wikipedia administrators. We leverage multiple classical ML approaches, but develop 3 novel sets of features. Our Wikipedia Vandal Behavior (WVB) approach uses a novel set of user editing patterns as features to classify some users as vandals. Our Wikipedia Transition Probability Matrix (WTPM) approach uses a set of features derived from a transition probability matrix and then reduces it via a neural net auto-encoder to classify some users as vandals. The VEWS approach merges the previous two approaches. Without using any information (e.g. reverts) provided by other users, these algorithms each have over 85% classification accuracy. Moreover, when temporal recency is considered, accuracy goes to almost 90%. We carry out detailed experiments on a new data set we have created consisting of about 33K Wikipedia users (including both a black list and a white list of editors) and containing 770K edits. We describe specific behaviors that distinguish between vandals and non-vandals. We show that VEWS beats ClueBot NG and STiki, the best known algorithms today for vandalism detection. Moreover, VEWS detects far more vandals than ClueBot NG and on average, detects them 2.39 edits before ClueBot NG when both detect the vandal. However, we show that the combination of VEWS and ClueBot NG can give a fully automated vandal early warning system with even higher accuracy.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2015 VEWSAWikipediaVandalEarlyWarnin	V.S. Subrahmanian Srijan Kumar Francesca Spezzano			VEWS: A Wikipedia Vandal Early Warning System				10.1145/2783258.2783367		2015