2011 IntegratingLowRankandGroupSpars

• (Chen et al., 2011) ⇒ Jianhui Chen, Jiayu Zhou, and Jieping Ye. (2011). “Integrating Low-rank and Group-sparse Structures for Robust Multi-task Learning.” In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2011) Journal. ISBN:978-1-4503-0813-7 doi:10.1145/2020408.2020423

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222011%22+Integrating+Low-rank+and+Group-sparse+Structures+for+Robust+Multi-task+Learning
• http://dl.acm.org/citation.cfm?id=2020408.2020423&preflayout=flat#citedby

Quotes

Author Keywords

• Algorithms; data mining; group-sparsity; low-rank patterns; multi-task learning; robust

Abstract

Multi-task learning (MTL) aims at improving the generalization performance by utilizing the intrinsic relationships among multiple related tasks. A key assumption in most MTL algorithms is that all tasks are related, which, however, may not be the case in many real-world applications. In this paper, we propose a robust multi-task learning (RMTL) algorithm which learns multiple tasks simultaneously as well as identifies the irrelevant (outlier) tasks. Specifically, the proposed RMTL algorithm captures the task relationships using a low-rank structure, and simultaneously identifies the outlier tasks using a group-sparse structure. The proposed RMTL algorithm is formulated as a non-smooth convex (unconstrained) optimization problem. We propose to adopt the accelerated proximal method (APM) for solving such an optimization problem. The key component in APM is the computation of the proximal operator, which can be shown to admit an analytic solution. We also theoretically analyze the effectiveness of the RMTL algorithm. In particular, we derive a key property of the optimal solution to RMTL; moreover, based on this key property, we establish a theoretical bound for characterizing the learning performance of RMTL. Our experimental results on benchmark data sets demonstrate the effectiveness and efficiency of the proposed algorithm.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2011 IntegratingLowRankandGroupSpars	Jieping Ye Jianhui Chen Jiayu Zhou			Integrating Low-rank and Group-sparse Structures for Robust Multi-task Learning				10.1145/2020408.2020423		2011