Expert advice problem with noisy low rank loss

Yaxiong Liu, Xuanke Jiang, Kohei Hatano, Eiji Takimoto

Research output: Contribution to journalConference articlepeer-review

Abstract

We consider the expert advice problem with a low rank but noisy loss sequence, where a loss vector lt ∈ [−1, 1]N in each round t is of the form lt = Uvt + ϵt for some fixed but unknown N × d matrix U called the kernel, some d-dimensional seed vector vt ∈ Rd, and some additional noisy term ϵt ∈ RN whose norm is bounded by ϵ. This is a generalization of the works of Hazan et al. and Barman et al., where the former only treats noiseless loss and the latter assumes that the kernel is known in advance. In this paper, we propose an algorithm, where we re-construct the kernel under the assumptions, that the low rank loss is noised and there is no prior information about kernel. In this algorithm, we approximate the kernel by choosing a set of loss vectors with a high degree of independence from each other, and we give a regret bound of O(d√T + d4/3(Nϵ)1/3 √T). Moreover, even if in experiment, the proposed algorithm performs better than Hazan's algorithm and Hedge algorithm.

Original languageEnglish
Pages (from-to)1097-1112
Number of pages16
JournalProceedings of Machine Learning Research
Volume157
Publication statusPublished - 2021
Event13th Asian Conference on Machine Learning, ACML 2021 - Virtual, Online
Duration: Nov 17 2021Nov 19 2021

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering
  • Statistics and Probability

Fingerprint

Dive into the research topics of 'Expert advice problem with noisy low rank loss'. Together they form a unique fingerprint.

Cite this