Abstract
We consider the expert advice problem with a low rank but noisy loss sequence, where a loss vector lt ∈ [−1, 1]N in each round t is of the form lt = Uvt + ϵt for some fixed but unknown N × d matrix U called the kernel, some d-dimensional seed vector vt ∈ Rd, and some additional noisy term ϵt ∈ RN whose norm is bounded by ϵ. This is a generalization of the works of Hazan et al. and Barman et al., where the former only treats noiseless loss and the latter assumes that the kernel is known in advance. In this paper, we propose an algorithm, where we re-construct the kernel under the assumptions, that the low rank loss is noised and there is no prior information about kernel. In this algorithm, we approximate the kernel by choosing a set of loss vectors with a high degree of independence from each other, and we give a regret bound of O(d√T + d4/3(Nϵ)1/3 √T). Moreover, even if in experiment, the proposed algorithm performs better than Hazan's algorithm and Hedge algorithm.
Original language | English |
---|---|
Pages (from-to) | 1097-1112 |
Number of pages | 16 |
Journal | Proceedings of Machine Learning Research |
Volume | 157 |
Publication status | Published - 2021 |
Event | 13th Asian Conference on Machine Learning, ACML 2021 - Virtual, Online Duration: Nov 17 2021 → Nov 19 2021 |
All Science Journal Classification (ASJC) codes
- Artificial Intelligence
- Software
- Control and Systems Engineering
- Statistics and Probability