摘要：A long standing idea in online learning is Exponential Gradient (EG) update protocol. Its online weight updating rules is derived from incorporating components of the relative entropy distance and relevant entropy loss as the objective function. In this manuscript, we study the behaviors of the EG algorithm with relative entropy loss in the scene of conjugate of conjugate. More specifically, we propose that a principled solution to circumventing approximation step for the traditional EG algorithm can be found by conjugate of conjugate strategy. Moreover, an upper bound for the error loss is presented to demonstrate the effectiveness of our proposed update strategies. Meanwhile, we give three different protocols for the choice of the parameter and compare the results on noisy data. In addition, we validate the effectiveness of our devised exponential gradient update rules in the classification and regression scenarios on real-world data sets.
© 2020 IEEE.

卷、期、页：p3957-3963

发表日期：2020-08-01

收录情况：EI（工程索引）

发表期刊名称：Proceedings of the 32nd Chinese Control and Decision Conference, CCDC 2020

通讯作者：张思思

第一作者：左信,刘建伟

论文类型：会议论文

论文概要：张思思,左信,刘建伟，The Improvement of the Algorithm EG for the Relative Entropy Loss，Proceedings of the 32nd Chinese Control and Decision Conference, CCDC 2020，2020，p3957-3963

论文题目：The Improvement of the Algorithm EG for the Relative Entropy Loss