Adaptive lifelong learning
| dc.contributor.author | Parul | |
| dc.contributor.supervisor | Mehta, Nishant | |
| dc.date.accessioned | 2018-12-20T21:29:44Z | |
| dc.date.available | 2018-12-20T21:29:44Z | |
| dc.date.copyright | 2018 | en_US |
| dc.date.issued | 2018-12-20 | |
| dc.degree.department | Department of Computer Science | en_US |
| dc.degree.level | Master of Science M.Sc. | en_US |
| dc.description.abstract | Lifelong learning is an emerging field in machine learning that still requires a lot of research. In lifelong learning, the tasks are presented sequentially, the system learns knowledge at each task and the goal is to retain the learned knowledge and utilize it when learning a new task. Exponentially Weighted Aggregation for Lifelong Learning (EWA-LL) is a meta-algorithm used in lifelong learning setting. It transfers information from previous tasks to the next. A prior distribution is maintained on the set of representations, which is updated after the encounter of each new task using the exponentially weighted aggregation (EWA) procedure. This project tries to relax the problem and explores the case of an easy scenario where we have some more information about the data. It implements adaptive learning in lifelong learning setting. It utilizes the adaptive learning algorithm Follow The Leader with Dropout Perturbations (FTL-DP) used in Online Prediction with Expert Advice. FTL-DP sets the losses of the experts to 0 or 1 at each task based on the dropout probability before selecting the leader. This project transports FTL-DP to lifelong learning setting. The goal is to prove that adaptive algorithm in lifelong learning is a better approach than EWA-LL as it gives smaller regret for certain easy problems while still maintaining the regret bounds similar to EWA-LL for the harder problems. | en_US |
| dc.description.scholarlevel | Graduate | en_US |
| dc.identifier.uri | http://hdl.handle.net/1828/10446 | |
| dc.language.iso | en | en_US |
| dc.rights | Available to the World Wide Web | en_US |
| dc.subject | Lifelong learning | en_US |
| dc.subject | Machine Learning | en_US |
| dc.subject | Adaptive learning | en_US |
| dc.title | Adaptive lifelong learning | en_US |
| dc.type | Project | en_US |