Please use this identifier to cite or link to this item:
http://hdl.handle.net/10609/149921
Title: | Quantum-Inspires Adaptive Learning Rate Optimization (QIALRO) |
Author: | Raigada-García, Ricard-Santiago |
Abstract: | The study proposes an optimization algorithm for machine learning, called Quantum-Inspired Adaptative Learning Rate Optimization (QIALRO), inspired by principles of quantum mechanics. Although the algorithm operates in the classical domain, its conception is based on the ability of quantum systems to simultaneously explore multiple potential states, a property that is sought to be emulated in the optimization of machine learning models. It has been implemented based on softmax regression, cross entropy loss, RMSProp optimizer for learning rate adaptation. The learning rate adjustment mechanism is inspired by the quantum search for optimal solutions by simultaneously exploring multiple possibilities. It adjusts the learning rate by increasing it when the current iteration of the model shows an improvement in loss, leading to an optimal solution space. The technique also permits a decrease in the rate by mimicking the reversion to previous states observed in quantum computing. |
Keywords: | Quantumlike learning Optimization Machine Learning Adaptive Learning Rate Softmax Regression Cross-Entropy Loss RMSProp Algorithm Convergence Classical Computing Multiclass Classification Models |
Document type: | info:eu-repo/semantics/workingPaper |
Issue Date: | 1-Mar-2024 |
Publication license: | http://creativecommons.org/licenses/by/3.0/es/ |
Appears in Collections: | Treballs finals de carrera, treballs de recerca, etc. |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Quantum-Inspired adaptative learning rate optimization QIALRO.pdf | The study of an optimization algorithm inspired by principles of quantum mechanics. | 660,73 kB | Adobe PDF | View/Open |
Share:
Items in repository are protected by copyright, with all rights reserved, unless otherwise indicated.