Reinforcement Learning Framework for Robust Navigation in GNSS Receivers
Contreras DF, Cortes I, Kontes G, Feigl T, Mutschler C, Ruegamer A (2024)
Publication Language: English
Publication Type: Conference contribution, Original article
Publication year: 2024
Pages Range: 2392-2408
Conference Proceedings Title: Proceedings of the 37th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2024)
Event location: Baltimore, Maryland
DOI: 10.33012/2024.19853
Abstract
Robust synchronization of the code phase, carrier Doppler, and carrier phase is essential in global navigation satellite system (GNSS) receivers to achieve continuous and reliable position, velocity, and time (PVT) solutions. Traditional fixed-configuration tracking loops are sub-optimal for time-varying scenarios. Recent research introduced the loop-bandwidth control algorithm (LBCA), an adaptive technique that updates the loop bandwidth based on the weighted difference between the mean and standard deviation of the discriminator’s output. Extensive testing has confirmed the LBCA’s superior performance compared to state-of-the-art adaptive tracking techniques while maintaining low complexity. However, the primary limitation lies in the need for precise tuning of features and weighting functions, which are traditionally hand-crafted and may neglect other effects such as transient dynamics or Allan variance from the oscillator. This paper presents the reinforcement learning bandwidth adaptive control (RLBAC), a reinforcement learning (RL) framework to optimize the adaptive control algorithm by searching for optimal weighting functions based on selected features. The environment in this framework represents the tracking channels of a GNSS receiver, while the agent includes the LBCA. The REINFORCE algorithm, a policy search/gradient algorithm, is included to optimize the policy function parameters (i.e., the weights of the LBCA). Two setups were implemented: first, an RL framework in Python to train the LBCA using synthetic signals; second, evaluation within the GOOSE©platform, a GNSS receiver with an open software interface. Results demonstrate that the LBCA can be the policy function of a reinforcement learning framework and that it is trainable, allowing for the search of optimal weighting functions. This proof-of-concept highlights the potential for RL frameworks to enhance adaptive control in GNSS tracking.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Contreras, D.F., Cortes, I., Kontes, G., Feigl, T., Mutschler, C., & Ruegamer, A. (2024). Reinforcement Learning Framework for Robust Navigation in GNSS Receivers. In Proceedings of the 37th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2024) (pp. 2392-2408). Baltimore, Maryland.
MLA:
Contreras, David Franco, et al. "Reinforcement Learning Framework for Robust Navigation in GNSS Receivers." Proceedings of the International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2024), Baltimore, Maryland 2024. 2392-2408.
BibTeX: Download