Abstract

We successfully demonstrated an intelligent adaptive beam alignment scheme using a reinforcement learning (RL) algorithm integrated with an 8 × 8 photonic array antenna operating in the 40 GHz millimeter wave (MMW) band. In our proposed scheme, the three key elements of RL: state, action, and reward, are represented as the phase values in the photonic array antenna, phase changes with specified steps, and an obtained error vector magnitude (EVM) value, respectively. Furthermore, thanks to the Q-table, the RL agent can effectively choose the most suitable action based on its prior experiences. As a result, the proposed scheme autonomously achieves the best EVM performance by determining the optimal phase. In this Letter, we verify the capability of the proposed scheme in single- and multiple-user scenarios and experimentally demonstrate the performance of beam alignment to the user’s location optimized by the RL algorithm. The achieved results always meet the signal quality requirement specified by the 3rd Generation Partnership Project (3GPP) criterion for 64-QAM orthogonal frequency division multiplexing (OFDM).

© 2024 Optica Publishing Group

Reinforcement learning for W-band radio-over-fiber system using a polarization modulator

Jyun-Wei Li, Run-Kai Shiu, Ming-Han Wen, Yibeltal Chanie Manie, Zhi-Qi Yang, and Peng-Chun Peng
Opt. Lett. 47(8) 2008-2011 (2022)

Proactive real-time interference avoidance in a 5G millimeter-wave over fiber mobile fronthaul using SARSA reinforcement learning

Qi Zhou, You-Wei Chen, Shuyi Shen, Yiming Kong, Mu Xu, Junwen Zhang, and Gee-Kung Chang
Opt. Lett. 44(17) 4347-4350 (2019)

Two-stage look-up-table-based 16QAM vector millimeter-wave signal generation and reception

Lun Zhao, Jing Wang, Yejun Liu, Junxian Wu, Song Song, Tingwei Wu, and Lei Guo
Opt. Lett. 49(4) 879-882 (2024)

Modulated-symbol domain matched filtering scheme for photonic-assisted integrated sensing and communication system based on a single OFDM waveform

Lede Yin and Jing He
Opt. Lett. 49(8) 2153-2156 (2024)

Dual vector millimeter-wave signal generation based on optical carrier suppression modulation and direct detection with one photodetector

Jiahao Bi, Tangyao Xie, Dong Guo, Xinying Li, Xiaolong Pan, Hengxin Yan, Jie Hou, Zhipei Li, Chenchen Wang, Qi Zhang, Ran Gao, Ze Dong, and Xiangjun Xin
Opt. Lett. 49(5) 1205-1208 (2024)