Reinforcement learning-based adaptive beam alignment in a photodiode-integrated array antenna module.

We successfully demonstrated an intelligent adaptive beam alignment scheme using a reinforcement learning (RL) algorithm integrated with an 8 × 8 photonic array antenna operating in the 40 GHz millimeter wave (MMW) band. In our proposed scheme, the three key elements of RL: state, action, and reward, are represented as the phase values in the photonic array antenna, phase changes with specified steps, and an obtained error vector magnitude (EVM) value, respectively. Furthermore, thanks to the Q-table, the RL agent can effectively choose the most suitable action based on its prior experiences.