Temporal Difference Learning Waveform Selection

Abstract

How to optimally decide or select the radar waveform for next transmission based on the observation of past radar returns is one of the important problems in cognitive radar. In this paper, stochastic dynamic programming model is proposed. Then temporal difference learning method is used to realize the adaptivity of waveform selection. The simulation results show that the uncertainty of state estimation using temporal difference learning is less than that using fixed waveform. Temporal difference learning method approaches the optimal waveform selection scheme but has lower computational cost. Finally, the whole paper is summarized.