Integrated with low-power micro-controllers and sensors, RFID-based wireless rechargeable sensor node is a very promising platform for applications such as inventory management, supply chain monitoring etc. Among other major research challenges, one of the most essential problems in such wireless rechargeable sensor networks is how to minimize the communication delay among RFID readers and RFID-based rechargeable nodes. While the existing works have mostly focused on the collision avoidance among RFID-based nodes, in this work we study an orthogonal approach which focuses on how to optimally plan the movement of the reader so as to minimize the communication delay in the network. To solve this problem, we introduce both an optimal solution for the linear reader movement pattern and an approximation solution for the generic two-dimensional reader move pattern with a provable approximation ratio. In addition, we also provide a solution for guaranteeing the quality of communication while minimizing the communication delay. We verify our observations through testbed experiments and extensively evaluate our design by both emulations and large-scale simulations. The results show our design can effectively reduce communication delay in wireless rechargeable sensor networks when compared with baseline solutions.