Fresh status updates are vital to the efficient operation of network monitoring and real-time control applications. In this paper, we consider a mobile edge computing(MEC)-assisted status update system, where smart de...Fresh status updates are vital to the efficient operation of network monitoring and real-time control applications. In this paper, we consider a mobile edge computing(MEC)-assisted status update system, where smart devices extract valuable status updates from sensed data to achieve timely awareness of the surroundings by exploiting computational resources at the device and edge server. To quantify the freshness of status updates obtained by executing computation tasks, we employ the concept of age of information(Ao I) to characterize the timeliness of status updates. To cope with the limited energy at devices, we investigate a joint task generation and computation offloading scheme under a given energy budget for minimizing the age of obtained status updates. The age minimization problem is modeled as a constrained Markov decision process(CMDP). To obtain the optimal policy, we derive the structural properties of the optimal deterministic policy and propose a lightweight structure-based status update algorithm in the case of known channel statistics. Moreover, we consider a more realistic scenario without prior knowledge of channel statistics, and propose a Q-learning-based status update algorithm to make online decisions. Simulation results show that the performance of our proposed algorithms is competitive when compared with existing schemes.展开更多
基金supported in part by National Science Foundation for Young Scientists of China Project No.042700349Beijing Natural Science Foundation under Grant 19L2033Key Area R&D Program of Guangdong Province with grant No.2018B030338001。
文摘Fresh status updates are vital to the efficient operation of network monitoring and real-time control applications. In this paper, we consider a mobile edge computing(MEC)-assisted status update system, where smart devices extract valuable status updates from sensed data to achieve timely awareness of the surroundings by exploiting computational resources at the device and edge server. To quantify the freshness of status updates obtained by executing computation tasks, we employ the concept of age of information(Ao I) to characterize the timeliness of status updates. To cope with the limited energy at devices, we investigate a joint task generation and computation offloading scheme under a given energy budget for minimizing the age of obtained status updates. The age minimization problem is modeled as a constrained Markov decision process(CMDP). To obtain the optimal policy, we derive the structural properties of the optimal deterministic policy and propose a lightweight structure-based status update algorithm in the case of known channel statistics. Moreover, we consider a more realistic scenario without prior knowledge of channel statistics, and propose a Q-learning-based status update algorithm to make online decisions. Simulation results show that the performance of our proposed algorithms is competitive when compared with existing schemes.
