• 首页
  • 期刊简介
  • 编委会
  • 投稿指南
  • 收录情况
  • 杂志订阅
  • 联系我们
引用本文:曹海涛,邱鹏鹏,蔡 霞.低地球轨道下基于TD3算法的通用轨道转移控制[J].软件工程,2024,27(9):6-9.【点击复制】
【打印本页】   【下载PDF全文】   【查看/发表评论】  【下载PDF阅读器】  
←前一篇|后一篇→ 过刊浏览
分享到: 微信 更多
低地球轨道下基于TD3算法的通用轨道转移控制
曹海涛, 邱鹏鹏, 蔡 霞
(浙江理工大学计算机科学与技术学院, 浙江 杭州 310018)
caohaitao97@163.com; qpp9616@163.com; cxdaisy@zstu.edu.cn
摘 要: 为应对低地球轨道下潜在的航天器脉冲式轨道转移任务挑战,提出一种用深度强化学习算法建立轨道转移通用控制模型的方法,以减少人工干预,解决反应不及时等问题。通过对轨道动力学的建模和对马尔可夫决策过程的设计,成功将TD3(Twin Delayed Deep Deterministic Policy Gradient)算法运用于轨道转移决策,实现高度自主的脉冲式点火控制器的设计。实验结果表明,使用TD3算法建立的脉冲式点火控制器,在不同的轨道转移任务下自主到达目标轨道的成功率可达96.1%,同时完成了轨道5个根数的收敛,证明TD3算法用于解决该问题的可行性与有效性。
关键词: 轨道转移;深度强化学习;TD3算法
中图分类号: TP183    文献标识码: A
General Orbit Transfer Control Based on TD3 Algorithm in Low Earth Orbit
CAO Haitao, QIU Pengpeng, CAI Xia
(School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China)
caohaitao97@163.com; qpp9616@163.com; cxdaisy@zstu.edu.cn
Abstract: To address potential impulsive orbit transfer tasks for spacecraft in low earth orbit, this paper proposes a method to establish a general control model for orbit transfer using deep reinforcement learning. This method aims to reduce human intervention and address issues related to delayed responses. By modeling orbital dynamics and designing a Markov decision process, the TD3 ( Twin Delayed Deep Deterministic Policy Gradient) algorithm is successfully applied to transfer decisions, achieving highly autonomous design of impulse ignition controllers. Experimental results demonstrate that the impulse ignition controller established with the TD3 algorithm can autonomously reach the target orbit in various orbit transfer tasks, with a success rate of up to 96. 1% , and the convergence of the five orbital parameters is achieved simultaneously, demonstrating the feasibility and effectiveness of the TD3 algorithm in addressing this problem.
Keywords: orbit transfer; deep reinforcement learning; TD3 algorithm


版权所有:软件工程杂志社
地址:辽宁省沈阳市浑南区新秀街2号 邮政编码:110179
电话:0411-84767887 传真:0411-84835089 Email:semagazine@neusoft.edu.cn
备案号:辽ICP备17007376号-1
技术支持:北京勤云科技发展有限公司

用微信扫一扫

用微信扫一扫