- Computers and Informatics
- Cilt: 3 Sayı: 2
- State space scalability to enable smart ships with statistical physics and multi-agent-based reinfor...
State space scalability to enable smart ships with statistical physics and multi-agent-based reinforcement learning
Authors : Alexander Manohar, David Singer
Pages : 67-80
View : 28 | Download : 61
Publication Date : 2023-12-01
Article Type : Research
Abstract :The global marine industry is transitioning to smart ships where navigation, maintenance, and operations are done autonomously. Integrating autonomy into already complex ships presents many challenges, including identifying faults and taking corrective actions. These actions are key components in a Self-Adaptive Health Monitoring (SAHM) system which aims to maintain ship operations. The challenge lies in the failure state space’s extraordinary size which current methods aren’t capable of dealing with. Diagnosis has been achieved for smaller scale systems such as NASA deep space probes, but the complexity of a probe is equivalent to a ship’s single small sub-system. The authors combine recent advancements in statistical physics and multi-agent-based reinforcement learning to address the scale issue and enable crewless vessels. Statistical physics works to extract information about objects through tensor networks, combining physical and logical representations of objects. By combining a sequence of contractions, an ensemble of data about the physical system can be constructed quickly. To demonstrate the proposed method, the algorithm is applied to a modified version of the N-Queens problem which contains operational decision making, geometrical constraints, and a scalable problem. The authors then apply an already proven method to the modified version of the N-Queens problem and compare the results. The tensor network enables agents to handle state space explosion by decoupling the system’s complexity from decision making.Keywords : Diagnosis, Fault detection, Self-adaptive health monitoring, Tensor networks