2024 |
Soojeong Hyeon / Iman Shames / Hyungbo Shim Multi-agent Target Position Estimation Using Bearing-only Measurments via Spatial Excitation Proceedings Article In: 2024 American Control Conference, pp. 548-553, IEEE, 2024, ISBN: 979-8-3503-8265-5. Abstract | Links | BibTeX | Tags: Multi-agent system, Networked control system @inproceedings{nokey, This paper solves the problem of estimating a single target position by a group of agents in two-dimensional space. Each agent is assumed to know its own position and to measure only the bearing to the target. We develop a distributed estimation scheme that processes individual bearing measurements by utilizing continuous-time dynamics with communication among the agents. Under the assumption of connectivity on the communication graph, it is shown that, even if each bearing measurement does not satisfy the persistency of excitation condition, each agent is able to estimate the target position provided that the agents are properly positioned. We examine this condition in terms of spatial excitation and its relationship with geometric configuration of the agents. Additionally, we analyze the convergence rate of the estimation error. Simulation results are provided to illustrate the performance of the proposed estimator. |
Deuksun Hong / Hyungbo Shim A Reinforcement Learning Approach for Safe Control Using Multi-Agent Q-Learning Proceedings Article In: 2024 14th Asian Control Conference, 2024. Abstract | BibTeX | Tags: Consensus, Multi-agent system, Reinforcement learning @inproceedings{nokey, Reinforcement learning techniques typically optimize a controller only for the trained environment. This characteristic leads to trouble when applying the learned models to other settings, particularly in real control scenarios where control needs to be performed under different conditions than those during the learning phase due to modeling errors or aging. This paper introduces a multi-agent version of Q-learning known as QD-learning. We also present how this algorithm operates when applied to the various environment settings, and experimentally demonstrate its effectiveness for designing a safe controller. |
2022 |
Jiyeon Nam / Jinwook Heo / Jeongwoo Kim / Hyungbo Shim / Jae Sung Bang / Jinsung Kim Initialization-free Algorithm for Discrete-time Dynamic Average Consensus and Its Application to Distributed Optimization Proceedings Article In: Proc. of 22th International Conference on Control, Automation and Systems (ICCAS), pp. 424-429, IEEE, Busan, Korea, 2022, ISBN: 978-89-93215-24-3. Abstract | Links | BibTeX | Tags: Dynamic average consensus, Initialization-free, Multi-agent system @inproceedings{nokey, In this paper, we address the problem of dynamic average consensus in a discrete-time setting. The objective of dynamic average consensus problem is for each state of agent to track the average of reference input signals of each agent in a distributed manner. Without initialization process, the proposed algorithm renders the state of each agent converge practically to the average of time-varying reference signals with any given bound. It is a simple time-domain algorithm based on two-time scale. Finally, by applying our algorithm to an distributed optimization problem, we provide two simulation results that converge correctly when the initial conditions are perturbed and that converge within certain amount of small error when numerical errors are injected every time step. |
2021 |
Jeong Mo Seong / Jeong Woo Kim / Seungjoon Lee / Hyungbo Shim Distributed Dynamic Quantile Solver With Plug-and-Play Operation Journal Article In: IEEE Access, vol. 9, pp. 165517-165525, 2021, ISSN: 2169-3536. Abstract | Links | BibTeX | Tags: Blended Dynamics Approach, Distributed algorithm, Multi-agent system @article{nokey, In this paper, we propose a continuous-time distributed algorithm for the dynamic quantile problem. The problem is to find the quantile of time-varying signals in a network of agents, each of which having the signal of its own. For example, this problem includes finding the median, maximum, or the second largest value of the signals. The proposed algorithm guarantees convergence from arbitrary initial conditions and does not use the decaying gains. Hence our algorithm is suitable for plug-and-play operation, where agents may freely join or leave the network during the operation. An application to a simplified electricity market problem is presented to show the effectiveness of the design. |
Jin Gyu Lee / Hyungbo Shim Design of Heterogeneous Multi-agent System for Distributed Computation Book Chapter In: Zhong-Ping Jiang; Christophe Prieur; Alessandro Astolfi (Ed.): Trends in Nonlinear and Adaptive Control, vol. 489, Chapter 4, pp. 83-108, Springer, Cham, Switzerland, 1, 2021, ISBN: 978-3-030-74627-8. Abstract | Links | BibTeX | Tags: Distributed algorithm, Heterogeneous multi-agents, Multi-agent system @inbook{LeeShim20c, A group behavior of a heterogeneous multi-agent system is studied which obeys an “average of individual vector fields” under strong couplings among the agents. Under stability of the averaged dynamics (not asking stability of individual agents), the behavior of heterogeneous multi-agent system can be estimated by the solution to the averaged dynamics. A following idea is to “design” individual agent’s dynamics such that the averaged dynamics performs the desired task. A few applications are discussed including estimation of the number of agents in a network, distributed least-squares or median solver, distributed optimization, distributed state estimation, and robust synchronization of coupled oscillators. Since stability of the averaged dynamics makes the initial conditions forgotten as time goes on, these algorithms are initialization-free and suitable for plug-and-play operation. At last, nonlinear couplings are also considered, which potentially asserts that enforced synchronization gives rise to an emergent behavior of a heterogeneous multi-agent system. |
2017 |
Hyeonjun Yun / Seungjoon Lee / Hyungbo Shim Consensus-based Distributed Coordination for Optimal Energy Generation of Hierarchical Systems Proceedings Article In: Proc. of 56th Annual Conference of the Society of Instrument and Control Engineers (SICE), pp. 871-876, Kanazawa, Japan, 2017. Abstract | Links | BibTeX | Tags: Distributed optimization, Multi-agent system, Power grids, Synchronization @inproceedings{YunLeeShim17, This paper considers the optimal energy generation problem for hierarchical system, which consists of multi-cluster power system. In particular, consensus-based distributed hierarchical coordination algorithm is proposed to meet the power generation/demand balance. By using Lagrangian-based approach, we show that the optimization problem for the hierarchical system can be separated into each layer's consensus problem with communication between each layer's leader agent. The convergence is proved in the sense of global practical stability by the singular perturbation theory. Simulation result shows that the solution obtained by the proposed algorithm converges to the optimal solution. |
2016 |
Jaeyong Kim / Jongwook Yang / Hyungbo Shim / Jung-Su Kim / Jin Heon Seo Robustness of Synchronization of Heterogeneous Agents by Strong Coupling and a Large Number of Agents Journal Article In: IEEE Transactions on Automatic Control, vol. 61, no. 10, pp. 3096-3102, 2016. Abstract | Links | BibTeX | Tags: Blended dynamics, Heterogeneity, Multi-agent system, Synchronization @article{KimYangShimKimSeo16, This technical note studies robustness of synchronization against heterogeneity of multi-agent systems. Here, heterogeneity also includes uncertainties and external disturbances in each agent. In order to effectively deal with the heterogeneous agents, we introduce the concept of the averaged dynamics which is the average of all agents’ dynamics, and then claim that two sources enhance the robustness of synchronized behavior against heterogeneity of agents’ dynamics. First, in spite of the heterogeneity of agents’ dynamics, we show that strong coupling among agents makes the trajectories of all agents arbitrarily close to the averaged dynamics. Second, in the averaged dynamics, the effect of variations in each agent gets smaller as the number of agents increases. Simulation results confirm the claim that a large number of agents with strong couplings have robust synchronization. |
Hongkeun Kim / Seongjun Kim / Juhoon Back / Hyungbo Shim / Jin Heon Seo Design of Stable Parallel Feedforward Compensator and its Application to Synchronization Problem Journal Article In: Automatica, vol. 64, pp. 208-216, 2016. Abstract | Links | BibTeX | Tags: Multi-agent system, Non-minimum phase, Parallel feedforward compensator, Synchronization @article{KimKimBackShimSeo16, This paper addresses the design problem of a stable parallel feedforward compensator V for a given SISO LTI plant P (possibly being of non-minimum phase and/or having relative degree greater than one). The objective of the problem is that their parallel interconnection P+V becomes minimum phase having relative degree one. Based on the classical results of simultaneous stabilization, a necessary and sufficient condition for solving the problem is presented as well as a design procedure for constructing such a compensator. The proposed feedforward compensator allows the control system to have the three useful features: (1) the ability that assigns the zeros of P+V to a region of complex numbers having arbitrary negative real parts, (2) infinite gain margin property of P+V controlled by a static output feedback, and (3) block diagonal structure of P+V. These features are extensively exploited in the synchronization problem of multi-agent systems to achieve arbitrary fast convergence rate and to have the synchronized trajectory independent of the initial conditions and parameters of the involved dynamic controllers. |
2015 |
Jaeyong Kim / Hyungbo Shim Robust Synchronization for High-Order Heterogeneous Multi-Agent Systems Proceedings Article In: Proc. of SWARM 2015: The First International Symposium on Swarm Behavior and Bio-Inspired Robotics, pp. 293-294, Kyoto, Japan, 2015. Abstract | BibTeX | Tags: Blended dynamics, Multi-agent system, Synchronization @inproceedings{KimShim15b, This paper studies robustness of synchronization for high-order heterogeneous multi-agent systems. Using the concept of the averaged dynamics, it is claimed that two sources enhance the robustness of synchronized behavior against heterogeneity of agents’ dynamics. First, strongly coupled network makes each behavior of heterogeneous agent close to that of the averaged dynamics. Second, we observe that the averaged dynamics becomes more robust against individual variation as the number of agents increases. Simulation result confirms our claim that a large number of agents with strong coupling have robust synchronization. |
2013 |
Jaeyong Kim / Jongwook Yang / Hyungbo Shim / Jung-Su Kim Robustness of Synchronization in Heterogeneous Multi-Agent Systems Proceedings Article In: Proc. of 2013 European Control Conference (ECC), pp. 3821-3826, IEEE, Zurich, Switzerland, 2013. Abstract | Links | BibTeX | Tags: Multi-agent system @inproceedings{KimYangShimKim13, This paper studies robustness of synchronization in heterogeneous multi-agent systems, which is gained by interactions with other agents through the network. In order to effectively deal with the heterogeneous cases, we introduce the concept of the averaged dynamics which is the average of all agents' dynamics, and then claim that two sources enhance the robustness of the group behavior against differences among agents. First, we show that strong coupling among heterogeneous agents makes the trajectories of all agents remain in an arbitrarily small neighborhood of the trajectory of the averaged dynamics. Second, we observe that the amount of individual variation of each agent, that contributes to the averaged dynamics, gets smaller as the number of agents increases, and thus, the averaged dynamics becomes more robust to the differences among agents. Simulation results confirm our claim that a large number of agents with strong couplings have robust synchronization. |
List of English Publication
2024 |
Multi-agent Target Position Estimation Using Bearing-only Measurments via Spatial Excitation Proceedings Article In: 2024 American Control Conference, pp. 548-553, IEEE, 2024, ISBN: 979-8-3503-8265-5. |
A Reinforcement Learning Approach for Safe Control Using Multi-Agent Q-Learning Proceedings Article In: 2024 14th Asian Control Conference, 2024. |
2022 |
Initialization-free Algorithm for Discrete-time Dynamic Average Consensus and Its Application to Distributed Optimization Proceedings Article In: Proc. of 22th International Conference on Control, Automation and Systems (ICCAS), pp. 424-429, IEEE, Busan, Korea, 2022, ISBN: 978-89-93215-24-3. |
2021 |
Distributed Dynamic Quantile Solver With Plug-and-Play Operation Journal Article In: IEEE Access, vol. 9, pp. 165517-165525, 2021, ISSN: 2169-3536. |
Design of Heterogeneous Multi-agent System for Distributed Computation Book Chapter In: Zhong-Ping Jiang; Christophe Prieur; Alessandro Astolfi (Ed.): Trends in Nonlinear and Adaptive Control, vol. 489, Chapter 4, pp. 83-108, Springer, Cham, Switzerland, 1, 2021, ISBN: 978-3-030-74627-8. |
2017 |
Consensus-based Distributed Coordination for Optimal Energy Generation of Hierarchical Systems Proceedings Article In: Proc. of 56th Annual Conference of the Society of Instrument and Control Engineers (SICE), pp. 871-876, Kanazawa, Japan, 2017. |
2016 |
Robustness of Synchronization of Heterogeneous Agents by Strong Coupling and a Large Number of Agents Journal Article In: IEEE Transactions on Automatic Control, vol. 61, no. 10, pp. 3096-3102, 2016. |
Design of Stable Parallel Feedforward Compensator and its Application to Synchronization Problem Journal Article In: Automatica, vol. 64, pp. 208-216, 2016. |
2015 |
Robust Synchronization for High-Order Heterogeneous Multi-Agent Systems Proceedings Article In: Proc. of SWARM 2015: The First International Symposium on Swarm Behavior and Bio-Inspired Robotics, pp. 293-294, Kyoto, Japan, 2015. |
2013 |
Robustness of Synchronization in Heterogeneous Multi-Agent Systems Proceedings Article In: Proc. of 2013 European Control Conference (ECC), pp. 3821-3826, IEEE, Zurich, Switzerland, 2013. |