Safe Reinforcement Learning via a Model-Free Safety Certifier.

This article presents a data-driven safe reinforcement learning (RL) algorithm for discrete-time nonlinear systems. A data-driven safety certifier is designed to intervene with the actions of the RL agent to ensure both safety and stability of its actions. This is in sharp contrast to existing model-based safety certifiers that can result in convergence to an undesired equilibrium point or conservative interventions that jeopardize the performance of the RL agent.

Soft-tissue modeling and image-guided control of steerable needles.

In this paper, we exploit a fuzzy controller on a flexible bevel-tip needle to manipulate the needle's base in order to steer its tip in a preset obstacle-free and target-tracking path. Although the needle tends to follow a curvature path, spinning the needle with an extremely high rotational velocity makes it symmetric with respect to the tissue to follow a straight path. The fuzzy controller determines an appropriate spinning to generate the planned trajectory and, the closed-loop system tries to match the needle body with that trajectory.

Hierarchical optimal control of large-scale nonlinear chemical processes.

In this paper, a new approach is presented for optimal control of large-scale chemical processes. In this approach, the chemical process is decomposed into smaller sub-systems at the first level, and a coordinator at the second level, for which a two-level hierarchical control strategy is designed. For this purpose, each sub-system in the first level can be solved separately, by using any conventional optimization algorithm.