Toward autonomous event-based sensorimotor control with supervised gait learning and obstacle avoidance for robot navigation.

Front Neurosci

Department of Electrical and Computer Engineering (ECE), Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, United States.

Published: February 2025

Miniature robots are useful during disaster response and accessing remote or unsafe areas. They need to navigate uneven terrains without supervision and under severe resource constraints such as limited compute, storage and power budget. Event-based sensorimotor control in edge robotics has potential to enable fully autonomous and adaptive robot navigation systems capable of responding to environmental fluctuations by learning new types of motion and real-time decision making to avoid obstacles. This work presents a novel bio-inspired framework with a hierarchical control system to address these limitations, utilizing a tunable multi-layer neural network with a hardware-friendly Central Pattern Generator (CPG) as the core coordinator to govern the precise timing of periodic motion. Autonomous operation is managed by a Dynamic State Machine (DSM) at the top of the hierarchy, providing the necessary adaptability to handle environmental challenges such as obstacles or uneven terrain. The multi-layer neural network uses a nonlinear neuron model which employs mixed feedback at multiple timescales to produce rhythmic patterns of bursting events to control the motors. A comprehensive study of the architecture's building blocks is presented along with a detailed analysis of network equations. Finally, we demonstrate the proposed framework on the Petoi robot, which can autonomously learn walk and crawl gaits using supervised Spike-Time Dependent Plasticity (STDP) learning algorithm, transition between the learned gaits stored as new states, through the DSM for real-time obstacle avoidance. Measured results of the system performance are summarized and compared with other works to highlight our unique contributions.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11893847PMC
http://dx.doi.org/10.3389/fnins.2025.1492436DOI Listing

Publication Analysis

Top Keywords

event-based sensorimotor
8
sensorimotor control
8
obstacle avoidance
8
robot navigation
8
multi-layer neural
8
neural network
8
autonomous event-based
4
control
4
control supervised
4
supervised gait
4

Similar Publications

Toward autonomous event-based sensorimotor control with supervised gait learning and obstacle avoidance for robot navigation.

Front Neurosci

February 2025

Department of Electrical and Computer Engineering (ECE), Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, United States.

Miniature robots are useful during disaster response and accessing remote or unsafe areas. They need to navigate uneven terrains without supervision and under severe resource constraints such as limited compute, storage and power budget. Event-based sensorimotor control in edge robotics has potential to enable fully autonomous and adaptive robot navigation systems capable of responding to environmental fluctuations by learning new types of motion and real-time decision making to avoid obstacles.

View Article and Find Full Text PDF

Researchers working with neural networks have historically focused on either non-spiking neurons tractable for running on computers or more biologically plausible spiking neurons typically requiring special hardware. However, in nature homogeneous networks of neurons do not exist. Instead, spiking and non-spiking neurons cooperate, each bringing a different set of advantages.

View Article and Find Full Text PDF

One of the questions yet to be fully understood is to what extent the properties of the sensory and the movement information interact to facilitate sensorimotor integration. In this study, we examined the relative contribution of the continuity compatibility between motor goals and their sensory outcomes in timing variability. The variability of inter-response intervals was measured in a synchronization-continuation paradigm.

View Article and Find Full Text PDF

Shifting computing architectures from von Neumann to event-based spiking neural networks (SNNs) uncovers new opportunities for low-power processing of sensory data in applications such as vision or sensorimotor control. Exploring roads toward cognitive SNNs requires the design of compact, low-power and versatile experimentation platforms with the key requirement of online learning in order to adapt and learn new features in uncontrolled environments. However, embedding online learning in SNNs is currently hindered by high incurred complexity and area overheads.

View Article and Find Full Text PDF

Steady-state evoked potentials distinguish brain mechanisms of self-paced versus synchronization finger tapping.

Hum Mov Sci

October 2018

Faculty of Psychology and Educational Sciences, Department of Psychology, University of Geneva, 40 Boulevard du Pont-d'Arve, CH-1211 Geneva, Switzerland; School of Health Sciences Geneva, HES-SO University of Applied Sciences and Arts Western Switzerland, 47 Avenue de Champel, CH-1206 Geneva, Switzerland.

Sensorimotor synchronization (SMS) requires aligning motor actions to external events and represents a core part of both musical and dance performances. In the current study, to isolate the brain mechanisms involved in synchronizing finger tapping with a musical beat, we compared SMS to pure self-paced finger tapping and listen-only conditions at different tempi. We analyzed EEG data using frequency domain steady-state evoked potentials (SSEPs) to identify sustained electrophysiological brain activity during repetitive tasks.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!