Relating Human Error-Based Learning to Modern Deep RL Algorithms.

In human error-based learning, the size and direction of a scalar error (i.e., the "directed error") are used to update future actions.

The future lies in a pair of tactile hands.

Advancing robot hand dexterity with optical tactile sensing raises questions about humanoid robotics.

A Lightweight and Affordable Wearable Haptic Controller for Robot-Assisted Microsurgery.

In robot-assisted microsurgery (RAMS), surgeons often face the challenge of operating with minimal feedback, particularly lacking in haptic feedback. However, most traditional desktop haptic devices have restricted operational areas and limited dexterity. This report describes a novel, lightweight, and low-budget wearable haptic controller for teleoperated microsurgical robotic systems.

Towards Living Machines: current and future trends of tactile sensing, grasping, and social robotics.

The development of future technologies can be highly influenced by our deeper understanding of the principles that underlie living organisms. The Living Machines conference aims at presenting (among others) the interdisciplinary work of behaving systems based on such principles. Celebrating the 10 years of the conference, we present the progress and future challenges of some of the key themes presented in the robotics workshop of the Living Machines conference.

Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network.

Dexterous manipulation in robotic hands relies on an accurate sense of artificial touch. Here we investigate neuromorphic tactile sensation with an event-based optical tactile sensor combined with spiking neural networks for edge orientation detection. The sensor incorporates an event-based vision system (mini-eDVS) into a low-form factor artificial fingertip (the NeuroTac).

Degenerate boundaries for multiple-alternative decisions.

Integration-to-threshold models of two-choice perceptual decision making have guided our understanding of human and animal behavior and neural processing. Although such models seem to extend naturally to multiple-choice decision making, consensus on a normative framework has yet to emerge, and hence the implications of threshold characteristics for multiple choices have only been partially explored. Here we consider sequential Bayesian inference and a conceptualisation of decision making as a particle diffusing in n-dimensions.

Artificial SA-I and RA-I afferents for tactile sensing of ridges and gratings.

For robot touch to reach the capabilities of human touch, artificial tactile sensors may require transduction principles like those of natural tactile afferents. Here we propose that a biomimetic tactile sensor (the TacTip) could provide suitable artificial analogues of the tactile skin dynamics, afferent responses and population encoding. Our three-dimensionally printed sensor skin is based on the physiology of the dermal-epidermal interface with an underlying mesh of biomimetic intermediate ridges and dermal papillae, comprising inner pins tipped with markers.

Artificial SA-I, RA-I and RA-II/vibrotactile afferents for tactile sensing of texture.

Robot touch can benefit from how humans perceive tactile textural information, from the stimulation mode to which tactile channels respond, then the tactile cues and encoding. Using a soft biomimetic tactile sensor (the TacTip) based on the physiology of the dermal-epidermal boundary, we construct two biomimetic tactile channels based on slowly adapting SA-I and rapidly adapting RA-I afferents, and introduce an additional sub-modality for vibrotactile information with an embedded microphone interpreted as an artificial RA-II channel. These artificial tactile channels are stimulated dynamically with a set of 13 artificial rigid textures comprising raised-bump patterns on a rotating drum that vary systematically in roughness.

Learning offline: memory replay in biological and artificial reinforcement learning.

Learning to act in an environment to maximise rewards is among the brain's key functions. This process has often been conceptualised within the framework of reinforcement learning, which has also gained prominence in machine learning and artificial intelligence (AI) as a way to optimise decision making. A common aspect of both biological and machine reinforcement learning is the reactivation of previously experienced episodes, referred to as replay.

Tactile Model O: Fabrication and Testing of a 3D-Printed, Three-Fingered Tactile Robot Hand.

Bringing tactile sensation to robotic hands will allow for more effective grasping, along with a wide range of benefits of human-like touch. Here, we present a three-dimensional-printed, three-fingered tactile robot hand comprising an OpenHand ModelO customized to house a TacTip soft biomimetic tactile sensor in the distal phalanx of each finger. We expect that combining the grasping capabilities of this underactuated hand with sophisticated tactile sensing will result in an effective platform for robot hand research-the Tactile Model O (T-MO).

The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies.

Tactile sensing is an essential component in human-robot interaction and object manipulation. Soft sensors allow for safe interaction and improved gripping performance. Here we present the TacTip family of sensors: a range of soft optical tactile sensors with various morphologies fabricated through dual-material 3D printing.

Biomimetic Active Touch with Fingertips and Whiskers.

This study provides a synthetic viewpoint that compares, contrasts, and draws commonalities for biomimetic perception over a range of tactile sensors and tactile stimuli. Biomimetic active perception is formulated from three principles: (i) evidence accumulation based on leading models of perceptual decision making; (ii) action selection with an evidence-based policy, here based on overt focal attention; and (iii) sensory encoding of evidence based on neural coding. Two experiments with each of three biomimetic tactile sensors are considered: the iCub (capacitive) fingertip, the TacTip (optical) tactile sensor, and BIOTACT whiskers.

Analysis of hand kinematics reveals inter-individual differences in intertemporal decision dynamics.

During intertemporal decisions, the preference for smaller, sooner reward over larger-delayed rewards (temporal discounting, TD) exhibits substantial inter-subject variability; however, it is currently unclear what are the mechanisms underlying this apparently idiosyncratic behavior. To answer this question, here we recorded and analyzed mouse movement kinematics during intertemporal choices in a large sample of participants (N = 86). Results revealed a specific pattern of decision dynamics associated with the selection of "immediate" versus "delayed" response alternatives, which well discriminated between a "discounter" versus a "farsighted" behavior-thus representing a reliable behavioral marker of TD preferences.

Probabilistic Decision Making with Spikes: From ISI Distributions to Behaviour via Information Gain.

Computational theories of decision making in the brain usually assume that sensory 'evidence' is accumulated supporting a number of hypotheses, and that the first accumulator to reach threshold triggers a decision in favour of its associated hypothesis. However, the evidence is often assumed to occur as a continuous process whose origins are somewhat abstract, with no direct link to the neural signals - action potentials or 'spikes' - that must ultimately form the substrate for decision making in the brain. Here we introduce a new variant of the well-known multi-hypothesis sequential probability ratio test (MSPRT) for decision making whose evidence observations consist of the basic unit of neural signalling - the inter-spike interval (ISI) - and which is based on a new form of the likelihood function.

Embodied choice: how action influences perceptual decision making.

Embodied Choice considers action performance as a proper part of the decision making process rather than merely as a means to report the decision. The central statement of embodied choice is the existence of bidirectional influences between action and decisions. This implies that for a decision expressed by an action, the action dynamics and its constraints (e.

The state of the art in biomimetics.

Biomimetics is a research field that is achieving particular prominence through an explosion of new discoveries in biology and engineering. The field concerns novel technologies developed through the transfer of function from biological systems. To analyze the impact of this field within engineering and related sciences, we compiled an extensive database of publications for study with network-based information analysis techniques.

The effect of whisker movement on radial distance estimation: a case study in comparative robotics.

Whisker movement has been shown to be under active control in certain specialist animals such as rats and mice. Though this whisker movement is well characterized, the role and effect of this movement on subsequent sensing is poorly understood. One method for investigating this phenomena is to generate artificial whisker deflections with robotic hardware under different movement conditions.

The basal ganglia optimize decision making over general perceptual hypotheses.

The basal ganglia are a subcortical group of interconnected nuclei involved in mediating action selection within cortex. A recent proposal is that this selection leads to optimal decision making over multiple alternatives because the basal ganglia anatomy maps onto a network implementation of an optimal statistical method for hypothesis testing, assuming that cortical activity encodes evidence for constrained gaussian-distributed alternatives. This letter demonstrates that this model of the basal ganglia extends naturally to encompass general Bayesian sequential analysis over arbitrary probability distributions, which raises the proposal to a practically realizable theory over generic perceptual hypotheses.

Optimal decision-making in mammals: insights from a robot study of rodent texture discrimination.

Texture perception is studied here in a physical model of the rat whisker system consisting of a robot equipped with a biomimetic vibrissal sensor. Investigations of whisker motion in rodents have led to several explanations for texture discrimination, such as resonance or stick-slips. Meanwhile, electrophysiological studies of decision-making in monkeys have suggested a neural mechanism of evidence accumulation to threshold for competing percepts, described by a probabilistic model of Bayesian sequential analysis.

A simple method for characterizing passive and active neuronal properties: application to striatal neurons.

The study of active and passive neuronal dynamics usually relies on a sophisticated array of electrophysiological, staining and pharmacological techniques. We describe here a simple complementary method that recovers many findings of these more complex methods but relies only on a basic patch-clamp recording approach. Somatic short and long current pulses were applied in vitro to striatal medium spiny (MS) and fast spiking (FS) neurons from juvenile rats.

Efficient fitting of conductance-based model neurons from somatic current clamp.

Estimating biologically realistic model neurons from electrophysiological data is a key issue in neuroscience that is central to understanding neuronal function and network behavior. However, directly fitting detailed Hodgkin-Huxley type model neurons to somatic membrane potential data is a notoriously difficult optimization problem that can require hours/days of supercomputing time. Here we extend an efficient technique that indirectly matches neuronal currents derived from somatic membrane potential data to two-compartment model neurons with passive dendrites.

Sensory prediction or motor control? Application of marr-albus type models of cerebellar function to classical conditioning.

Marr-Albus adaptive filter models of the cerebellum have been applied successfully to a range of sensory and motor control problems. Here we analyze their properties when applied to classical conditioning of the nictitating membrane response in rabbits. We consider a system-level model of eyeblink conditioning based on the anatomy of the eyeblink circuitry, comprising an adaptive filter model of the cerebellum, a comparator model of the inferior olive and a linear dynamic model of the nictitating membrane plant.

Nonlinear dynamic modeling of isometric force production in primate eye muscle.

Although the oculomotor plant is usually modeled as a linear system, recent studies of ocular motoneuron behavior have drawn attention to the presence of significant nonlinearities. One source of these is the development of muscle force in response to changes in motoneuron firing rate. Here, we attempt to simulate the production of isometric force by the primate lateral rectus muscle in response to electrical stimulation [A.