Learning agile soccer skills for a bipedal robot with deep reinforcement learning.

We investigated whether deep reinforcement learning (deep RL) is able to synthesize sophisticated and safe movement skills for a low-cost, miniature humanoid robot that can be composed into complex behavioral strategies. We used deep RL to train a humanoid robot to play a simplified one-versus-one soccer game. The resulting agent exhibits robust and dynamic movement skills, such as rapid fall recovery, walking, turning, and kicking, and it transitions between them in a smooth and efficient manner.

Simultaneous Floating-Base Estimation of Human Kinematics and Joint Torques.

The paper presents a stochastic methodology for the simultaneous floating-base estimation of the human whole-body kinematics and dynamics (i.e., joint torques, internal and external forces).

Whole-Body Human Inverse Dynamics with Distributed Micro-Accelerometers, Gyros and Force Sensing.

Human motion tracking is a powerful tool used in a large range of applications that require human movement analysis. Although it is a well-established technique, its main limitation is the lack of estimation of real-time kinetics information such as forces and torques during the motion capture. In this paper, we present a novel approach for a human soft wearable force tracking for the simultaneous estimation of whole-body forces along with the motion.

Motor contagion during human-human and human-robot interaction.

Motor resonance mechanisms are known to affect humans' ability to interact with others, yielding the kind of "mutual understanding" that is the basis of social interaction. However, it remains unclear how the partner's action features combine or compete to promote or prevent motor resonance during interaction. To clarify this point, the present study tested whether and how the nature of the visual stimulus and the properties of the observed actions influence observer's motor response, being motor contagion one of the behavioral manifestations of motor resonance.

The ITALK project: a developmental robotics approach to the study of individual, social, and linguistic learning.

This article presents results from a multidisciplinary research project on the integration and transfer of language knowledge into robots as an empirical paradigm for the study of language development in both humans and humanoid robots. Within the framework of human linguistic and cognitive development, we focus on how three central types of learning interact and co-develop: individual learning about one's own embodiment and the environment, social learning (learning from others), and learning of linguistic capability. Our primary concern is how these capabilities can scaffold each other's development in a continuous feedback cycle as their interactions yield increasingly sophisticated competencies in the agent's capacity to interact with others and manipulate its world.

Muscle synergies in neuroscience and robotics: from input-space to task-space perspectives.

In this paper we review the works related to muscle synergies that have been carried-out in neuroscience and control engineering. In particular, we refer to the hypothesis that the central nervous system (CNS) generates desired muscle contractions by combining a small number of predefined modules, called muscle synergies. We provide an overview of the methods that have been employed to test the validity of this scheme, and we show how the concept of muscle synergy has been generalized for the control of artificial agents.

Evidence for composite cost functions in arm movement planning: an inverse optimal control approach.

An important issue in motor control is understanding the basic principles underlying the accomplishment of natural movements. According to optimal control theory, the problem can be stated in these terms: what cost function do we optimize to coordinate the many more degrees of freedom than necessary to fulfill a specific motor goal? This question has not received a final answer yet, since what is optimized partly depends on the requirements of the task. Many cost functions were proposed in the past, and most of them were found to be in agreement with experimental data.

Finger impedance evaluation by means of hand exoskeleton.

Modulation of arm mechanical impedance is a fundamental aspect for interaction with the external environment and its regulation is essential for stability preservation during manipulation. Even though past research on human arm movements has suggested that models of human finger impedance would benefit the study of neural control mechanisms and the design of novel hand prostheses, relatively few studies have focused on finger and hand impedance. This article touches on the two main aspects of this research topic: first it introduces a mechanical refinement of a device that can be used to effectively measure finger impedance during manipulation tasks; then, it describes a pilot study aimed at identifying the inertia of the finger and the viscous and elastic properties of finger muscles.

Manifold reaching paradigm: how do we handle target redundancy?

How the central nervous system coordinates the many intrinsic degrees of freedom of the musculoskeletal system is a recurrent question in motor control. Numerous studies addressed it by considering redundant reaching tasks such as point-to-point arm movements, for which many joint trajectories and muscle activations are usually compatible with a single goal. There exists, however, a different, extrinsic kind of redundancy that is target redundancy.

The iCub humanoid robot: an open-systems platform for research in cognitive development.

We describe a humanoid robot platform--the iCub--which was designed to support collaborative research in cognitive development through autonomous exploration and social interaction. The motivation for this effort is the conviction that significantly greater impact can be leveraged by adopting an open systems policy for software and hardware development. This creates the need for a robust humanoid robot that offers rich perceptuo-motor capabilities with many degrees of freedom, a cognitive capacity for learning and development, a software architecture that encourages reuse & easy integration, and a support infrastructure that fosters collaboration and sharing of resources.

A control theory approach to the analysis and synthesis of the experimentally observed motion primitives.

Recent experiments on frogs and rats, have led to the hypothesis that sensory-motor systems are organized into a finite number of linearly combinable modules; each module generates a motor command that drives the system to a predefined equilibrium. Surprisingly, in spite of the infiniteness of different movements that can be realized, there seems to be only a handful of these modules. The structure can be thought of as a vocabulary of "elementary control actions".