Passive Polarized Vision for Autonomous Vehicles: A Review.

This review article aims to address common research questions in passive polarized vision for robotics. What kind of polarization sensing can we embed into robots? Can we find our geolocation and true north heading by detecting light scattering from the sky as animals do? How should polarization images be related to the physical properties of reflecting surfaces in the context of scene understanding? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying future directions in passive polarized vision for robotics. After an introduction, three key interconnected areas will be covered in the following sections: embedded polarization imaging; polarized vision for robotics navigation; and polarized vision for scene understanding.

Shaping the energy curves of a servomotor-based hexapod robot.

The advantageous versatility of hexapod robots is often accompanied by high power consumption, while animals have evolved an energy efficient locomotion. However, there are a lack of methods able to compare and apply animals' energetic optimizations to robots. In this study, we applied our method to a full servomotor-based hexapod robot to evaluate its energetic performance.

SkyPole-A method for locating the north celestial pole from skylight polarization patterns.

True north can be determined on Earth by three means: magnetic compasses, stars, and via the global navigation satellite systems (GNSS), each of which has its own drawbacks. GNSS are sensitive to jamming and spoofing, magnetic compasses are vulnerable to magnetic interferences, and the stars can be used only at night with a clear sky. As an alternative to these methods, nature-inspired navigational cues are of particular interest.

Honeybees Use Multiple Invariants to Control Their Altitude.

How do bees perceive altitude changes so as to produce safe displacements within their environment? It has been proved that humans use invariants, but this concept remains little-known within the entomology community. The use of a single invariant, the optical speed rate of change, has been extensively demonstrated in bees in a ground-following task. Recently, it has been demonstrated that another invariant, the splay angle rate of change, could also be used by bees to adjust their altitude.

Visual augmentation of deck-landing-ability improves helicopter ship landing decisions.

When attempting to land on a ship deck tossed by the sea, helicopter pilots must make sure that the helicopter can develop sufficient lift to be able to safely touchdown. This reminder of affordance theory led us to model and study the affordance of deck-landing-ability, which defines whether it is possible to land safely on a ship deck depending on the helicopter's available lift and the ship's deck heave movements. Two groups of participants with no piloting experience using a laptop helicopter simulator attempted to land either a low-lifter or a heavy-lifter helicopter on a virtual ship deck by either triggering a pre-programmed lift serving as the descent law if it was deemed possible to land, or aborting the deck-landing maneuver.

An experimental setup for decoupling optical invariants in honeybees' altitude control.

Bees outperform pilots in navigational tasks, despite having 100,000 times fewer neurons. It is commonly accepted in the literature that optic flow is a key parameter used by flying insects to control their altitude. The ambition of the present work was to design an innovative experimental setup that would make it possible to determine whether bees could rely simultaneously on several optical invariants, as pilots do.

Floor and ceiling mirror configurations to study altitude control in honeybees.

To investigate altitude control in honeybees, an optical configuration was designed to manipulate or cancel the optic flow. It has been widely accepted that honeybees rely on the optic flow generated by the ground to control their altitude. Here, we create an optical configuration enabling a better understanding of the mechanism of altitude control in honeybees.

Ecological Entomology: How Is Gibson's Framework Useful?

To date, numerous studies have demonstrated the fundamental role played by optic flow in the control of goal-directed displacement tasks in insects. Optic flow was first introduced by Gibson as part of their ecological approach to perception and action. While this theoretical approach (as a whole) has been demonstrated to be particularly suitable for the study of goal-directed displacements in humans, its usefulness in carrying out entomological field studies remains to be established.

Insect-Inspired Robots: Bridging Biological and Artificial Systems.

This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control.

Ecological design of augmentation improves helicopter ship landing maneuvers: An approach in augmented virtuality.

Helicopter landing on a ship is a visually regulated "rendezvous" task during which pilots must use fine control to land a powerful rotorcraft on the deck of a moving ship tossed by the sea while minimizing the energy at impact. Although augmented reality assistance can be hypothesized to improve pilots' performance and the safety of landing maneuvers by guiding action toward optimal behavior in complex and stressful situations, the question of the optimal information to be displayed to feed the pilots' natural information-movement coupling remains to be investigated. Novice participants were instructed to land a simplified helicopter on a ship in a virtual reality simulator while minimizing energy at impact and landing duration.

Optic flow cues help explain altitude control over sea in freely flying gulls.

For studies of how birds control their altitude, seabirds are of particular interest because they forage offshore where the visual environment can be simply modelled by a flat world textured by waves then generating only ventral visual cues. This study suggests that optic flow, i.e.

Polarized skylight-based heading measurements: a bio-inspired approach.

Many insects such as desert ants, crickets, locusts, dung beetles, bees and monarch butterflies have been found to extract their navigation cues from the regular pattern of the linearly polarized skylight. These species are equipped with ommatidia in the dorsal rim area of their compound eyes, which are sensitive to the angle of polarization of the skylight. In the polarization-based robotic vision, most of the sensors used so far comprise high-definition CCD or CMOS cameras topped with linear polarizers.

AntBot: A six-legged walking robot able to home like desert ants in outdoor environments.

Autonomous outdoor navigation requires reliable multisensory fusion strategies. Desert ants travel widely every day, showing unrivaled navigation performance using only a few thousand neurons. In the desert, pheromones are instantly destroyed by the extreme heat.

Insect-inspired vision for autonomous vehicles.

Flying insects are being studied these days as if they were agile micro air vehicles fitted with smart sensors, requiring very few brain resources. The findings obtained on these natural fliers have proved to be extremely valuable when it comes to designing compact low-weight artificial optical sensors capable of performing visual processing tasks robustly under various environmental conditions (light, clouds, contrast). Here, we review some outstanding bio-inspired visual sensors, which can be used for either detecting motion in the visible spectrum or controlling celestial navigation in the ultraviolet spectrum and for attitude stabilisation purposes.

Altitude control in honeybees: joint vision-based learning and guidance.

Studies on insects' visual guidance systems have shed little light on how learning contributes to insects' altitude control system. In this study, honeybees were trained to fly along a double-roofed tunnel after entering it near either the ceiling or the floor of the tunnel. The honeybees trained to hug the ceiling therefore encountered a sudden change in the tunnel configuration midways: i.

Optic flow-based collision-free strategies: From insects to robots.

Flying insects are able to fly smartly in an unpredictable environment. It has been found that flying insects have smart neurons inside their tiny brains that are sensitive to visual motion also called optic flow. Consequently, flying insects rely mainly on visual motion during their flight maneuvers such as: takeoff or landing, terrain following, tunnel crossing, lateral and frontal obstacle avoidance, and adjusting flight speed in a cluttered environment.

A biomimetic vision-based hovercraft accounts for bees' complex behaviour in various corridors.

Here we present the first systematic comparison between the visual guidance behaviour of a biomimetic robot and those of honeybees flying in similar environments. We built a miniature hovercraft which can travel safely along corridors with various configurations. For the first time, we implemented on a real physical robot the 'lateral optic flow regulation autopilot', which we previously studied computer simulations.

A bee in the corridor: centering and wall-following.

In an attempt to better understand the mechanism underlying lateral collision avoidance in flying insects, we trained honeybees (Apis mellifera) to fly through a large (95-cm wide) flight tunnel. We found that, depending on the entrance and feeder positions, honeybees would either center along the corridor midline or fly along one wall. Bees kept following one wall even when a major (150-cm long) part of the opposite wall was removed.