A Computationally Efficient Visual Saliency Algorithm Suitable for an Analog CMOS Implementation.

Computer vision algorithms are often limited in their application by the large amount of data that must be processed. Mammalian vision systems mitigate this high bandwidth requirement by prioritizing certain regions of the visual field with neural circuits that select the most salient regions. This work introduces a novel and computationally efficient visual saliency algorithm for performing this neuromorphic attention-based data reduction.

CIDER: Enabling Robustness-Power Tradeoffs on a Computational Eyeglass.

The human eye offers a fascinating window into an individual's health, cognitive attention, and decision making, but we lack the ability to continually measure these parameters in the natural environment. The challenges lie in: a) handling the complexity of continuous high-rate sensing from a camera and processing the image stream to estimate eye parameters, and b) dealing with the wide variability in illumination conditions in the natural environment. This paper explores the power-robustness tradeoffs inherent in the design of a wearable eye tracker, and proposes a novel staged architecture that enables graceful adaptation across the spectrum of real-world illumination.

Light-controlled modulation of gene expression by chemical optoepigenetic probes.

Epigenetic gene regulation is a dynamic process orchestrated by chromatin-modifying enzymes. Many of these master regulators exert their function through covalent modification of DNA and histone proteins. Aberrant epigenetic processes have been implicated in the pathophysiology of multiple human diseases.

CIDER: Enhancing the Performance of Computational Eyeglasses.

The human eye offers a fascinating window into an individual's health, cognitive attention, and decision making, but we lack the ability to continually measure these parameters in the natural environment. We demonstrate CIDER, a system that operates in a highly optimized low-power mode under indoor settings by using a fast Search-Refine controller to track the eye, but detects when the environment switches to more challenging outdoor sunlight and switches models to operate robustly under this condition. Our design is holistic and tackles a) power consumption in digitizing pixels, estimating pupillary parameters, and illuminating the eye via near-infrared and b) error in estimating pupil center and pupil dilation.

A portable time-domain LED fluorimeter for nanosecond fluorescence lifetime measurements.

Fluorescence lifetime measurements are becoming increasingly important in chemical and biological research. Time-domain lifetime measurements offer fluorescence multiplexing and improved handling of interferers compared with the frequency-domain technique. In this paper, an all solid-state, filterless, and highly portable light-emitting-diode based time-domain fluorimeter (LED TDF) is reported for the measurement of nanosecond fluorescence lifetimes.

iShadow: Design of a Wearable, Real-Time Mobile Gaze Tracker.

Continuous, real-time tracking of eye gaze is valuable in a variety of scenarios including hands-free interaction with the physical world, detection of unsafe behaviors, leveraging visual context for advertising, life logging, and others. While eye tracking is commonly used in clinical trials and user studies, it has not bridged the gap to everyday consumer use. The challenge is that a real-time eye tracker is a power-hungry and computation-intensive device which requires continuous sensing of the eye using an imager running at many tens of frames per second, and continuous processing of the image stream using sophisticated gaze estimation algorithms.

Lensless fluorescence imaging with height calculation.

Lensless fluorescence imaging (LFI) is the imaging of fluorescence from cells or microspheres using an image sensor with no external lenses or filters. The simplicity of the hardware makes it well suited to replace fluorescence microscopes and flow cytometers in lab-on-a-chip applications, but the images captured by LFI are highly dependent on the distance between the sample and the sensor. This work demonstrates that not only can samples be accurately detected across a range of sample-sensor separations using LFI, but also that the separation can be accurately estimated based on the shape of fluorescence in the LFI image.

High-throughput imaging of adult fluorescent zebrafish with an LED fluorescence macroscope.

Zebrafish are a useful vertebrate model for the study of development, behavior, disease and cancer. A major advantage of zebrafish is that large numbers of animals can be economically used for experimentation; however, high-throughput methods for imaging live adult zebrafish had not been developed. Here, we describe protocols for building a light-emitting diode (LED) fluorescence macroscope and for using it to simultaneously image up to 30 adult animals that transgenically express a fluorescent protein, are transplanted with fluorescently labeled tumor cells or are tagged with fluorescent elastomers.

Quantitative Measurement of Protease-Activity with Correction of Probe Delivery and Tissue Absorption Effects.

Proteases play important roles in a variety of pathologies from heart disease to cancer. Quantitative measurement of protease activity is possible using a novel spectrally matched dual fluorophore probe and a small animal lifetime imager. The recorded fluorescence from an activatable fluorophore, one that changes its fluorescent amplitude after biological target interaction, is also influenced by other factors including imaging probe delivery and optical tissue absorption of excitation and emission light.

Development of a time domain fluorimeter for fluorescent lifetime multiplexing analysis.

We show that a portable, inexpensive USB-powered time domain fluorimeter (TDF) and analysis scheme were developed for use in evaluating a new class of fluorescent lifetime multiplexed dyes. Fluorescent proteins, organic dyes, and quantum dots allow the labeling of more and more individual features within biological systems, but the wide absorption and emission spectra of these fluorophores limit the number of distinct processes which may be simultaneously imaged using spectral separation alone. By additionally separating reporters in a second dimension, fluorescent lifetime multiplexing provides a means to multiply the number of available imaging channels.

Upconverting luminescent nanomaterials: application to in vivo bioimaging.

In this report, the development of multi-channel anti-Stokes luminescent Y2O3 nanoparticles for application to in vivo upconversion imaging is detailed.

Design and demonstration of a small-animal up-conversion imager.

This first small-animal up-conversion imager (SAUCI) was developed and used for in-vivo imaging of up-converting nanoparticles (UCNs.) Unlike traditional fluorophores, UCNs absorb multiple lower-energy photons and emit a single higher-energy photon. This unique physical process makes it possible to image deeper into tissue with lower background signals.