Publications by authors named "Daniela Rus"

Discrepancy is a well-known measure for the irregularity of the distribution of a point set. Point sets with small discrepancy are called low discrepancy and are known to efficiently fill the space in a uniform manner. Low-discrepancy points play a central role in many problems in science and engineering, including numerical integration, computer vision, machine perception, computer graphics, machine learning, and simulation.

View Article and Find Full Text PDF

Sperm whales (Physeter macrocephalus) are highly social mammals that communicate using sequences of clicks called codas. While a subset of codas have been shown to encode information about caller identity, almost everything else about the sperm whale communication system, including its structure and information-carrying capacity, remains unknown. We show that codas exhibit contextual and combinatorial structure.

View Article and Find Full Text PDF

The sports industry is witnessing an increasing trend of utilizing multiple synchronized sensors for player data collection, enabling personalized training systems with multi-perspective real-time feedback. Badminton could benefit from these various sensors, but there is a scarcity of comprehensive badminton action datasets for analysis and training feedback. Addressing this gap, this paper introduces a multi-sensor badminton dataset for forehand clear and backhand drive strokes, based on interviews with coaches for optimal usability.

View Article and Find Full Text PDF

Human-machine interfaces for capturing, conveying, and sharing tactile information across time and space hold immense potential for healthcare, augmented and virtual reality, human-robot collaboration, and skill development. To realize this potential, such interfaces should be wearable, unobtrusive, and scalable regarding both resolution and body coverage. Taking a step towards this vision, we present a textile-based wearable human-machine interface with integrated tactile sensors and vibrotactile haptic actuators that are digitally designed and rapidly fabricated.

View Article and Find Full Text PDF

Robots are notoriously difficult to design because of complex interdependencies between their physical structure, sensory and motor layouts, and behavior. Despite this, almost every detail of every robot built to date has been manually determined by a human designer after several months or years of iterative ideation, prototyping, and testing. Inspired by evolutionary design in nature, the automated design of robots using evolutionary algorithms has been attempted for two decades, but it too remains inefficient: days of supercomputing are required to design robots in simulation that, when manufactured, exhibit desired behavior.

View Article and Find Full Text PDF

Analysis of relations between objects and comprehension of abstract concepts in the surgical video is important in AI-augmented surgery. However, building models that integrate our knowledge and understanding of surgery remains a challenging endeavor. In this paper, we propose a novel way to integrate conceptual knowledge into temporal analysis tasks using temporal concept graph networks.

View Article and Find Full Text PDF

Soft robots aim to revolutionize how robotic systems interact with the environment thanks to their inherent compliance. Some of these systems are even able to modulate their physical softness. However, simply equipping a robot with softness will not generate intelligent behaviors.

View Article and Find Full Text PDF

Autonomous robots can learn to perform visual navigation tasks from offline human demonstrations and generalize well to online and unseen scenarios within the same environment they have been trained on. It is challenging for these agents to take a step further and robustly generalize to new environments with drastic scenery changes that they have never encountered. Here, we present a method to create robust flight navigation agents that successfully perform vision-based fly-to-target tasks beyond their training environment under drastic distribution shifts.

View Article and Find Full Text PDF

Origami-inspired engineering has enabled intelligent materials and structures to process and react to environmental stimuli. However, it is challenging to achieve complete sense-decide-act loops in origami materials for autonomous interaction with environments, mainly due to the lack of information processing units that can interface with sensing and actuation. Here, we introduce an integrated origami-based process to create autonomous robots by embedding sensing, computing, and actuating in compliant, conductive materials.

View Article and Find Full Text PDF

Transformers have proven superior performance for a wide variety of tasks since they were introduced. In recent years, they have drawn attention from the vision community in tasks such as image classification and object detection. Despite this wave, an accurate and efficient multiple-object tracking (MOT) method based on transformers is yet to be designed.

View Article and Find Full Text PDF

We present the MiniCity, a multi-vehicle evaluation platform for testing perception hardware and software for autonomous vehicles. The MiniCity is a 1/10th scale city consisting of realistic urban scenery, intersections, and multiple fully autonomous 1/10th scale vehicles with state-of-the-art sensors and algorithms. The MiniCity is used to evaluate and test perception algorithms both upstream and downstream in the autonomy stack, in urban driving scenarios such as occluded intersections and avoiding multiple vehicles.

View Article and Find Full Text PDF

Multifunctional materials with distributed sensing and programmed mechanical properties are required for myriad emerging technologies. However, current fabrication techniques constrain these materials' design and sensing capabilities. We address these needs with a method for sensorizing architected materials through fluidic innervation, where distributed networks of empty, air-filled channels are directly embedded within an architected material's sparse geometry.

View Article and Find Full Text PDF

Machine learning has been advancing dramatically over the past decade. Most strides are human-based applications due to the availability of large-scale datasets; however, opportunities are ripe to apply this technology to more deeply understand non-human communication. We detail a scientific roadmap for advancing the understanding of communication of whales that can be built further upon as a template to decipher other forms of animal and non-human communication.

View Article and Find Full Text PDF

Introduction: Machine learning models are increasingly applied to predict the drug development outcomes based on intermediary clinical trial results. A key challenge to this task is to address various forms of bias in the historical drug approval data.

Objective: We aimed to identify and mitigate the bias in drug approval predictions and quantify the impacts of debiasing in terms of financial value and drug safety.

View Article and Find Full Text PDF

When an epidemic spreads into a population, it is often impractical or impossible to continuously monitor all subjects involved. As an alternative, we propose using algorithmic solutions that can infer the state of the whole population from a limited number of measures. We analyze the capability of deep neural networks to solve this challenging task.

View Article and Find Full Text PDF

MIT's Emergency-Vent Project was launched in March 2020 to develop safe guidance and a reference design for a bridge ventilator that could be rapidly produced in a distributed manner worldwide. The system uses a novel servo-based robotic gripper to automate the squeezing of a manual resuscitator bag evenly from both sides to provide ventilation according to clinically specified parameters. In just one month, the team designed and built prototype ventilators, tested them in a series of porcine trials, and collaborated with industry partners to enable mass production.

View Article and Find Full Text PDF

While neural networks achieve state-of-the-art performance for many molecular modeling and structure-property prediction tasks, these models can struggle with generalization to out-of-domain examples, exhibit poor sample efficiency, and produce uncalibrated predictions. In this paper, we leverage advances in evidential deep learning to demonstrate a new approach to uncertainty quantification for neural network-based molecular structure-property prediction at no additional computational cost. We develop both evidential 2D message passing neural networks and evidential 3D atomistic neural networks and apply these networks across a range of different tasks.

View Article and Find Full Text PDF

Today's use of large-scale industrial robots is enabling extraordinary achievement on the assembly line, but these robots remain isolated from the humans on the factory floor because they are very powerful, and thus dangerous to be around. In contrast, the soft robotics research community has proposed soft robots that are safe for human environments. The current state of the art enables the creation of small-scale soft robotic devices.

View Article and Find Full Text PDF

Many of the policies that were put into place during the Covid-19 pandemic had a common goal: to flatten the curve of the number of infected people so that its peak remains under a critical threshold. This letter considers the challenge of engineering a strategy that enforces such a goal using control theory. We introduce a simple formulation of the optimal flattening problem, and provide a closed form solution.

View Article and Find Full Text PDF

Background: Artificial intelligence (AI) and computer vision (CV) have revolutionized image analysis. In surgery, CV applications have focused on surgical phase identification in laparoscopic videos. We proposed to apply CV techniques to identify phases in an endoscopic procedure, peroral endoscopic myotomy (POEM).

View Article and Find Full Text PDF

Deployment of autonomous vehicles on public roads promises increased efficiency and safety. It requires understanding the intent of human drivers and adapting to their driving styles. Autonomous vehicles must also behave in safe and predictable ways without requiring explicit communication.

View Article and Find Full Text PDF

Objective(s): To develop and assess AI algorithms to identify operative steps in laparoscopic sleeve gastrectomy (LSG).

Background: Computer vision, a form of artificial intelligence (AI), allows for quantitative analysis of video by computers for identification of objects and patterns, such as in autonomous driving.

Methods: Intraoperative video from LSG from an academic institution was annotated by 2 fellowship-trained, board-certified bariatric surgeons.

View Article and Find Full Text PDF

Biological organisms achieve robust high-level behaviours by combining and coordinating stochastic low-level components. By contrast, most current robotic systems comprise either monolithic mechanisms or modular units with coordinated motions. Such robots require explicit control of individual components to perform specific functions, and the failure of one component typically renders the entire robot inoperable.

View Article and Find Full Text PDF