Researchers leverage shadows to model 3D scenes, including objects blocked from view
This technique could lead to safer autonomous vehicles, more efficient AR/VR headsets, or faster warehouse robots.
Understanding the visual knowledge of language models
LLMs trained primarily on text can generate complex visual concepts through code with self-correction. Researchers used these illustrations to train an image-free computer vision system to recognize real photos.
A smarter way to streamline drug discovery
The SPARROW algorithm automatically identifies the best molecules to test as potential new medicines, given the vast number of factors affecting each choice.
Technique improves the reasoning capabilities of large language models
Combining natural language and programming, the method enables LLMs to solve numerical, analytical, and language-based tasks transparently.
Researchers use large language models to help robots navigate
The method uses language-based inputs instead of costly visual data to direct a robot through a multistep navigation task.
New algorithm discovers language just by watching videos
DenseAV, developed at MIT, learns to parse and understand the meaning of language just by watching videos of people talking, with potential applications in multimedia search, language learning, and robotics.
Mouth-based touchpad enables people living with paralysis to interact with computers
The startup Augmental allows users to operate phones and other devices using their tongue, mouth, and head gestures.
Helping robots grasp the unpredictable
MIT CSAIL’s frugal deep-learning model infers the hidden physical properties of objects, then adapts to find the most stable grasps for robots in unstructured environments like homes and fulfillment centers.
A technique for more effective multipurpose robots
With generative AI models, researchers combined robotics data from different sources to help robots learn better.
Modular, scalable hardware architecture for a quantum computer
A new quantum-system-on-chip enables the efficient control of a large array of qubits, moving toward practical quantum computing.
Looking for a specific action in a video? This AI-based method can find it for you
A new approach could streamline virtual training processes or aid clinicians in reviewing diagnostic videos.
Controlled diffusion model can change material properties in images
“Alchemist” system adjusts the material attributes of specific objects within images to potentially modify video game models to fit different environments, fine-tune VFX, and diversify robotic training.
School of Engineering welcomes new faculty
Fifteen new faculty members join six of the school’s academic departments.
Robotic palm mimics human touch
MIT CSAIL researchers enhance robotic precision with sophisticated tactile sensors in the palm and agile fingers, setting the stage for improvements in human-robot interaction and prosthetic technology.
Janabel Xia: Algorithms, dance rhythms, and the drive to succeed
When the senior isn’t using mathematical and computational methods to boost driverless vehicles and fairer voting, she performs with MIT’s many dance groups to keep her on track.