News & Events

1,431 News items, Awards, Events and Talks related to MERL and its staff.


  •  NEWS    Rien Quirynen appointed as an Associate Editor for Journal of Optimal Control Applications and Methods (OCAM)
    Date: February 24, 2022
    MERL Contact: Rien Quirynen
    Research Areas: Control, Optimization
    Brief
    • Rien Quirynen has accepted an invitation to serve on the editorial board of Journal of Optimal Control Applications and Methods (OCAM) as an Associate Editor.

      OCAM provides a forum for papers on the full range of optimal control and related control design methods. The aim is to encourage new developments in optimal control theory and design methodologies that may lead to advances in real control applications.
  •  
  •  TALK    [MERL Seminar Series 2022] Beyond the First Portrait of a Black Hole
    Date & Time: Tuesday, February 15, 2022; 1:00 PM EST
    Speaker: Katie Bouman, California Institute of Technology
    MERL Host: Joshua Rapp
    Research Area: Computational Sensing
    Abstract
    • As imaging requirements become more demanding, we must rely on increasingly sparse and/or noisy measurements that fail to paint a complete picture. Computational imaging pipelines, which replace optics with computation, have enabled image formation in situations that are impossible for conventional optical imaging. For instance, the first black hole image, published in 2019, was only made possible through the development of computational imaging pipelines that worked alongside an Earth-sized distributed telescope. However, remaining scientific questions motivate us to improve this computational telescope to see black hole phenomena still invisible to us and to meaningfully interpret the collected data. This talk will discuss how we are leveraging and building upon recent advances in machine learning in order to achieve more efficient uncertainty quantification of reconstructed images as well as to develop techniques that allow us to extract the evolving structure of our own Milky Way's black hole over the course of a night, perhaps even in three dimensions.
  •  
  •  TALK    [MERL Seminar Series 2022] Extreme optics design as a large-scale optimization problem
    Date & Time: Tuesday, February 8, 2022; 1:00 PM EST
    Speaker: Raphaël Pestourie, MIT
    MERL Host: Matthew E. Brand
    Research Areas: Applied Physics, Electronic and Photonic Devices, Optimization
    Abstract
    • Thin large-area structures with aperiodic subwavelength patterns can unleash the full power of Maxwell’s equations for focusing light and a variety of other wave transformation or optical applications. Because of their irregularity and large scale, capturing the full scattering through these devices is one of the most challenging tasks for computational design: enter extreme optics! This talk will present ways to harness the full computational power of modern large-scale optimization in order to design optical devices with thousands or millions of free parameters. We exploit various methods of domain-decomposition approximations, supercomputer-scale topology optimization, laptop-scale “surrogate” models based on Chebyshev interpolation and/or new scientific machine learning models, and other techniques to attack challenging problems: achromatic lenses that simultaneously handle many wavelengths and angles, “deep” images, hyperspectral imaging, and more.
  •  
  •  NEWS    Dr. Benosman is invited to give the mini-course in control theory at the 2022 edition of the Benelux Meeting on Systems and Control
    Date: July 5, 2022 - July 7, 2022
    MERL Contact: Mouhacine Benosman
    Research Areas: Control, Data Analytics, Dynamical Systems
    Brief
    • The Benelux meeting is an annual conference gathering of the scientific community of Belgium, the Netherlands, and Luxemburg around systems and control. It is especially intended for PhD researchers and a number of activities are dedicated to them, including plenary talks and a mini-course.

      Dr. Benosman has been invited to give the mini-course of the 2022 edition of the conference. This course, entitled 'A hybrid approach to control: classical control theory meets machine learning theory', will be centered around the topic of safe and robust machine learning-based control.
  •  
  •  NEWS    Radu Corcodel joins the IEEE-RAS Standing Committee for Standards & Human-Robot Interaction Terminology
    Date: February 3, 2022
    MERL Contact: Radu Corcodel
    Research Areas: Robotics, Human-Computer Interaction
    Brief
    • Radu Corcodel, a Principal Research Scientist in MERL's computer vision group, has been invited to join the IEEE-RAS Standing Committee for Standards & Human-Robot Interaction Terminology. This committee defines standard terms relevant to human-robot interaction in service, social, education, industrial, and research robotic applications. It establishes and defines a common terminology for practitioners and users of human-robot interaction (HRI) technologies. It is also intended to address issues common within the field of HRI, particularly surrounding the use of inconsistent and/or conflicting terms and definitions.

      The invitation is a recognition of Radu's excellent record of robotics research and a significant opportunity for him to contribute to new standards in robotics terminology.
  •  
  •  NEWS    Arvind Raghunathan to serve on The Howard Rosenbrock Prize committee
    Date: May 31, 2022
    MERL Contact: Arvind Raghunathan
    Research Area: Optimization
    Brief
    • Arvind Raghunathan from MERL's Data Analytics group has been invited to serve on the The Howard Rosenbrock Prize committee. Instituted in 2015, Optimization and Engineering journal's Howard Rosenbrock Prize is awarded annually to honor the authors of the best paper published in the journal in the previous year.
  •  
  •  NEWS    Jonathan Le Roux discusses MERL's audio source separation work on popular machine learning podcast
    Date: January 24, 2022
    Where: The TWIML AI Podcast
    MERL Contact: Jonathan Le Roux
    Research Areas: Artificial Intelligence, Machine Learning, Speech & Audio
    Brief
    • MERL Speech & Audio Senior Team Leader Jonathan Le Roux was featured in an extended interview on the popular TWIML AI Podcast, presenting MERL's work towards solving the "cocktail party problem". Humans have the extraordinary ability to focus on particular sounds of interest within a complex acoustic scene, such as a cocktail party. MERL's Speech & Audio Team has been at the forefront of the field's effort to develop algorithms giving machines similar abilities. Jonathan talked with host Sam Charrington about the group's decade-long journey on this topic, from early pioneering work using deep learning for speech enhancement and speech separation, to recent works on weakly-supervised separation, hierarchical sound separation, as well as the separation of real-world soundtracks into speech, music, and sound effects (aka the "cocktail fork problem").

      The TWIML AI podcast, formerly known as This Week in Machine Learning & AI, was created in 2016 and is followed by more than 10,000 subscribers on Youtube and Twitter. Jonathan's interview marks the 555th episode of the podcast.
  •  
  •  AWARD    Joshua Rapp wins Best Dissertation Award from the IEEE Signal Processing Society
    Date: December 20, 2021
    Awarded to: Joshua Rapp
    MERL Contact: Joshua Rapp
    Research Areas: Computational Sensing, Signal Processing
    Brief
    • Joshua Rapp has won the 2021 Best PhD Dissertation Award from the IEEE Signal Processing Society.
      The award recognizes a PhD thesis completed on a signal processing subject within the past three years for its relevant work in signal processing while stimulating further research in the field.

      Dr. Rapp completed his PhD at Boston University in 2020 with a thesis entitled "Probabilistic Modeling for Single-Photon Lidar." The dissertation tackles challenges of the acquisition and processing of 3D depth maps reconstructed from time-of-flight data captured one photon at a time.
      The award will be presented at the 2022 IEEE International Conference on Image Processing (ICIP) in France.
  •  
  •  NEWS    Uroš Kalabić joins editorial board of IEEE Transactions on Control Systems Technology
    Date: December 14, 2021
    Research Area: Control
    Brief
    • MERL researcher Uroš Kalabić has been appointed to serve as an associate editor of the IEEE Transactions on Control Systems Technology.

      The Transactions on Control Systems Technology bridge the gap between the theory and practice of control engineering. They feature publications on engineering needed to implement practical control systems.
  •  
  •  TALK    [MERL Seminar Series 2021] Harnessing machine learning to build better Earth system models for climate projection
    Date & Time: Tuesday, December 14, 2021; 1:00 PM EST
    Speaker: Prof. Chris Fletcher, University of Waterloo
    MERL Host: Ankush Chakrabarty
    Research Areas: Dynamical Systems, Machine Learning, Multi-Physical Modeling
    Abstract
    • Decision-making and adaptation to climate change requires quantitative projections of the physical climate system and an accurate understanding of the uncertainty in those projections. Earth system models (ESMs), which solve the Navier-Stokes equations on the sphere, are the only tool that climate scientists have to make projections forward into climate states that have not been observed in the historical data record. Yet, ESMs are incredibly complex and expensive codes and contain many poorly constrained physical parameters—for processes such as clouds and convection—that must be calibrated against observations. In this talk, I will describe research from my group that uses ensembles of ESM simulations to train statistical models that learn the behavior and sensitivities of the ESM. Once trained and validated the statistical models are essentially free to run, which allows climate modelling centers to make more efficient use of precious compute cycles. The aim is to improve the quality of future climate projections, by producing better calibrated ESMs, and to improve the quantification of the uncertainties, by better sampling the equifinality of climate states.
  •  
  •  NEWS    Toshiaki Koike-Akino Gives Seminar Talk at IEEE Boston Photonics
    Date & Time: December 9, 2021; 7pm EST
    Where: virtual
    MERL Contact: Toshiaki Koike-Akino
    Research Areas: Communications, Machine Learning, Signal Processing
    Brief
    • Toshiaki Koike-Akino (Signal Processing group, Network Intelligence Team) is giving an invited talk titled, `Evolution of Machine Learning for Photonic Research' for the Boston Photonic Chapter of the IEEE Photonic Society on December 9. The talk covers recent MERL research on machine learning for nonlinearity compensation and nanophotonic device design.
  •  
  •  TALK    [MERL Seminar Series 2021] Use the [Magnetic] Force for Good: Sustainability Through Magnetic Levitation
    Date & Time: Tuesday, December 7, 2021; 1:00 PM EST
    Speaker: Prof. Eric Severson, University of Wisconsin-Madison
    MERL Host: Bingnan Wang
    Research Area: Electric Systems
    Abstract
    • Electric motors pump our water, heat and cool our homes and offices, drive critical medical and surgical equipment, and, increasingly, operate our transportation systems. Approximately 99% of the world’s electric energy is produced by a rotating generator and 45% of that energy is consumed by an electric motor. The efficiency of this technology is vital in enabling our energy sustainability and reducing our carbon footprint. The reliability and lifetime of this technology have severe, and sometimes life-altering, consequences. Today’s motor technology largely relies upon mechanical bearings to support the motor’s shaft. These bearings are the first components to fail, create frictional losses, and rely on lubricants that create contamination challenges and require periodic maintenance. In short, bearings are the Achilles' heel of modern electric motors.

      This seminar will explore the use of actively controlled magnetic forces to levitate the motor shaft, eliminating mechanical bearings and the problems associated with them. The working principles of traditional magnetic levitation technology (active magnetic bearings) will be reviewed and used to explain why this technology has not been successfully applied to the most high-impact motor applications. Research into “bearingless” motors offers a new levitation approach by manipulating the inherent magnetic force capability of all electric motors. While traditional motors are carefully designed to prevent shaft forces, the bearingless motor concept controls these forces to make the motor simultaneously function as an active magnetic bearing. The seminar will showcase the potential of bearingless technology to revolutionize motor systems of critical importance for energy and sustainability—from industrial compressors and blowers, such as those found in HVAC systems and wastewater aeration equipment, to power grid flywheel energy storage devices and electric turbochargers in fuel-efficient vehicles.
  •  
  •  EVENT    Prof. Melanie Zeilinger of ETH to give keynote at MERL's Virtual Open House
    Date & Time: Thursday, December 9, 2021; 1:00pm - 5:30pm EST
    Location: Virtual Event
    Speaker: Prof. Melanie Zeilinger, ETH
    Research Areas: Applied Physics, Artificial Intelligence, Communications, Computational Sensing, Computer Vision, Control, Data Analytics, Dynamical Systems, Electric Systems, Electronic and Photonic Devices, Machine Learning, Multi-Physical Modeling, Optimization, Robotics, Signal Processing, Speech & Audio, Digital Video, Human-Computer Interaction, Information Security
    Brief
    • MERL is excited to announce the second keynote speaker for our Virtual Open House 2021:
      Prof. Melanie Zeilinger from ETH .

      Our virtual open house will take place on December 9, 2021, 1:00pm - 5:30pm (EST).

      Join us to learn more about who we are, what we do, and discuss our internship and employment opportunities. Prof. Zeilinger's talk is scheduled for 3:15pm - 3:45pm (EST).

      Registration: https://mailchi.mp/merl/merlvoh2021

      Keynote Title: Control Meets Learning - On Performance, Safety and User Interaction

      Abstract: With increasing sensing and communication capabilities, physical systems today are becoming one of the largest generators of data, making learning a central component of autonomous control systems. While this paradigm shift offers tremendous opportunities to address new levels of system complexity, variability and user interaction, it also raises fundamental questions of learning in a closed-loop dynamical control system. In this talk, I will present some of our recent results showing how even safety-critical systems can leverage the potential of data. I will first briefly present concepts for using learning for automatic controller design and for a new safety framework that can equip any learning-based controller with safety guarantees. The second part will then discuss how expert and user information can be utilized to optimize system performance, where I will particularly highlight an approach developed together with MERL for personalizing the motion planning in autonomous driving to the individual driving style of a passenger.
  •  
  •  AWARD    Petros Boufounos Elevated to IEEE Fellow
    Date: January 1, 2022
    Awarded to: Petros T. Boufounos
    MERL Contact: Petros T. Boufounos
    Research Areas: Computational Sensing, Signal Processing
    Brief
    • MERL’s Petros Boufounos has been elevated to IEEE Fellow, effective January 2022, for “contributions to compressed sensing.”

      IEEE Fellow is the highest grade of membership of the IEEE. It honors members with an outstanding record of technical achievements, contributing importantly to the advancement or application of engineering, science and technology, and bringing significant value to society. Each year, following a rigorous evaluation procedure, the IEEE Fellow Committee recommends a select group of recipients for elevation to IEEE Fellow. Less than 0.1% of voting members are selected annually for this member grade elevation.
  •  
  •  EVENT    Prof. Ashok Veeraraghavan of Rice University to give keynote at MERL's Virtual Open House
    Date & Time: Thursday, December 9, 2021; 1:00pm - 5:30pm EST
    Location: Virtual Event
    Speaker: Prof. Ashok Veeraraghavan, Rice University
    Research Areas: Applied Physics, Artificial Intelligence, Communications, Computational Sensing, Computer Vision, Control, Data Analytics, Dynamical Systems, Electric Systems, Electronic and Photonic Devices, Machine Learning, Multi-Physical Modeling, Optimization, Robotics, Signal Processing, Speech & Audio, Digital Video, Human-Computer Interaction, Information Security
    Brief
    • MERL is excited to announce the first keynote speaker for our Virtual Open House 2021:
      Prof. Ashok Veeraraghavan from Rice University.

      Our virtual open house will take place on December 9, 2021, 1:00pm - 5:30pm (EST).

      Join us to learn more about who we are, what we do, and discuss our internship and employment opportunities. Prof. Veeraraghavan's talk is scheduled for 1:15pm - 1:45pm (EST).

      Registration: https://mailchi.mp/merl/merlvoh2021

      Keynote Title: Computational Imaging: Beyond the limits imposed by lenses.

      Abstract: The lens has long been a central element of cameras, since its early use in the mid-nineteenth century by Niepce, Talbot, and Daguerre. The role of the lens, from the Daguerrotype to modern digital cameras, is to refract light to achieve a one-to-one mapping between a point in the scene and a point on the sensor. This effect enables the sensor to compute a particular two-dimensional (2D) integral of the incident 4D light-field. We propose a radical departure from this practice and the many limitations it imposes. In the talk we focus on two inter-related research projects that attempt to go beyond lens-based imaging.

      First, we discuss our lab’s recent efforts to build flat, extremely thin imaging devices by replacing the lens in a conventional camera with an amplitude mask and computational reconstruction algorithms. These lensless cameras, called FlatCams can be less than a millimeter in thickness and enable applications where size, weight, thickness or cost are the driving factors. Second, we discuss high-resolution, long-distance imaging using Fourier Ptychography, where the need for a large aperture aberration corrected lens is replaced by a camera array and associated phase retrieval algorithms resulting again in order of magnitude reductions in size, weight and cost. Finally, I will spend a few minutes discussing how the wholistic computational imaging approach can be used to create ultra-high-resolution wavefront sensors.
  •  
  •  AWARD    Toshiaki Koike-Akino elected Fellow of Optica
    Date: November 18, 2021
    Awarded to: Toshiaki Koike-Akino
    MERL Contact: Toshiaki Koike-Akino
    Research Areas: Communications, Electronic and Photonic Devices, Signal Processing
    Brief
    • Toshiaki Koike-Akino's research activities in communications, error control coding and optical technologies at MERL have earned him election as a Fellow Member of Optica (formerly OSA), the foremost professional association in optics and photonics worldwide. Fellow membership in Optica is limited to no more than ten percent of the membership and is reserved for members who have served with distinction in the advancement of optics and photonics. Koike-Akino is one of 106 members from 24 countries in Optica’s 2022 Fellows Class, elected during the Board of Directors of Optica meeting held on 2nd of November, 2021.

      “Congratulations to the 2022 Optica Fellows,” said 2021 President Connie Chang-Hasnain, University of California, Berkeley, USA. “These members exemplify what it means to be a leader in optics and photonics. Your election, by your peers, confirms the important contributions made within our field. Thank you for your dedication to Optica, and for advancing the science of light.”

      Koike-Akino's elevation to Fellow is specifically “for outstanding and innovative contributions to R&D in enabling technologies for optical communications, including nonlinear equalizers, high-dimensional modulations, and FEC (Forward Error Correction),” said Meredith Smith, Director, Optica Awards and Honors Office. "Again, congratulations on joining this esteemed group of Optica members."

      About Optica

      Optica (formerly OSA) is dedicated to promoting the generation, application, archiving and dissemination of knowledge in optics and photonics worldwide. Founded in 1916, it is the leading organization for scientists, engineers, business professionals, students and others interested in the science of light. Optica’s renowned publications, meetings, online resources and in-person activities fuel discoveries, shape real-life applications and accelerate scientific, technical and educational achievement.
  •  
  •  AWARD    Mitsubishi Electric US Receives a 2022 CES Innovation Award for Touchless Elevator Control Jointly Developed with MERL
    Date: November 17, 2021
    Awarded to: Elevators and Escalators Division of Mitsubishi Electric US, Inc.
    MERL Contacts: Daniel N. Nikovski; William S. Yerazunis
    Research Areas: Data Analytics, Machine Learning, Signal Processing
    Brief
    • The Elevators and Escalators Division of Mitsubishi Electric US, Inc. has been recognized as a 2022 CES® Innovation Awards honoree for its new PureRide™ Touchless Control for elevators, jointly developed with MERL. Sponsored by the Consumer Technology Association (CTA), the CES Innovation Awards is the largest and most influential technology event in the world. PureRide™ Touchless Control provides a simple, no-touch product that enables users to call an elevator and designate a destination floor by placing a hand or finger over a sensor. MERL initiated the development of PureRide™ in the first weeks of the COVID-19 pandemic by proposing the use of infra-red sensors for operating elevator call buttons, and participated actively in its rapid implementation and commercialization, resulting in a first customer installation in October of 2020.
  •  
  •  AWARD    MERL Ranked 1st Place in Cross-Subject Transfer Learning Task and 4th Place Overall at the NeurIPS2021 BEETL Competition for EEG Transfer Learning.
    Date: November 11, 2021
    Awarded to: Niklas Smedemark-Margulies, Toshiaki Koike-Akino, Ye Wang, Deniz Erdogmus
    MERL Contacts: Toshiaki Koike-Akino; Ye Wang
    Research Areas: Artificial Intelligence, Signal Processing, Human-Computer Interaction
    Brief
    • The MERL Signal Processing group achieved first place in the cross-subject transfer learning task and fourth place overall in the NeurIPS 2021 BEETL AI Challenge for EEG Transfer Learning. The team included Niklas Smedemark-Margulies (intern from Northeastern University), Toshiaki Koike-Akino, Ye Wang, and Prof. Deniz Erdogmus (Northeastern University). The challenge addresses two types of transfer learning tasks for EEG Biosignals: a homogeneous transfer learning task for cross-subject domain adaptation; and a heterogeneous transfer learning task for cross-data domain adaptation. There were 110+ registered teams in this competition, MERL ranked 1st in the homogeneous transfer learning task, 7th place in the heterogeneous transfer learning task, and 4th place for the combined overall score. For the homogeneous transfer learning task, MERL developed a new pre-shot learning framework based on feature disentanglement techniques for robustness against inter-subject variation to enable calibration-free brain-computer interfaces (BCI). MERL is invited to present our pre-shot learning technique at the NeurIPS 2021 workshop.
  •  
  •  TALK    [MERL Seminar Series 2021] Prof. Thomas Schön presents talk at MERL entitled Deep probabilistic regression
    Date & Time: Tuesday, November 16, 2021; 11:00 AM EST
    Speaker: Thomas Schön, Uppsala University
    MERL Host: Karl Berntorp
    Research Areas: Dynamical Systems, Machine Learning
    Abstract
    • While deep learning-based classification is generally addressed using standardized approaches, this is really not the case when it comes to the study of regression problems. There are currently several different approaches used for regression and there is still room for innovation. We have developed a general deep regression method with a clear probabilistic interpretation. The basic building block in our construction is an energy-based model of the conditional output density p(y|x), where we use a deep neural network to predict the un-normalized density from input-output pairs (x, y). Such a construction is also commonly referred to as an implicit representation. The resulting learning problem is challenging and we offer some insights on how to deal with it. We show good performance on several computer vision regression tasks, system identification problems and 3D object detection using laser data.
  •  
  •  EVENT    MERL Virtual Open House 2021
    Date & Time: Thursday, December 9, 2021; 100pm-5:30pm (EST)
    Location: Virtual Event
    Research Areas: Applied Physics, Artificial Intelligence, Communications, Computational Sensing, Computer Vision, Control, Data Analytics, Dynamical Systems, Electric Systems, Electronic and Photonic Devices, Machine Learning, Multi-Physical Modeling, Optimization, Robotics, Signal Processing, Speech & Audio, Digital Video, Human-Computer Interaction, Information Security
    Brief
    • Mitsubishi Electric Research Laboratories cordially invites you to join our Virtual Open House, on December 9, 2021, 1:00pm - 5:30pm (EST).

      The event will feature keynotes, live sessions, research area booths, and time for open interactions with our researchers. Join us to learn more about who we are, what we do, and discuss our internship and employment opportunities.

      Registration: https://mailchi.mp/merl/merlvoh2021
  •  
  •  TALK    [MERL Seminar Series 2021] Prof. Marco Di Renzo presents talk at MERL entitled Reconfigurable Intelligent Surfaces for Wireless Communications
    Date & Time: Tuesday, November 9, 2021; 1:00 PM EST
    Speaker: Prof. Marco Di Renzo, CNRS & Paris-Saclay University
    MERL Host: Kyeong Jin (K.J.) Kim
    Research Areas: Communications, Electronic and Photonic Devices, Signal Processing
    Abstract
    • A Reconfigurable Intelligent Surface (RIS) is a planar structure that is engineered to have properties that enable the dynamic control of the electromagnetic waves. In wireless communications and networks, RISs are an emerging technology for realizing programmable and reconfigurable wireless propagation environments through nearly passive and tunable signal transformations. RIS-assisted programmable wireless environments are a multidisciplinary research endeavor. This presentation is aimed to report the latest research advances on modeling, analyzing, and optimizing RISs for wireless communications with focus on electromagnetically consistent models, analytical frameworks, and optimization algorithms.
  •  
  •  NEWS    Keynote Speech by Dr. Rui Ma at EDICON2021
    Date: December 10, 2021
    Research Areas: Electronic and Photonic Devices, Machine Learning
    Brief
    • MERL's Researcher Dr. Rui Ma is the keynote speaker for Electronic Design Innovation CON (EDICON2021) to be held in Shenzhen, China from Dec. 9-10, with a talk titled "Digitization and intelligence: unlocking the innovation of future radios". The conference brings together international researchers from academics, industry, and media distribution to share perspectives on the technology needed and being developed for the next generation of communication.
  •  
  •  NEWS    Anthony Vetro elected to serve on Board of Governors of IEEE Signal Processing Society
    Date: November 4, 2021
    MERL Contact: Anthony Vetro
    Brief
    • Anthony Vetro has been elected as a Member-at-Large to serve on the Board of Governors of the IEEE Signal Processing Society (SPS). He will serve a three-year term from January 2022 until December 2024.

      The Board of Governors (BoG) is the governing body that oversees the activities of the IEEE Signal Processing Society. The SPS BoG has the responsibility of establishing and implementing policy, and receiving reports from its standing boards and committees. Members-at-Large represent the member view point in the Board decision-making. They typically review, discuss, and act upon a wide range of items affecting the actions, activities, and health of the Society.
  •  
  •  TALK    [MERL Seminar Series 2021] Dr. Hsiao-Yu (Fish) Tung presents talk at MERL entitled Learning to See by Moving: Self-supervising 3D scene representations for perception, control, and visual reasoning
    Date & Time: Tuesday, November 2, 2021; 1:00 PM EST
    Speaker: Dr. Hsiao-Yu (Fish) Tung, MIT BCS
    Research Areas: Artificial Intelligence, Computer Vision, Machine Learning, Robotics
    Abstract
    • Current state-of-the-art CNNs can localize and name objects in internet photos, yet, they miss the basic knowledge that a two-year-old toddler has possessed: objects persist over time despite changes in the observer’s viewpoint or during cross-object occlusions; objects have 3D extent; solid objects do not pass through each other. In this talk, I will introduce neural architectures that learn to parse video streams of a static scene into world-centric 3D feature maps by disentangling camera motion from scene appearance. I will show the proposed architectures learn object permanence, can imagine RGB views from novel viewpoints in truly novel scenes, can conduct basic spatial reasoning and planning, can infer affordability in sentences, and can learn geometry-aware 3D concepts that allow pose-aware object recognition to happen with weak/sparse labels. Our experiments suggest that the proposed architectures are essential for the models to generalize across objects and locations, and it overcomes many limitations of 2D CNNs. I will show how we can use the proposed 3D representations to build machine perception and physical understanding more close to humans.
  •  
  •  NEWS    Ankush Chakrabarty gave an invited talk at CRAN: Centre de Recherche en Automatique de Nancy, France
    Date: October 21, 2021
    Where: Université de Lorraine, France
    MERL Contact: Ankush Chakrabarty
    Research Areas: Artificial Intelligence, Control, Machine Learning, Multi-Physical Modeling, Optimization
    Brief
    • Ankush Chakrabarty (RS, Multiphysical Systems Team) gave an invited talk on `Bayesian-Optimized Estimation and Control for Buildings and HVAC' at the Research Center for Automatic Control (CRAN) in the University of Lorraine in France. The talk presented recent MERL research on probabilistic machine learning for set-point optimization and calibration of digital twins for building energy systems.
  •