Artificial Intelligence

Making machines smarter for improved safety, efficiency and comfort.

Our AI research encompasses advances in computer vision, speech and audio processing, as well as data analytics. Key research themes include improved perception based on machine learning techniques, learning control policies through model-based reinforcement learning, as well as cognition and reasoning based on learned semantic representations. We apply our work to a broad range of automotive and robotics applications, as well as building and home systems.

Quick Links
Researchers
Awards
- AWARD MERL Wins Awards at NeurIPS LLM Privacy Challenge
  Date: December 15, 2024
  Awarded to: Jing Liu, Ye Wang, Toshiaki Koike-Akino, Tsunato Nakai, Kento Oonishi, Takuya Higashi
  MERL Contacts: Toshiaki Koike-Akino; Jing Liu; Ye Wang
  Research Areas: Artificial Intelligence, Machine Learning, Information Security
  Brief
  - The Mitsubishi Electric Privacy Enhancing Technologies (MEL-PETs) team, consisting of a collaboration of MERL and Mitsubishi Electric researchers, won awards at the NeurIPS 2024 Large Language Model (LLM) Privacy Challenge. In the Blue Team track of the challenge, we won the 3rd Place Award, and in the Red Team track, we won the Special Award for Practical Attack.
- AWARD University of Padua and MERL team wins the AI Olympics with RealAIGym competition at IROS24
  Date: October 17, 2024
  Awarded to: Niccolò Turcato, Alberto Dalla Libera, Giulio Giacomuzzo, Ruggero Carli, Diego Romeres
  MERL Contact: Diego Romeres
  Research Areas: Artificial Intelligence, Dynamical Systems, Machine Learning, Robotics
  Brief
  - The team composed of the control group at the University of Padua and MERL's Optimization and Robotic team ranked 1st out of the 4 finalist teams that arrived to the 2nd AI Olympics with RealAIGym competition at IROS 24, which focused on control of under-actuated robots. The team was composed by Niccolò Turcato, Alberto Dalla Libera, Giulio Giacomuzzo, Ruggero Carli and Diego Romeres. The competition was organized by the German Research Center for Artificial Intelligence (DFKI), Technical University of Darmstadt and Chalmers University of Technology.
    
    The competition and award ceremony was hosted by IEEE International Conference on Intelligent Robots and Systems (IROS) on October 17, 2024 in Abu Dhabi, UAE. Diego Romeres presented the team's method, based on a model-based reinforcement learning algorithm called MC-PILCO.
- AWARD MERL team wins the Listener Acoustic Personalisation (LAP) 2024 Challenge
  Date: August 29, 2024
  Awarded to: Yoshiki Masuyama, Gordon Wichern, Francois G. Germain, Christopher Ick, and Jonathan Le Roux
  MERL Contacts: Jonathan Le Roux; Gordon Wichern; Yoshiki Masuyama
  Research Areas: Artificial Intelligence, Machine Learning, Speech & Audio
  Brief
  - MERL's Speech & Audio team ranked 1st out of 7 teams in Task 2 of the 1st SONICOM Listener Acoustic Personalisation (LAP) Challenge, which focused on "Spatial upsampling for obtaining a high-spatial-resolution HRTF from a very low number of directions". The team was led by Yoshiki Masuyama, and also included Gordon Wichern, Francois Germain, MERL intern Christopher Ick, and Jonathan Le Roux.
    
    The LAP Challenge workshop and award ceremony was hosted by the 32nd European Signal Processing Conference (EUSIPCO 24) on August 29, 2024 in Lyon, France. Yoshiki Masuyama presented the team's method, "Retrieval-Augmented Neural Field for HRTF Upsampling and Personalization", and received the award from Prof. Michele Geronazzo (University of Padova, IT, and Imperial College London, UK), Chair of the Challenge's Organizing Committee.
    
    The LAP challenge aims to explore challenges in the field of personalized spatial audio, with the first edition focusing on the spatial upsampling and interpolation of head-related transfer functions (HRTFs). HRTFs with dense spatial grids are required for immersive audio experiences, but their recording is time-consuming. Although HRTF spatial upsampling has recently shown remarkable progress with approaches involving neural fields, HRTF estimation accuracy remains limited when upsampling from only a few measured directions, e.g., 3 or 5 measurements. The MERL team tackled this problem by proposing a retrieval-augmented neural field (RANF). RANF retrieves a subject whose HRTFs are close to those of the target subject at the measured directions from a library of subjects. The HRTF of the retrieved subject at the target direction is fed into the neural field in addition to the desired sound source direction. The team also developed a neural network architecture that can handle an arbitrary number of retrieved subjects, inspired by a multi-channel processing technique called transform-average-concatenate.
See All Awards for Artificial Intelligence
News & Events
- NEWS Diego Romeres Delivers Invited Talks at Fraunhofer Italia and the University of Padua
  Date: July 16, 2025 - July 18, 2025
  MERL Contact: Diego Romeres
  Research Areas: Artificial Intelligence, Control, Machine Learning, Optimization, Robotics, Human-Computer Interaction
  Brief
  - MERL researcher Diego Romeres was invited to present MERL's latest research at two institutions in Italy this July, focusing on human-robot collaboration and LLM-driven assembly systems.
    
    On July 16th, Dr. Romeres delivered a talk titled “Human-Robot Collaborative Assembly” at Fraunhofer Italia – Innovation Engineering Center (EIC) in Bolzano. His presentation showcased research on human-robot collaboration for efficient and flexible assembly processes. Fraunhofer Italia EIC is a non-profit research institute focused on enabling digital and sustainable transformation through applied innovation in close collaboration with both public and private sectors.
    
    Two days later, on July 18th, Dr. Romeres was hosted by the University of Padua, one of Europe’s oldest and most renowned universities. His invited lecture, “Robot Assembly through Human Collaboration & Large Language Models”, explored how artificial intelligence can enhance human-robot synergy in complex assembly tasks.
- NEWS Toshiaki Koike-Akino to give a tutorial talk at ISIT 2025 Quantum Hackathon
  Date: June 22, 2025
  Where: IEEE International Symposium on Information Theory (ISIT)
  MERL Contact: Toshiaki Koike-Akino
  Research Areas: Artificial Intelligence, Communications, Data Analytics, Machine Learning, Optimization, Signal Processing, Human-Computer Interaction, Information Security
  Brief
  - Toshiaki Koike-Akino is invited to present a tutorial talk at IEEE ISIT 2025 Quantum Hackathon, to be held at Ann Arbor, Michigan, USA. The talk, entitled "Emerging Quantum AI Technology", will discuss the recent trends, challenges, and applications of quantum artificial intelligence (QAI) technologies.
    
    The ISIT 2025 Quantum Hackathon invites participants to explore the intersection of quantum computing and information theory. Participants will work with quantum simulators, available quantum hardware, and state-of-the-art development kits to create innovative solutions that connect quantum advancements with challenges in communication and signal processing.
    
    The IEEE International Symposium on Information Theory (ISIT) is the flagship conference of the IEEE Information Theory Society. The symposium centers around the presentation in all of the areas of information theory, including source and channel coding, communication theory and systems, cryptography and security, detection and estimation, networks, pattern recognition and learning, statistics, stochastic processes and complexity, and signal processing.
See All News & Events for Artificial Intelligence
Research Highlights
Internships
- CA0165: Internship - Optimization of Aerial Robot Coordination
  
  MERL is seeking a self-motivated and qualified individual to work on developing an integer/mixed-integer programming solver customarily designed for coordination planning of aerial drones. The ideal candidate will be a PhD student in computer science, mathematics, industrial engineering, or a related discipline, with a solid background in integer optimization. Preferred skills include knowledge of branch-price-and-cut algorithm or column generation, and hands-on experience with callbacks of the Gurobi Optimizer; strong programming skills and experience with at least one of Python, Julia, C/C++, Matlab are also expected. Publication of results produced during the internship is desired. The expected start date is in Fall 2025 or Spring 2026, for a duration of 3- months.
  Required Specific Experience
  - Significant hands-on experience with integer optimization.
    - Experience with trajectory optimization is a plus.
  - Fluency in at least one of: Python, Julia, C/C++, Matlab
  - Completed their MS, or >30% of their PhD program
- EA0183: Internship - machine learning for predictive maintenance
  
  Mitsubishi Electric Research Laboratories (MERL) is seeking a self-motivated Ph.D. candidate in Computer Science, Electrical Engineering, or a related field for a 3 month internship focused on developing advanced machine learning algorithms for electric machine condition monitoring and predictive maintenance. The ideal candidate will have a strong background in machine learning and signal processing with a proven publication record, while experience in multi-modal data analysis or domain adaptation is preferred and knowledge of electric machines is a plus. The intern will collaborate with MERL researchers to design and develop novel machine learning algorithms, prepare technical reports, and contribute to manuscripts for top-tier scientific publications. This position requires onsite work at MERL, with a flexible start date.
  Required Specific Experience
  - Experience with Python and Matlab.
- EA0076: Internship - Machine Learning for Electric Motor Design
  
  MERL is seeking a motivated and qualified intern to conduct research on machine learning based electric motor design and optimization. Ideal candidates should be Ph.D. students with a solid background and publication record in electric machine design, optimization, and machine learning. Hands-on experience with the implementation of optimization algorithms, machine learning and deep learning methods is required. Strong programming skills using Python/PyTorch are expected. Knowledge and experience with electric machine principle, design and finite-element analysis are highly desirable. Start date for this internship is flexible and the duration is about 3 months.
See All Internships for Artificial Intelligence
Openings
- CI0177: Postdoctoral Research Fellow - Agentic AI
See All Openings at MERL
Recent Publications
- Yang, C.-A., Peng, K.-C., Yeh, R., "Toward Long-Tailed Online Anomaly Detection through Class-Agnostic Concepts", IEEE International Conference on Computer Vision (ICCV), October 2025.
  BibTeX TR2025-124 PDF Data Presentation
  - @inproceedings{Yang2025oct,
  - author = {{{Yang, Chiao-An and Peng, Kuan-Chuan and Yeh, Raymond}}},
  - title = {{{Toward Long-Tailed Online Anomaly Detection through Class-Agnostic Concepts}}},
  - booktitle = {IEEE International Conference on Computer Vision (ICCV)},
  - year = 2025,
  - month = oct,
  - url = {https://www.merl.com/publications/TR2025-124}
  - }
- Liu, J., Koike-Akino, T., Wang, P., Brand, M., Parsons, K., Wang, Y., "LoDA: Low-Dimensional Adaptation of Large Language Models" in Springer Book, September 2025.
  BibTeX TR2025-130 PDF
  - @incollection{Liu2025sep,
  - author = {Liu, Jing and Koike-Akino, Toshiaki and Wang, Pu and Brand, Matthew and Parsons, Kieran and Wang, Ye},
  - title = {{LoDA: Low-Dimensional Adaptation of Large Language Models}},
  - booktitle = {Springer Book},
  - year = 2025,
  - month = sep,
  - url = {https://www.merl.com/publications/TR2025-130}
  - }
- Hussein, A., Khurana, S., Wichern, G., Germain, F.G., Le Roux, J., "HASRD: Hierarchical Acoustic and Semantic Representation Disentanglement", Interspeech, August 2025.
  BibTeX TR2025-122 PDF
  - @inproceedings{Hussein2025aug,
  - author = {Hussein, Amir and Khurana, Sameer and Wichern, Gordon and Germain, François G and {Le Roux}, Jonathan},
  - title = {{HASRD: Hierarchical Acoustic and Semantic Representation Disentanglement}},
  - booktitle = {Interspeech},
  - year = 2025,
  - month = aug,
  - url = {https://www.merl.com/publications/TR2025-122}
  - }
- Ick, C., Wichern, G., Masuyama, Y., Germain, F.G., Le Roux, J., "Direction-Aware Neural Acoustic Fields for Few-Shot Interpolation of Ambisonic Impulse Responses", Interspeech, DOI: 10.21437/Interspeech.2025-1912, August 2025, pp. 933-937.
  BibTeX TR2025-120 PDF
  - @inproceedings{Ick2025aug,
  - author = {Ick, Christopher and Wichern, Gordon and Masuyama, Yoshiki and Germain, François G and {Le Roux}, Jonathan},
  - title = {{Direction-Aware Neural Acoustic Fields for Few-Shot Interpolation of Ambisonic Impulse Responses}},
  - booktitle = {Interspeech},
  - year = 2025,
  - pages = {933--937},
  - month = aug,
  - doi = {10.21437/Interspeech.2025-1912},
  - url = {https://www.merl.com/publications/TR2025-120}
  - }
- Khurana, S., Klement, D., Laurent, A., Bobos, D., Novosad, J., Gazdik, P., Zhang, E., Huang, Z., Hussein, A., Marxer, R., Masuyama, Y., Aihara, R., Hori, C., Germain, F.G., Wichern, G., Le Roux, J., "Factorized RVQ-GAN For Disentangled Speech Tokenization", Interspeech, August 2025.
  BibTeX TR2025-123 PDF
  - @inproceedings{Khurana2025aug,
  - author = {Khurana, Sameer and Klement, Dominik and Laurent, Antoine and Bobos, Dominik and Novosad, Juraj and Gazdik, Peter and Zhang, Ellen and Huang, Zilli and Hussein, Amir and Marxer, Ricard and Masuyama, Yoshiki and Aihara, Ryo and Hori, Chiori and Germain, François G and Wichern, Gordon and {Le Roux}, Jonathan},
  - title = {{Factorized RVQ-GAN For Disentangled Speech Tokenization}},
  - booktitle = {Interspeech},
  - year = 2025,
  - month = aug,
  - url = {https://www.merl.com/publications/TR2025-123}
  - }
- Yang, H., Wichern, G., Aihara, R., Masuyama, Y., Khurana, S., Germain, F.G., Le Roux, J., "Investigating Continuous Autoregressive Generative Speech Enhancement", Interspeech, August 2025.
  BibTeX TR2025-119 PDF
  - @inproceedings{Yang2025aug,
  - author = {Yang, Haici and Wichern, Gordon and Aihara, Ryo and Masuyama, Yoshiki and Khurana, Sameer and Germain, François G and {Le Roux}, Jonathan},
  - title = {{Investigating Continuous Autoregressive Generative Speech Enhancement}},
  - booktitle = {Interspeech},
  - year = 2025,
  - month = aug,
  - url = {https://www.merl.com/publications/TR2025-119}
  - }
- Steinmetz, C., Uhle, C., Everardo, F., Mitcheltree, C., McElveen, J.K., Jot, J.-M., Wichern, G., "Audio Signal Processing in the Artificial Intelligence Era: Challenges and Directions", Journal of the Audio Engineering Society, August 2025.
  BibTeX TR2025-116 PDF
  - @article{Steinmetz2025aug,
  - author = {Steinmetz, Christian and Uhle, Christian and Everardo, Flavio and Mitcheltree, Christopher and McElveen, J. Keith and Jot, Jean-Marc and Wichern, Gordon},
  - title = {{Audio Signal Processing in the Artificial Intelligence Era: Challenges and Directions}},
  - journal = {Journal of the Audio Engineering Society},
  - year = 2025,
  - month = aug,
  - url = {https://www.merl.com/publications/TR2025-116}
  - }
- Lewis, A., White, M., Liu, J., Koike-Akino, T., Parsons, K., Wang, Y., "Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in Product QA Agents", ACL 2025 workshop on Generation, Evaluation & Metrics (GEM), July 2025.
  BibTeX TR2025-114 PDF
  - @inproceedings{Lewis2025jul2,
  - author = {Lewis, Ashley and White, Michael and Liu, Jing and Koike-Akino, Toshiaki and Parsons, Kieran and Wang, Ye},
  - title = {{Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in Product QA Agents}},
  - booktitle = {ACL 2025 workshop on Generation, Evaluation \& Metrics (GEM)},
  - year = 2025,
  - month = jul,
  - url = {https://www.merl.com/publications/TR2025-114}
  - }
See All Publications for Artificial Intelligence
Videos

In-Context Iterative Policy Improvement for Dynamic Manipulation

[CVPR 2025] TailedCore: Few-Shot Sampling for Unsupervised Long-Tail Noisy Anomaly Detection

[MERL Seminar Series Spring 2025] Red Teaming AI Agents in-the-wild: Revealing Deployment Vulnerabilities

[MERL Seminar Series Spring 2025] The Emergence of Generalizability and Semantic Low-Dim Subspaces in Diffusion Models

[MERL Seminar Series Spring 2025] Amplifying human performance in combinatorial competitive programming

[WACV 2025] Towards Zero-shot 3D Anomaly Localization

[NeurIPS 2024] MEL-PETs Defense for the NeurIPS 2024 LLM Privacy Challenge Blue Team Track

[NeurIPS 2024] MEL-PETs Joint-Context Attack for the NeurIPS 2024 LLM Privacy Challenge Red Team Track

[MERL Seminar Series Fall 2024] AI-assisted Power Grid Dispatch and Control: Optimization, Safety, and Real-world Demonstrations

[NeurIPS 2024] Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads

[MERL Seminar Series Fall 2024] Audio for Object and Spatial Awareness

[IROS 2024] Few-shot Transparent Instance Segmentation for Bin Picking

[MERL Seminar Series Fall 2024] Tools from cognitive science to understand the behavior of large language models

[ECCV 2024] PS-NEUS: A Probability-guided Sampler for Neural Implicit Surface Rendering

[ECCV 2024] Equivariant Spatio-Temporal Self-Supervision for LiDAR Object Detection

Gear-NeRF: Free-Viewpoint Rendering and Tracking with Motion-aware Spatio-Temporal Sampling

[MERL Seminar Series Spring 2024] Are Emergent Abilities of Large Language Models a Mirage?

MERL's Quantum AI Technology

[MERL Seminar Series Spring 2024] The Debate Over 'Understanding' in AI's Large Language Models

[MERL Seminar Series Spring 2024] Computational models of human auditory and language processing

[MERL Seminar Series Fall 2023] Multiplicity in Machine Learning

Multi-level Reasoning for Robotic Assembly: From Sequence Inference to Contact Selection

[MERL Seminar Series Fall 2023] Visual Programming - A compositional approach to building General Purpose Vision Systems

[MERL Seminar Series Fall 2023] The Confluence of Vision, Language, and Robotics

Are Deep Neural Networks SMARTer than Second Graders?

[MERL Seminar Series Spring 2023] Fine-grained wildlife sound recognition: Towards the accuracy of a naturalist

[MERL Seminar Series Spring 2023] Pitfalls and Opportunities in Interpretable Machine Learning

Human Perspective Scene Understanding via Multimodal Sensing

[MERL Seminar Series Spring 2022] Self-Supervised Scene Representation Learning

[MERL Seminar Series Spring 2022] Learning Speech Representations with Multimodal Self-Supervision

[MERL Seminar Series 2021] Deep probabilistic regression

[MERL Seminar Series 2021] Learning to See by Moving: Self-supervising 3D scene representations for perception, control, and visual reasoning

[MERL Seminar Series 2021] Look and Listen: From Semantic to Spatial Audio-Visual Perception

Application of Deep Learning for Nanophotonic Device Design (Invited)

Machine Learning Power Amplifier

Scene-Aware Interaction Technology
Software & Data Downloads

Software & Data Downloads

MERL is making Artificial Intelligence software and data available to the research community:

Subject- and Dataset-Aware Neural Field for HRTF Modeling (SuDaField)
Open Vocabulary Attribute Detection Dataset (OVAD)
Task-Aware Unified Source Separation (TUSS)
Local Density-Based Anomaly Score Normalization for Domain Generalization (anomaly-score-normalization)
Long-Tailed Online Anomaly Detection dataset (LTOAD)
Group Representation Networks (G-RepsNets)

See All Downloads