Computational Sensing

Utilizing computation to improve sensing capabilities.

Our research in the area of computational sensing focuses on signal acquisition and design, signal modeling and reconstruction algorithms, including inverse problems, as well as array signal processing techniques.

  • Researchers

  • Awards

    •  AWARD    Joshua Rapp wins Best Dissertation Award from the IEEE Signal Processing Society
      Date: December 20, 2021
      Awarded to: Joshua Rapp
      MERL Contact: Joshua Rapp
      Research Areas: Computational Sensing, Signal Processing
      Brief
      • Joshua Rapp has won the 2021 Best PhD Dissertation Award from the IEEE Signal Processing Society.
        The award recognizes a PhD thesis completed on a signal processing subject within the past three years for its relevant work in signal processing while stimulating further research in the field.

        Dr. Rapp completed his PhD at Boston University in 2020 with a thesis entitled "Probabilistic Modeling for Single-Photon Lidar." The dissertation tackles challenges of the acquisition and processing of 3D depth maps reconstructed from time-of-flight data captured one photon at a time.
        The award will be presented at the 2022 IEEE International Conference on Image Processing (ICIP) in France.
    •  
    •  AWARD    Petros Boufounos Elevated to IEEE Fellow
      Date: January 1, 2022
      Awarded to: Petros T. Boufounos
      MERL Contact: Petros T. Boufounos
      Research Areas: Computational Sensing, Signal Processing
      Brief
      • MERL’s Petros Boufounos has been elevated to IEEE Fellow, effective January 2022, for “contributions to compressed sensing.”

        IEEE Fellow is the highest grade of membership of the IEEE. It honors members with an outstanding record of technical achievements, contributing importantly to the advancement or application of engineering, science and technology, and bringing significant value to society. Each year, following a rigorous evaluation procedure, the IEEE Fellow Committee recommends a select group of recipients for elevation to IEEE Fellow. Less than 0.1% of voting members are selected annually for this member grade elevation.
    •  
    •  AWARD    Best Paper - Honorable Mention Award at WACV 2021
      Date: January 6, 2021
      Awarded to: Rushil Anirudh, Suhas Lohit, Pavan Turaga
      MERL Contact: Suhas Lohit
      Research Areas: Computational Sensing, Computer Vision, Machine Learning
      Brief
      • A team of researchers from Mitsubishi Electric Research Laboratories (MERL), Lawrence Livermore National Laboratory (LLNL) and Arizona State University (ASU) received the Best Paper Honorable Mention Award at WACV 2021 for their paper "Generative Patch Priors for Practical Compressive Image Recovery".

        The paper proposes a novel model of natural images as a composition of small patches which are obtained from a deep generative network. This is unlike prior approaches where the networks attempt to model image-level distributions and are unable to generalize outside training distributions. The key idea in this paper is that learning patch-level statistics is far easier. As the authors demonstrate, this model can then be used to efficiently solve challenging inverse problems in imaging such as compressive image recovery and inpainting even from very few measurements for diverse natural scenes.
    •  

    See All Awards for Computational Sensing
  • News & Events


    See All News & Events for Computational Sensing
  • Research Highlights

  • Internships

    • DA1899: Physics-informed scientific machine learning

      The Data Analytics Group at MERL is seeking a highly motivated, qualified individual to join our internship program in the summer of 2023. The ideal candidate will be a Ph.D. student specializing in engineering, applied mathematics, computer science or similar fields with solid background in scientific machine learning, deep learning, and non-convex optimization. Research exposure to one of the following is very desirable but not necessary: PDE-constrained optimization, Koopman theory, dynamical systems, operator learning (DeepONet, FNO, etc.), and Physics-informed Neural Nets (PINNs). Ideal candidate is familiar with PyTorch, TensorFlow, or Jax. Publication of results obtained during the internship is expected. The starting date is flexible and the internship will last about 12 weeks.

    • ST1750: THz (Terahertz) Sensing

      The Signal Processing (SP) group at MERL is seeking a highly motivated intern to conduct fundamental research in THz (Terahertz) sensing. Expertise in statistical inference, unsupervised anomaly detection, and deep learning (spatial-temporal representation learning) is required. Previous hands-on experience in THz data analysis is a plus. Familiarity with python and deep learning libraries is a must. The intern will collaborate with a small group of MERL researchers to develop novel algorithms, design experiments with collaborators, and prepare results for patents and publication. The expected duration of the internship is 3 months with a flexible start date.

    • ST1863: Radar Perception Testbed Engineering (Undergraduate/Master Students)

      MERL is seeking an undergraduate or master student engineering intern to use MERL''s millimeter radar hardware testbed for experiments and data collection, and to maintain the data preprocessing pipeline from raw data acquisition, data organization, annotation, sanitization, and document preparation. Scripting in Python/MATLAB is required. Previous experience with radio frequency (RF) testbed/evaluation kits is preferred. The duration is from September to December with a flexible start date and a part-time option.


    See All Internships for Computational Sensing
  • Recent Publications

    •  Shimoya, R., Morimoto, T., van Baar, J., Boufounos, P.T., Ma, Y., Mansour, H., "Learning Occlusion-Aware Dense Correspondences for Multi-Modal Images", IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), November 2022.
      BibTeX TR2022-149 PDF
      • @inproceedings{Shimoya2022nov,
      • author = {Shimoya, Ryosuke and Morimoto, Tahashi and van Baar, Jeroen and Boufounos, Petros T. and Ma, Yanting and Mansour, Hassan},
      • title = {Learning Occlusion-Aware Dense Correspondences for Multi-Modal Images},
      • booktitle = {IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS)},
      • year = 2022,
      • month = nov,
      • url = {https://www.merl.com/publications/TR2022-149}
      • }
    •  Mansour, H., Lohit, S., Boufounos, P.T., "Distributed Radar Autofocus Imaging Using Deep Priors", IEEE International Conference on Image Processing (ICIP), October 2022.
      BibTeX TR2022-129 PDF Video
      • @inproceedings{Mansour2022oct,
      • author = {Mansour, Hassan and Lohit, Suhas and Boufounos, Petros T.},
      • title = {Distributed Radar Autofocus Imaging Using Deep Priors},
      • booktitle = {IEEE International Conference on Image Processing (ICIP)},
      • year = 2022,
      • month = oct,
      • url = {https://www.merl.com/publications/TR2022-129}
      • }
    •  Zheng, X., Liu, D., Inoue, H., Kanemaru, M., "Eccentricity Severity Estimation of Induction Machines using a Sparsity-Driven Regression Model", The Fourteenth Annual Energy Conversion Congress and Exposition, October 2022.
      BibTeX TR2022-126 PDF
      • @inproceedings{Zheng2022oct,
      • author = {Zheng, Xiangtian and Liu, Dehong and Inoue, Hiroshi and Kanemaru, Makoto},
      • title = {Eccentricity Severity Estimation of Induction Machines using a Sparsity-Driven Regression Model},
      • booktitle = {The Fourteenth Annual Energy Conversion Congress and Exposition},
      • year = 2022,
      • month = oct,
      • url = {https://www.merl.com/publications/TR2022-126}
      • }
    •  Wang, S., Guo, J., Wang, P., Parsons, K., Orlik, P.V., Nagai, Y., Sumi, T., Pathak, P., ,, "X-Disco: Cross-technology Neighbor Discovery", IEEE International Conference on Sensing, Communication, and Networking, September 2022.
      BibTeX TR2022-119 PDF
      • @inproceedings{Wang2022sep2,
      • author = {Wang, Shuai and Guo, Jianlin and Wang, Pu and Parsons, Kieran and Orlik, Philip V. and Nagai, Yukimasa and Sumi, Takenori and Pathak, Parth and},
      • title = {X-Disco: Cross-technology Neighbor Discovery},
      • booktitle = {IEEE International Conference on Sensing, Communication, and Networking},
      • year = 2022,
      • month = sep,
      • url = {https://www.merl.com/publications/TR2022-119}
      • }
    •  Rapp, J., Mansour, H., Boufounos, P.T., Orlik, P.V., Koike-Akino, T., Parsons, K., "Maximum Likelihood Surface Profilometry via Optical Coherence Tomography", IEEE International Conference on Image Processing (ICIP), DOI: 10.1109/​ICIP46576.2022.9897247, September 2022, pp. 1561-1565.
      BibTeX TR2022-117 PDF
      • @inproceedings{Rapp2022sep,
      • author = {Rapp, Joshua and Mansour, Hassan and Boufounos, Petros T. and Orlik, Philip V. and Koike-Akino, Toshiaki and Parsons, Kieran},
      • title = {Maximum Likelihood Surface Profilometry via Optical Coherence Tomography},
      • booktitle = {IEEE International Conference on Image Processing (ICIP)},
      • year = 2022,
      • pages = {1561--1565},
      • month = sep,
      • doi = {10.1109/ICIP46576.2022.9897247},
      • issn = {978-1-6654-9620-9},
      • isbn = {2381-8549},
      • url = {https://www.merl.com/publications/TR2022-117}
      • }
    •  Mansour, H., Boufounos, P.T., "Temporal Super-resolution for Wire Position Estimation in Electric Discharge Machines," Tech. Rep. TR2022-124, Mitsubishi Electric Research Laboratories, September 2022.
      BibTeX TR2022-124 PDF
      • @techreport{Mansour2022sep,
      • author = {Mansour, Hassan and Boufounos, Petros T.},
      • title = {Temporal Super-resolution for Wire Position Estimation in Electric Discharge Machines},
      • institution = {MERL website},
      • year = 2022,
      • month = sep,
      • url = {https://www.merl.com/publications/TR2022-124}
      • }
    •  Xia, H., Wang, P., Koike-Akino, T., Wang, Y., Orlik, P.V., Ding, Z., "Adversarial Bi-Regressor Network for Domain Adaptive Regression", International Joint Conference on Artificial Intelligence (IJCAI), Lud De Raedt, Eds., DOI: 10.24963/​ijcai.2022/​501, July 2022, pp. 3608-3614.
      BibTeX TR2022-103 PDF
      • @inproceedings{Xia2022jul,
      • author = {Xia, Haifeng and Wang, Pu and Koike-Akino, Toshiaki and Wang, Ye and Orlik, Philip V. and Ding, Zhengming},
      • title = {Adversarial Bi-Regressor Network for Domain Adaptive Regression},
      • booktitle = {International Joint Conference on Artificial Intelligence (IJCAI)},
      • year = 2022,
      • editor = {Lud De Raedt},
      • pages = {3608--3614},
      • month = jul,
      • publisher = {IJCAI},
      • doi = {10.24963/ijcai.2022/501},
      • url = {https://www.merl.com/publications/TR2022-103}
      • }
    •  Jin, S., Pu, W., Boufounos, P.T., Orlik, P.V., Takahashi, R., Roy, S., "Spatial-Domain Mutual Interference Mitigation for Slow-Time MIMO-FMCW Automotive Radar", IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM), DOI: 10.1109/​SAM53842.2022.9827852, June 2022.
      BibTeX TR2022-067 PDF
      • @inproceedings{Jin2022jun,
      • author = {Jin, Sian and Pu, Wang and Boufounos, Petros T. and Orlik, Philip V. and Takahashi, Ryuhei and Roy, Sumit},
      • title = {Spatial-Domain Mutual Interference Mitigation for Slow-Time MIMO-FMCW Automotive Radar},
      • booktitle = {IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM)},
      • year = 2022,
      • month = jun,
      • doi = {10.1109/SAM53842.2022.9827852},
      • issn = {2151-870X},
      • isbn = {978-1-6654-0633-8},
      • url = {https://www.merl.com/publications/TR2022-067}
      • }
    See All Publications for Computational Sensing
  • Videos

  • Software Downloads