Tim Marks

Tim Marks
  • Biography

    Prior to joining MERL's Imaging Group in 2008, Tim did postdoctoral research in robotic Simultaneous Localization and Mapping in collaboration with NASA's Jet Propulsion Laboratory. His research at MERL spans a variety of areas in computer vision and machine learning, including face recognition under variations in pose and lighting, and robotic vision and touch-based registration for industrial automation.

  • News & Events


    See All News & Events for Tim
  • Research Highlights

  • Internships with Tim

    • CV1302: Health Monitoring from Video

      MERL is seeking a highly motivated intern to conduct original research in the area of monitoring a person's vital signs (e.g., heart rate and heart rate variability) from video. The successful candidate will collaborate with MERL researchers to derive and implement new models, collect data, conduct experiments, and prepare results for publication. The ideal candidate would be a senior PhD student in computer vision with experience in face alignment and tracking, signal processing, machine learning, and health monitoring. Strong programming skills (C/C++, Python, Matlab, etc.) are expected.

    • CV1303: Generative Adversarial Networks (GANs)

      Generative adversarial networks (GANs) and related methods have generated much excitement for their ability to synthesize images and data that appear remarkably realistic. MERL is seeking a highly motivated intern to conduct original research in the area of generative adversarial networks. The successful candidate will collaborate with MERL researchers to design and implement new models, conduct experiments, and prepare results for publication. The ideal candidate would be a senior PhD student in computer vision with experience in GANs and related deep learning methods, as well as strong general knowledge in machine learning. Strong programming skills in Python, flexibility working across various deep learning platforms (e.g., TensorFlow and PyTorch), and previous experience coding GANs are expected.

    • CV1304: Uncertainty Estimation for Deep Network Predictions

      While deep networks have been highly successful at visual regression problems such as face landmark estimation and skeleton tracking, relatively little work has been done on estimating their prediction error. We are seeking a highly motivated intern to conduct original research in the area of uncertainty estimation for deep network predictions. The successful candidate will collaborate with MERL researchers to design and implement new models, conduct experiments, and prepare results for publication. The ideal candidate would be a senior PhD student in computer vision and machine learning with a strong publication record and experience in deep learning-based facial or body landmark estimation and tracking. Strong programming skills, experience developing and implementing new models in deep learning platforms such as PyTorch and TensorFlow, and broad knowledge of machine learning and deep learning methods are expected.

    See All Internships at MERL
  • MERL Publications

    •  Hori, C., Alamri, H., Wang, J., Wichern, G., Hori, T., Cherian, A., Marks, T.K., Cartillier, V., Lopes, R., Das, A., Essa, I., Batra, D., Parikh, D., "End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features", arXiv, July 13, 2018.
      BibTeX Download PDFAbout TR2018-085
      • @techreport{MERL_TR2018-085,
      • author = {Hori, C. and Alamri, H. and Wang, J. and Wichern, G. and Hori, T. and Cherian, A. and Marks, T.K. and Cartillier, V. and Lopes, R. and Das, A. and Essa, I. and Batra, D. and Parikh, D.},
      • title = {End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features},
      • institution = {MERL - Mitsubishi Electric Research Laboratories},
      • address = {Cambridge, MA 02139},
      • number = {TR2018-085},
      • month = jul,
      • year = 2018,
      • url = {http://www.merl.com/publications/TR2018-085/}
      • }
    •  Alamri, H., Cartillier, V., Lopes, R., Das, A., Wang, J., Essa, I., Batra, D., Parikh, D., Cherian, A., Marks, T.K., Hori, C., "Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7", arXiv, July 12, 2018.
      BibTeX Download PDFAbout TR2018-069
      • @techreport{MERL_TR2018-069,
      • author = {Alamri, H. and Cartillier, V. and Lopes, R. and Das, A. and Wang, J. and Essa, I. and Batra, D. and Parikh, D. and Cherian, A. and Marks, T.K. and Hori, C.},
      • title = {Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7},
      • institution = {MERL - Mitsubishi Electric Research Laboratories},
      • address = {Cambridge, MA 02139},
      • number = {TR2018-069},
      • month = jul,
      • year = 2018,
      • url = {http://www.merl.com/publications/TR2018-069/}
      • }
    •  Nowara, E., Marks, T.K., Mansour, H., Nakamura, Y., Veeraraghavan, A., "SparsePPG: Towards Driver Monitoring Using Camera-Based Vital Signs Estimation in Near-Infrared", CVPR workshop: CVPM 2018. [IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop on Computer Vision for Physiological Measurement (CVPM), July 11, 2018, pp. 1272-1281.
    •  Hori, C., Hori, T., Marks, T.K., Hershey, J.R., "Early and Late Integration of Audio Features for Automatic Video Description", IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), DOI: 10.1109/ASRU.2017.8268968, December 2017.
    •  Lin, C., Marks, T.K., Pajovic, M., Watanabe, S., Tung, C., "Model parameter learning using Kullback-Leibler divergence", Physica A, DOI: 10.1016/j.physa.2017.09.018, Vol. 491, No. 1, pp. 549-559, November 2017.
    See All Publications for Tim
  • Other Publications

    •  Marks, Tim K; Howard, Andrew; Bajracharya, Max; Cottrell, Garrison W; Matthies, Larry H, "Gamma-SLAM: Visual SLAM in unstructured environments using variance grid maps", Journal of Field Robotics, Vol. 26, No. 1, pp. 26-51, 2009.
      BibTeX
      • @Article{marks2009gamma,
      • author = {Marks, Tim K and Howard, Andrew and Bajracharya, Max and Cottrell, Garrison W and Matthies, Larry H},
      • title = {Gamma-SLAM: Visual SLAM in unstructured environments using variance grid maps},
      • journal = {Journal of Field Robotics},
      • year = 2009,
      • volume = 26,
      • number = 1,
      • pages = {26--51},
      • publisher = {Wiley Online Library}
      • }
    •  Barrington, Luke; Marks, Tim K; Hsiao, Janet Hui-wen; Cottrell, Garrison W, "NIMBLE: A kernel density model of saccade-based visual memory", Journal of Vision, Vol. 8, No. 14, 2008.
      BibTeX
      • @Article{barrington2008nimble,
      • author = {Barrington, Luke and Marks, Tim K and Hsiao, Janet Hui-wen and Cottrell, Garrison W},
      • title = {NIMBLE: A kernel density model of saccade-based visual memory},
      • journal = {Journal of Vision},
      • year = 2008,
      • volume = 8,
      • number = 14,
      • publisher = {Association for Research in Vision and Ophthalmology}
      • }
    •  Marks, Tim K; Howard, Andrew; Bajracharya, Max; Cottrell, Garrison W; Matthies, Larry, "Gamma-SLAM: Using stereo vision and variance grid maps for SLAM in unstructured environments", Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, 2008, pp. 3717-3724.
      BibTeX
      • @Inproceedings{marks2008gamma,
      • author = {Marks, Tim K and Howard, Andrew and Bajracharya, Max and Cottrell, Garrison W and Matthies, Larry},
      • title = {Gamma-SLAM: Using stereo vision and variance grid maps for SLAM in unstructured environments},
      • booktitle = {Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on},
      • year = 2008,
      • pages = {3717--3724},
      • organization = {IEEE}
      • }
    •  Zhang, Lingyun; Tong, Matthew H; Marks, Tim K; Shan, Honghao; Cottrell, Garrison W, "SUN: A Bayesian framework for saliency using natural statistics", Journal of Vision, Vol. 8, No. 7, 2008.
      BibTeX
      • @Article{zhang2008sun,
      • author = {Zhang, Lingyun and Tong, Matthew H and Marks, Tim K and Shan, Honghao and Cottrell, Garrison W},
      • title = {SUN: A Bayesian framework for saliency using natural statistics},
      • journal = {Journal of Vision},
      • year = 2008,
      • volume = 8,
      • number = 7,
      • publisher = {Association for Research in Vision and Ophthalmology}
      • }
    •  Marks, Tim K; Howard, Andrew; Bajracharya, Max; Cottrell, Garrison W; Matthies, Larry, "Gamma-SLAM: Stereo visual SLAM in unstructured environments using variance grid maps", IROS visual SLAM workshop, 2007.
      BibTeX
      • @Article{marks2007gamma,
      • author = {Marks, Tim K and Howard, Andrew and Bajracharya, Max and Cottrell, Garrison W and Matthies, Larry},
      • title = {Gamma-SLAM: Stereo visual SLAM in unstructured environments using variance grid maps},
      • journal = {IROS visual SLAM workshop},
      • year = 2007,
      • publisher = {Citeseer}
      • }
    •  Marks, Tim K; Hershey, John; Roddey, J Cooper; Movellan, Javier R, "Joint tracking of pose, expression, and texture using conditionally Gaussian filters", Advances in neural information processing systems, Vol. 17, pp. 889-896, 2005.
      BibTeX
      • @Article{marks2005joint,
      • author = {Marks, Tim K and Hershey, John and Roddey, J Cooper and Movellan, Javier R},
      • title = {Joint tracking of pose, expression, and texture using conditionally Gaussian filters},
      • journal = {Advances in neural information processing systems},
      • year = 2005,
      • volume = 17,
      • pages = {889--896}
      • }
    •  Marks, Tim K; Hershey, John; Roddey, J Cooper; Movellan, Javier R, "3d tracking of morphable objects using conditionally gaussian nonlinear filters", Computer Vision and Pattern Recognition Workshop, 2004. CVPRW'04. Conference on, 2004, pp. 190-190.
      BibTeX
      • @Inproceedings{marks20043d,
      • author = {Marks, Tim K and Hershey, John and Roddey, J Cooper and Movellan, Javier R},
      • title = {3d tracking of morphable objects using conditionally gaussian nonlinear filters},
      • booktitle = {Computer Vision and Pattern Recognition Workshop, 2004. CVPRW'04. Conference on},
      • year = 2004,
      • pages = {190--190},
      • organization = {IEEE}
      • }
    •  Marks, Tim K; Movellan, Javier R, "Diffusion networks, products of experts, and factor analysis", Proc. Int. Conf. on Independent Component Analysis, pp. 481-485, 2001.
      BibTeX
      • @Article{marks2001diffusion,
      • author = {Marks, Tim K and Movellan, Javier R},
      • title = {Diffusion networks, products of experts, and factor analysis},
      • journal = {Proc. Int. Conf. on Independent Component Analysis},
      • year = 2001,
      • pages = {481--485},
      • publisher = {Citeseer}
      • }
  • Videos

  • MERL Issued Patents

    • Title: "Method for Estimating Locations of Facial Landmarks in an Image of a Face using Globally Aligned Regression"
      Inventors: Tuzel, Oncel; Marks, Tim; Tambe, Salil
      Patent No.: 9,633,250
      Issue Date: Apr 25, 2017
    • Title: "Method for Generating Representations Polylines Using Piecewise Fitted Geometric Primitives"
      Inventors: Brand, Matthew E.; Marks, Tim; MV, Rohith
      Patent No.: 9,613,443
      Issue Date: Apr 4, 2017
    • Title: "Method for Determining Similarity of Objects Represented in Images"
      Inventors: Jones, Michael J.; Marks, Tim; Ahmed, Ejaz
      Patent No.: 9,436,895
      Issue Date: Sep 6, 2016
    • Title: "Method for Detecting 3D Geometric Boundaries in Images of Scenes Subject to Varying Lighting"
      Inventors: Marks, Tim; Tuzel, Oncel; Porikli, Fatih M.; Thornton, Jay E.; Ni, Jie
      Patent No.: 9,418,434
      Issue Date: Aug 16, 2016
    • Title: "Method for Factorizing Images of a Scene into Basis Images"
      Inventors: Tuzel, Oncel; Marks, Tim; Porikli, Fatih M.; Ni, Jie
      Patent No.: 9,384,553
      Issue Date: Jul 5, 2016
    • Title: "Method and System for Tracking People in Indoor Environments using a Visible Light Camera and a Low-Frame-Rate Infrared Sensor"
      Inventors: Marks, Tim; Jones, Michael J.; Kumar, Suren
      Patent No.: 9,245,196
      Issue Date: Jan 26, 2016
    • Title: "Method for Detecting and Tracking Objects in Image Sequences of Scenes Acquired by a Stationary Camera"
      Inventors: Marks, Tim; Jones, Michael J.; MV, Rohith
      Patent No.: 9,213,896
      Issue Date: Dec 15, 2015
    • Title: "Method and System for Segmenting Moving Objects from Images Using Foreground Extraction"
      Inventors: Veeraraghavan, Ashok N.; Marks, Tim; Taguchi, Yuichi
      Patent No.: 8,941,726
      Issue Date: Jan 27, 2015
    • Title: "Camera-Based 3D Climate Control"
      Inventors: Marks, Tim; Jones, Michael J.
      Patent No.: 8,929,592
      Issue Date: Jan 6, 2015
    • Title: "Method and System for Registering an Object with a Probe Using Entropy-Based Motion Selection and Rao-Blackwellized Particle Filtering"
      Inventors: Taguchi, Yuichi; Marks, Tim; Hershey, John R.
      Patent No.: 8,510,078
      Issue Date: Aug 13, 2013
    • Title: "Localization in Industrial Robotics Using Rao-Blackwellized Particle Filtering"
      Inventors: Marks, Tim; Taguchi, Yuichi
      Patent No.: 8,219,352
      Issue Date: Jul 10, 2012
    • Title: "Method for Synthetically Images of Objects"
      Inventors: Jones, Michael J.; Marks, Tim; Kumar, Ritwik
      Patent No.: 8,194,072
      Issue Date: Jun 5, 2012
    See All Patents for MERL