Professor Saito

Hyper Vision Research Laboratory is actively looking for outstanding prospective bachelor, master and Ph.D. students. Our research and education range from theoretical foundations to practical application systems of computer vision and machine learning. The application area of our recent research includes autonomous driving, human sensing, supporting of medical surgery, human-robot interaction, visual inspection, etc. If you are interested in our team, feel free to contact us.






Hideo Saito, PhD


Hideo Saito

Hideo Saito

Professor, Keio University

斎藤 英雄 · Hyper Vision Research Laboratory

About me

I am a Professor in the Department of Information and Computer Science, Faculty of Science and Technology, Keio University, Japan, where I lead the Hyper Vision Research Laboratory (HVRL). I currently serve as Chair of the School of Informatics, Management and Human Sciences in the Graduate School of Science and Technology, and as a Group Leader at the Keio AI Research Center, Keio University Global Research Institute (KGRI).

Publications

Selected Papers

Selected peer-reviewed papers from recent years. The complete list is available on Google Scholar.

2026

Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensors

R. Hori, J.-T. Song, Z. Luo, J. Cao, S. Shin, H. Saito, K. Kitani

CVPR 2026

Learning from Synthetic Data via Provenance-Based Input Gradient Guidance

K. Nagano, R. Fujii, R. Hachiuma, F. Sato, T. Sekii, H. Saito

CVPR 2026

3D Reconstruction of American Football Game Situations from Handheld Monocular Video

K. Sawafuji, R. Otsubo, D. Mikami, H. Saito

CVPR W 2026 CVSports Workshop

MSVS: Multi-Shell Viewpoint Sampling for Comprehensive Evaluation of 3D Watermarking

T. Matsubara, L. Yao, C. Huang, M. Pan, H. Saito

ICASSP 2026

Real-Time Dynamic Digital Twin Generation Using Multiple First-Person Views

H. Yazaki, S. Hirokawa, R. Hori, H. Saito, A. Sawada, M. Nakanoya

IEEE VR W 2026 4th Workshop on Seamless Reality (WSR)

3D Gaussian Reference Parts for Robust Free-Viewpoint Visual Inspection

K. Ito, S. Ueda, S. Mori, J. Sugano, H. Adachi, H. Saito · 2026

IEEE Access

Efficient Detailing and Update of 3D Gaussian Splatting from Feed-Forward Models’ Prediction

A. Sawada, M. Nakanoya, D. Kanetomo, T. Hosoi, H. Saito

IROS 2026

Preliminary Exploration of Sonification for Spatial Augmentation of Ball-Approach Dynamics and Timing in Tennis

K. Masai, H. Saito

IEEE VR W 2026 4th Workshop on Seamless Reality (WSR)

2025

Towards Predicting Any Human Trajectory In Context

R. Fujii, H. Saito, R. Hachiuma

NeurIPS 2025

Human Preference-Aligned Concept Customization Benchmark via Decomposed Evaluation

R. Ishikawa, R. Fujii, H. Saito, R. Hachiuma

ICCV W 2025

Human Mesh Reconstruction of Sports Players with Multiple Dynamic Cameras

Y. Hokari, R. Hori, H. Saito

CVPR W 2025 CVSports Workshop

IntelliCap: Intelligent Guidance for Consistent View Sampling

A. Yasunaga, H. Saito, D. Schmalstieg, S. Mori

ISMAR 2025

Occlusion-Free 4D Gaussians for Open Surgery Videos Using Multi-Camera Shadowless Lamps

Y. Kato, S. Mori, H. Saito, Y. Takatsume, H. Kajita, M. Isogawa

MICCAI 2025

Dense Depth from Event Focal Stack

K. Horikawa, M. Isogawa, H. Saito, S. Mori

WACV 2025

User-in-the-Loop View Sampling with Error Peaking Visualization

A. Yasunaga, H. Saito, S. Mori

ICIP 2025

Gait Inertial Poser (GIP): Gait-Aware Human Motion Capture Using Shoe-Embedded IMUs

R. Hori, H. Deguchi, T. Maruyama, M. Tada, H. Saito · 2025

IEEE Access

Instant Slow-Motion Visualization of High-Speed Phenomena Based on Event Camera

K. Matsunaga, K. Masai, H. Saito · 2025

IEEE Access

EgoSurgery-HTS: A Dataset for Egocentric Hand–Tool Segmentation in Open Surgery Videos

N. Darjana, R. Fujii, H. Saito, H. Kajita · Healthcare Technology Letters

HTL 2025

Real-Time Ball Tracking and Action Classification using an Event Camera

M. Yamane, M. Yamaguchi, K. Higa, R. Fujiwara, H. Saito

MMSports 2025 ACM MM Workshop

Players Tracking and Identification for Minimap Generation in American Football

R. Otsubo, K. Ishii, H. Saito

MMSports 2025 ACM MM Workshop

Hand Held Multi-Object Tracking Dataset in American Football

R. Otsubo, K. Sawafuji, H. Saito

MMSports 2025 ACM MM Workshop

2024

Multimodal Cross-Domain Few-Shot Learning for Egocentric Action Recognition

M. Hatano, R. Hachiuma, R. Fujii, H. Saito

ECCV 2024

EventPointMesh: Human Mesh Recovery Solely from Event Point Clouds

R. Hori, M. Isogawa, D. Mikami, H. Saito · Vol. 31, No. 9

IEEE TVCG

Event-Based Ball Spin Estimation in Sports

T. Nakabayashi, K. Higa, M. Yamaguchi, R. Fujiwara, H. Saito

CVPR W 2024 CVSports Workshop

Time-consistent Ball Tracking and Spin Estimation with Event Camera

K. Sato, T. Nakabayashi, M. Yamaguchi, K. Higa, R. Fujiwara, H. Saito

MMSports 2024

Visuo-Tactile Zero-Shot Object Recognition with Vision-Language Model

S. Ueda, A. Hashimoto, M. Hamaya, K. Tanaka, H. Saito

IROS 2024

E2GS: Event Enhanced Gaussian Splatting

H. Deguchi, M. Masuda, T. Nakabayashi, H. Saito

ICIP 2024

Occlusion Free Multi-Object Tracking Extension using Multi-Camera for Sport

M. Yamane, A. Kondo, M. Hatano, R. Hori, H. Saito

MMSports 2024 ACM MM Workshop

2023

Multi-Layer Scene Representation from Composed Focal Stacks

R. Ishikawa, H. Saito, D. Kalkofen, S. Mori · Vol. 29, No. 11

IEEE TVCG

Best Journal Paper Award, IEEE ISMAR 2023

Learning Food Picking without Food: Fracture Anticipation by Breaking Reusable Fragile Objects

R. Yagawa, R. Ishikawa, M. Hamaya, K. Tanaka, A. Hashimoto, H. Saito

ICRA 2023

Event-Based Blur Kernel Estimation for Blind Motion Deblurring

T. Nakabayashi, K. Hasegawa, M. Matsugu, H. Saito

CVPR W 2023 Event-based Vision Workshop

Event-Based Camera Tracker by ∇t NeRF

M. Masuda, Y. Sekikawa, H. Saito · Vol. 11

IEEE Access

Accuracy Evaluation and Prediction of Single-Image Camera Calibration

S. Kikkawa, F. Okura, D. Muramatsu, Y. Yagi, H. Saito · Vol. 11

IEEE Access

Unsupervised Fall Detection on Edge Devices

T. Nakabayashi, H. Saito

MVA 2023

Career

Appointments and Education

Present Chair, School of Informatics, Management and Human Sciences, Graduate School of Science and Technology, Keio University
Present Group Leader, Keio AI Research Center, Keio University Global Research Institute (KGRI)
2006–present Professor, Department of Information and Computer Science, Keio University
2001–2006 Associate Professor, Department of Information and Computer Science, Keio University
1997–1999 Visiting Researcher, Virtualized Reality Project, Robotics Institute, Carnegie Mellon University
1995–2001 Assistant Professor, Department of Information and Computer Science, Keio University
1992–1995 Research Associate / Assistant Professor, Department of Electrical Engineering, Keio University
1992 Ph.D. in Electrical Engineering, Keio University
1989 M.E. in Electrical Engineering, Keio University
1987 B.E. in Electrical Engineering, Keio University

Professional Activity

Honors and Service

Honors

  • Fellow, Institute of Electronics, Information and Communication Engineers (IEICE)
  • Fellow, Virtual Reality Society of Japan (VRSJ)
  • Best Journal Paper Award, IEEE ISMAR 2023

Society Leadership

  • President, Institute of Image Information and Television Engineers (ITE), 2025
  • President, Information and Systems Society of IEICE (IEICE-ISS), 2024
  • Chair, IEICE-ISS Technical Committee on Pattern Recognition and Media Understanding (PRMU)

Conference Leadership

  • General Chair, IEEE ISMAR 2015; Program Chair, IEEE ISMAR 2016
  • Program Chair, ACCV 2014
  • Scientific Program Chair, EuroVR 2020
  • Steering Committee Member, IEEE ISMAR
  • General Chair, MVA 2009; General Co-Chair, ICAT 2006 and 2008

Editorial

  • Editor-in-Chief, IPSJ Transactions on Computer Vision and Applications
  • Program Committee, ICCV, IEEE ISMAR, CVMP, and others

Students

Doctoral Graduates

Ph.D. graduates supervised at the Hyper Vision Research Laboratory, Keio University.

2026 Ryosuke Hori, Ryo Fujii
2025 Mana Masuda
2023 Atsunori Moteki
2022 Tomoya Kaichi, Linlin Zhang, Takehiro Ozawa
2021 Ryo Hachiuma, Masahiro Yamaguchi, Akiyoshi Kurobe
2020 Yusuke Sekikawa, Yoshikatsu Nakajima, Naoto Ienaga
2018 Siim Meerits
2017 Kosuke Hara
2016 Kunihiro Hasegawa
2015 Sho Tamaki, Takenori Hara
2014 Dao Huu Hung, Takuya Minagawa
2013 Sandy Eggi Martedi
2012 Hiroyuki Segi
2011 Hidenori Tanaka, Yuji Oyamada
2010 Hiroyo Ishikawa, Hideaki Uchiyama, Tomoaki Teshima
2009 Songkran Jarusirisawad, Chutisant Kerdvibulvech, Koichiro Yamauchi
2008 Yuko Uematsu
2006 Satoshi Yaguchi
2005 Jiahui Wang, Daisuke Iso, Naho Inamoto
2002 Makoto Kimura

In total, 36 students have received their Ph.D. under my supervision. A full list of past members, including master’s and bachelor’s graduates, is available on the HVRL past members page.

Hideo Saito

Professor, Keio University

Department of Information and Computer Science

3-14-1 Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan

hs@keio.jp