I am currently a postdoctoral researcher working with Prof. Boxin Shi and Chao Xu at Camera Intelligence Lab, Peking University (PKU). Before that, I received my Ph.D. in 2023, advised by Prof. Yuchao Dai, at the School of Electronics and Information, Northwestern Polytechnical University (NPU), Xi'an, China.

My research mainly focuses on camera pose estimation, image rectification, temporal super-resolution, and 3D reconstruction, especially regarding the rolling shutter camera. I am also interested in low-level geometric problems (e.g. structure from motion, SLAM) and image restoration tasks (e.g. deblurring).

Contact

  • binfan [at] mail.nwpu.edu.cn

  • No. 1 Dongxiang Road, Chang'an District, Xi'an, China, 710129

  • (+86)-187-1738-1424

Education

  • Ph.D. in Information and Communication Engineering

    Apr 2019 - Apr 2023

    NPU, Shaanxi, China

    Advisor: Prof. Yuchao Dai

  • M.E. in Control Science and Engineering

    Sep 2016 - Mar 2019

    NPU, Shaanxi, China

    Advisor: Prof. Chunhui Zhao

  • B.S. in Statistics

    Sep 2012 - Jun 2016

    NPU, Shaanxi, China

Project Experiences

  • Motion and Depth Estimation of Stereo Rolling Shutter Camera
    Apr 2019 - Sep 2022

    DJI, Shenzhen
    Principal Investigator
  • Rolling Shutter Temporal Super-Resolution and High-Quality 3D Reconstruction
    Jan 2023 - Dec 2026

    National Natural Science Foundation of China
    Principal Investigator
  • Monocular Dense 3D Reconstruction of Complex Dynamic Scenes
    Jan 2019 - Dec 2022

    National Natural Science Foundation of China
    Key personnel for localization and reconstruction based on monocular videos
  • Outdoor Urban Level Positioning
    Jun 2018 - Jun 2021

    Huawei, Xi'an
    Key personnel for multi-sensor calibration and data acquisition
  • Autonomous Perception and Intelligent Flight Technology
    Jun 2017 - Dec 2018

    Innovation Special Zone Project
    Key personnel for outfield experiments of quadrotor-based obstacle detection and avoidance
  • Dynamic Autonomous Calibration of Distributed Multi-Camera Arrays
    Jan 2017 - Dec 2018

    Natural Science Foundation of Shaanxi Province
    Key personnel for principle analysis and code debugging of multi-camera SLAM

Publications

  • Learning Bilateral Cost Volume for Rolling Shutter Temporal Super-Resolution

    Bin Fan, Yuchao Dai, Hongdong Li

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

    [ Project Page | Paper | Code | Supplementary Video ]

  • Rolling Shutter Inversion: Bring Rolling Shutter Images to High Framerate Global Shutter Video

    Bin Fan, Yuchao Dai, Hongdong Li

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

    [ Paper | Code | Supplementary Video ]

  • Joint Appearance and Motion Learning for Efficient Rolling Shutter Correction

    Bin Fan, Yuxin Mao, Yuchao Dai, Zhexiong Wan, Qi Liu

    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

    [ Project Page | Paper | Poster | Video | Code ]

  • Context-Aware Video Reconstruction for Rolling Shutter Cameras

    Bin Fan, Yuchao Dai, Zhiyuan Zhang, Qi Liu, Mingyi He

    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

    [ Project Page | Paper | Poster | Code ]

  • Inverting a Rolling Shutter Camera: Bring Rolling Shutter Images to High Framerate Global Shutter Video

    Bin Fan, Yuchao Dai

    IEEE International Conference on Computer Vision (ICCV), 2021

    [ Project Page | Paper | Poster | Code ]

  • SUNet: Symmetric Undistortion Network for Rolling Shutter Correction

    Bin Fan, Yuchao Dai, Mingyi He

    IEEE International Conference on Computer Vision (ICCV), 2021

    [ Project Page | Paper | Poster | Code ]

  • Rolling-Shutter-Stereo-Aware Motion Estimation and Image Correction

    Bin Fan, Yuchao Dai, Ke Wang

    Computer Vision and Image Understanding (CVIU), 2021

    [ Project Page | Paper ]

  • Differential SfM and Image Correction for a Rolling Shutter Stereo Rig

    Bin Fan, Yuchao Dai, Zhiyuan Zhang, Ke Wang

    Image and Vision Computing (IVC), 2022

    [ Project Page | Paper ]

  • Rolling Shutter Camera: Modeling, Optimization and Learning

    Bin Fan, Yuchao Dai, Mingyi He

    Machine Intelligence Research (MIR), 2023

    [ Project Page | Paper ]

  • RS-DPSNet: Deep Plane Sweep Network for Rolling Shutter Stereo Images

    Bin Fan, Ke Wang, Yuchao Dai, Mingyi He

    IEEE Signal Processing Letters (SPL), 2021

    [ Paper ]

  • Fast and Robust Differential Relative Pose Estimation with Radial Distortion

    Bin Fan, Yuchao Dai, Zhiyuan Zhang, Mingyi He

    IEEE Signal Processing Letters (SPL), 2021

    [ Paper ]

  • A Revisit of the Normalized Eight-Point Algorithm and a Self-Supervised Deep Solution

    Bin Fan, Yuchao Dai, Yongduek Seo, Mingyi He

    Visual Intelligence (VI), 2024

    [ Overview | Paper ]

  • Learning a Task-Specific Descriptor for Robust Matching of 3D Point Clouds

    Zhiyuan Zhang, Yuchao Dai, Bin Fan, Jiadai Sun, Mingyi He

    IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2022

    [ Project Page | Paper ]

  • VRNet: Learning the Rectified Virtual Corresponding Points for 3D Point Cloud Registration

    Zhiyuan Zhang, Jiadai Sun, Yuchao Dai, Bin Fan, Mingyi He

    IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2022

    [ Project Page | Paper ]

  • Searching Dense Point Correspondences via Permutation Matrix Learning

    Zhiyuan Zhang, Jiadai Sun, Yuchao Dai, Bin Fan, Qi Liu

    IEEE Signal Processing Letters (SPL), 2022

    [ Paper ]

  • Homography-Based Camera Pose Estimation with Known Gravity Direction for UAV Navigation

    Chunhui Zhao, Bin Fan, Jinwen Hu, Quan Pan, Zhao Xu

    Science China Information Sciences (Sci. China Inf. Sci.), 2021

    [ Paper ]

  • Self-Supervised Multi-Body Scene Flow Estimation

    Jihuang Dai, Yuchao Dai, Bin Fan

    Neurocomputing (NEUCOM), 2021

    [ Paper ]

  • Relative Pose Estimation for Stereo Rolling Shutter Cameras

    Ke Wang, Bin Fan, Yuchao Dai

    IEEE International Conference on Image Processing (ICIP), 2020

    [ Paper ]

  • Pose Estimation for Multi-Camera Systems

    Chunhui Zhao, Bin Fan, Jinwen Hu, Limin Tian, Zhiyuan Zhang, Sijia Li, Quan Pan

    IEEE International Conference on Unmanned Systems (ICUS), 2017

    [ Paper ]

Awards & Honors

Academic Activities

Talks

  • Rolling Shutter Camera: Modeling, Optimization and Learning (Academic Talk, online), Macao Polytechnic University, China, Dec 2023
  • Co-organizer of CVPR 2023 Tutorial on Rolling Shutter Camera: Modeling, Optimization, Learning and Hardware, Vancouver, Canada, Jun 2023
  • Research Experience Sharing and Discussion (No. 170, Weituo), School of Electronics and Information, NPU, Xi'an, China, Apr 2023
  • Co-organizer of ACCV 2022 Tutorial on Rolling Shutter Camera: Modeling, Optimization and Learning, Macau SAR, China, Dec 2022
  • Vision and Learning Seminar (VALSE), Tianjin, China, Aug 2022
  • Conference on Computer Vision and Pattern Recognition (Poster Presentation), Virtual attendance, Jun 2022
  • Get a Footage without Rolling Shutter Effect (Academic Talk), Samsung, Xi'an, China, Nov 2021
  • International Conference on Computer Vision (Poster Presentation), Virtual attendance, Oct 2021
  • Vision and Learning Seminar (VALSE), Hefei, China, Apr 2019
  • International Conference on Control and Automation (Oral Presentation), Anchorage, USA, Jun 2018
  • International Conference on Unmanned Systems (Oral Presentation), Beijing, China, Oct 2017

Services

  • Journal Reviewer: TPAMI, IJCV, NAT COMMUN, TMM, Journal of Sensors
  • Conference Reviewer: CVPR 2022-2023, ECCV 2022, ICCV 2023, ICRA 2023, IROS 2021, ICME 2020-2021