Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator

Zifan Shi, Yinghao Xu, Yujun Shen, Deli Zhao, Qifeng Chen, and Dit-Yan Yeung

Conference on Neural Information Processing Systems (NeurIPS), 2022

Project Website

Source Code

Spotlight (5.2% acceptance rate)

AniFaceGAN: Animatable 3D-Aware Face Image Generation for Video Avatars

Yue Wu, Yu Deng, Jiaolong Yang, Fangyun Wei, Qifeng Chen, and Xin Tong

Conference on Neural Information Processing Systems (NeurIPS), 2022

Source Code

Spotlight (5.2% acceptance rate)

One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulations

Yiming Zhu*, Hongyu Liu*, Yibing Song, Ziyang Yuan, Xintong Han, Chun Yuan, Qifeng Chen, and Jue Wang

Conference on Neural Information Processing Systems (NeurIPS), 2022

Source Code

Spotlight (5.2% acceptance rate)

Planning for Sample Efficient Imitation Learning

Zhao-Heng Yin, Weirui Ye, Qifeng Chen, and Yang Gao

Conference on Neural Information Processing Systems (NeurIPS), 2022

Source Code

Volumetric-based Contact Point Detection for 7-DoF Grasping

Junhao Cai, Jingcheng Su, Zida Zhou, Hui Cheng, Qifeng Chen, and Michael Yu Wang

Conference on Robot Learning (CoRL), 2022

Source Code

Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer

Junming Chen, Meirui Jiang, Qi Dou, and Qifeng Chen

Winter Conference on Applications of Computer Vision (WACV), 2023

Source Code

Project Website

3D-Aware Indoor Scene Synthesis with Depth Priors

Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit-Yan Yeung, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2022

Full Oral Presentation (acceptance rate 2.7%)

Project Website

Real-Time Neural Character Rendering with Pose-Guided Multiplane Images

Hao Ouyang, Bo Zhang, Pan Zhang, Hao Yang, Jiaolong Yang, Dong Chen, Qifeng Chen, and Fang Wen

European Conference on Computer Vision (ECCV), 2022

Project Website

Optimizing Image Compression via Joint Learning with Denoising

Ka Leong Cheng*, Yueqi Xie*, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2022

Source Code

Point Cloud Compression with Sibling Context and Surface Priors

Zhili Chen, Zian Qian, Sukai Wang, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2022

Source Code

Efficient Point Cloud Segmentation with Geometry-aware Sparse Networks

Maosheng Ye, Rui Wan, Shuangjie Xu, Tongyi Cao, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2022

Real-time Streaming Video Denoising with Bidirectional Buffers

Chenyang Qi*, Junming Chen*, Xin Yang, and Qifeng Chen

ACM International Conference on Multimedia (ACM MM), 2022

Source Code

Composite Photograph Harmonization with Complete Background Cues

Yazhou Xing, Yu Li, Xintao Wang, Ye Zhu, and Qifeng Chen

ACM International Conference on Multimedia (ACM MM), 2022

A Portable Multiscopic Camera for Novel View and Time Synthesis in Dynamic Scenes

Tianjia Zhang, Yuen-Fui Lau, and Qifeng Chen

International Conference on Intelligent Robots and Systems (IROS), 2022

Project Website

Region-Based Semantic Factorization in GANs

Jiapeng Zhu, Yujun Shen, Yinghao Xu, Deli Zhao, and Qifeng Chen

International Conference on Machine Learning (ICML), 2022

Source Code

Optimizing Video Prediction via Video Frame Interpolation

Yue Wu, Qiang Wen, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Project Website

Demo Video

Shape from Polarization for Complex Scenes in the Wild

Chenyang Lei*, Chenyang Qi*, Jiaxin Xie*, Na Fan, Vladlen Koltun, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Project Website

High-Fidelity GAN Inversion for Image Attribute Editing

Tengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Project Website

FS6D: Few-Shot 6D Pose Estimation of Novel Objects

Yisheng He, Yao Wang, Haoqiang Fan, Jian Sun, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Project Website

An initial attempt for invertible image processing

Restorable Image Operators with Quasi-Invertible Networks

Hao Ouyang*, Tengfei Wang*, and Qifeng Chen

AAAI Conference on Artificial Intelligence (AAAI), 2022

Deep Video Prior for Video Consistency and Propagation

Chenyang Lei, Yazhou Xing, Hao Ouyang, and Qifeng Chen

To Appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

Source Code

Low-Rank Subspaces in GANs

Jiapeng Zhu, Ruili Feng, Yujun Shen, Deli Zhao, Zhengjun Zha, Jingren Zhou, and Qifeng Chen

Conference on Neural Information Processing Systems (NeurIPS), 2021

Source Code

Learning to Predict Vehicle Trajectories with Model-based Planning

Haoran Song, Di Luan, Wenchao Ding, Michael Yu Wang, and Qifeng Chen

Conference on Robot Learning (CoRL), 2021

Project Website

Dual-Camera Super-Resolution with Aligned Attention Modules

Tengfei Wang*, Jiaxin Xie*, Wenxiu Sun, Qiong Yan, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2021

Full Oral Presentation (3.4% acceptance rate)

Project Website with Code

Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving

Xuanchi Ren*, Tao Yang*, Li Erran Li, Alexandre Alahi, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2021

Xuanchi is an HKUST undergraduate.

Internal Video Inpainting by Implicit Long-range Propagation

Hao Ouyang*, Tengfei Wang*, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2021

Project Website with Code

DRINet: A Dual-Representation Iterative Learning Network for Point Cloud Segmentation

Maosheng Ye*, Shuangjie Xu*, Tongyi Cao, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2021

Embedding Novel Views in a Single JPEG Image

Yue Wu*, Guotao Meng*, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2021

Project Website

IICNet: A Generic Framework for Reversible Image Conversion

Ka Leong Cheng*, Yueqi Xie*, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2021

Source Code

Normalized Human Pose Features for Human Action Video Alignment

Jingyuan Liu, Mingyi Shi, Qifeng Chen, Hongbo Fu, and Chiew-Lan Tai

International Conference on Computer Vision (ICCV), 2021

Full Oral Presentation (3.4% acceptance rate)

Enhanced Invertible Encoding for Learned Image Compression

Yueqi Xie*, Ka Leong Cheng*, and Qifeng Chen

ACM International Conference on Multimedia (ACM MM), 2021

Full Oral Presentation (9% acceptance rate)

Source Code

Deep Generative Priors with Non-deterministic Degradation

Unsupervised Portrait Shadow Removal via Generative Priors

Yingqing He*, Yazhou Xing*, Tianjia Zhang, and Qifeng Chen

ACM International Conference on Multimedia (ACM MM), 2021

Full Oral Presentation (9% acceptance rate)

Source Code

Stereo Waterdrop Removal with Row-wise Dilated Attention

Zifan Shi, Na Fan, Dit-Yan Yeung, and Qifeng Chen

International Conference on Intelligent Robots and Systems (IROS), 2021

Source Code

Joint Depth and Normal Estimation from Real-world Time-of-flight Raw Data

Rongrong Gao*, Na Fan*, Changlin Li, Wentao Liu, and Qifeng Chen

International Conference on Intelligent Robots and Systems (IROS), 2021

Please email Na Fan <nfanaa@connect.ust.hk> for the ToF-100 dataset (for academic purpose only).

Stereo Matching by Self-supervision of Multiscopic Vision

Weihao Yuan, Yazhan Zhang, Bingkun Wu, Siyu Zhu, Ping Tan, Michael Yu Wang, and Qifeng Chen

International Conference on Intelligent Robots and Systems (IROS), 2021

Efficient internal learning for image manipulation (33x faster than SinGAN)

SinIR: Efficient General Image Manipulation with Single Image Reconstruction

Jihyeong Yoo and Qifeng Chen

International Conference on Machine Learning (ICML), 2021

Supplementary Material

Source Code

Invertible Image Signal Processing

Yazhou Xing*, Zian Qian*, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Project Website

Source Code

Robust Reflection Removal with Reflection-free Flash-only Cues

Chenyang Lei and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Source Code

Dataset

Neural Camera Simulators

Hao Ouyang*, Zifan Shi*, Chenyang Lei, Ka Lung Law, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Source Code

TPCN: Temporal Point Cloud Networks for Motion Forecasting

Maosheng Ye, Tongyi Cao, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Image Inpainting with External-internal Learning and Monochromic Bottleneck

Tengfei Wang*, Hao Ouyang*, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Project Website

Source Code

Involution: Inverting the Inherence of Convolution for Visual Recognition

Duo Li, Jie Hu, Changhu Wang, Xiangtai Li, Qi She, Lei Zhu, Tong Zhang, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Source Code

FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation

Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, and Jian Sun

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

Full Oral Presentation (4% acceptance rate)

Source Code

Learning to Denoise Astronomical Images with U-nets

Antonia Vojtekova, Maggie Lieu, Ivan Valtchanov, Bruno Altieri, Lyndsay Old, Qifeng Chen, Filip Hroch

Monthly Notices of the Royal Astronomical Society (MNRAS), 2021

Source Code

Blind Video Temporal Consistency via Deep Video Prior

Chenyang Lei*, Yazhou Xing*, and Qifeng Chen

Conference on Neural Information Processing Systems (NeurIPS), 2020

Demo Video

Source Code

Project Website

Slides

Self-supervised Dance Video Synthesis Conditioned on Music

Xuanchi Ren, Haoran Li, Zijian Huang, and Qifeng Chen

ACM International Conference on Multimedia (ACM MM), 2020

Full Oral Presentation (9% acceptance rate)

Demo Video, Demo Video 2

Source Code

Xuanchi, Haoran, and Zijian are HKUST undergraduates.

Robust Federated Learning with Attack-Adaptive Aggregation

Ching Pui Wan and Qifeng Chen

arXiv:2102.05257

FTL-IJCAI Workshop 2021

Best Paper Award

PiP: Planning-informed Trajectory Prediction for Autonomous Driving

Haoran Song, Wenchao Ding, Yuxuan Chen, Shaojie Shen, Michael Yu Wang, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2020

Project Website

Learning to Learn Parameterized Classification Networks for Scalable Input Images

Duo Li, Anbang Yao, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2020

Source Code

PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer

Duo Li, Anbang Yao, and Qifeng Chen

European Conference on Computer Vision (ECCV), 2020

Source Code

Fully Convolutional Networks for Continuous Sign Language Recognition

Ka Leong CHENG, Zhaoyang Yang, Qifeng Chen, and Yu-Wing Tai

European Conference on Computer Vision (ECCV), 2020

Video Depth Estimation by Fusing Flow-to-Depth Proposals

Jiaxin Xie, Chenyang Lei, Zhuwen Li, Li Erran Li, and Qifeng Chen

International Conference on Intelligent Robots and Systems (IROS), 2020

Demo Video

Project Website

Source Code

Self-supervised Object Tracking with Cycle-consistent Siamese Networks

Weihao Yuan, Michael Yu Wang, and Qifeng Chen

International Conference on Intelligent Robots and Systems (IROS), 2020

Source Code

Depth Sensing Beyond LiDAR Range

Kai Zhang, Jiaxin Xie, Noah Snavely, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2020

Project website

Source Code

Polarized Reflection Removal with Perfect Alignment in the Wild

Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2020

Project website

Source Code

Dataset

Future Video Synthesis with Object Motion Prediction

Yue Wu, Rongrong Gao, Jaesik Park, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2020

Demo Video

Supplementary Material

Source Code

Attack-Resistant Federated Learning with Residual-based Reweighting

Shuhao Fu, Chulin Xie, Bo Li, and Qifeng Chen

AAAI 2021 Workshop

Source Code

MFuseNet: Robust Depth Estimation with Learned Multiscopic Fusion

Weihao Yuan, Rui Fan, Michael Yu Wang, and Qifeng Chen

International Conference on Robotics and Automation (ICRA), 2020

IEEE Robotics and Automation Letters, 2020

Project Website

Demo Video

Source Code

Hiding Video in Audio via Reversible Generative Models

Hyukyrul Yang*, Hao Ouyang*, Vladlen Koltun, and Qifeng Chen

International Conference on Computer Vision (ICCV), 2019

Slides

High-quality video reconstruction from raw sensor data.

Seeing Motion in the Dark

Chen Chen, Qifeng Chen, Minh Do, and Vladlen Koltun

International Conference on Computer Vision (ICCV), 2019

Full Oral Presentation (4.3% acceptance rate)

Demo Video

Source Code

The first dedicated video colorization method without any user input.

Fully Automatic Video Colorization with Self-Regularization and Diversity

Chenyang Lei and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2019

Project Website

Demo Video

A novel loss (CoBi) for slightly misalighned image-to-image translation.

Zoom to Learn, Learn to Zoom

Xuaner Zhang, Qifeng Chen, Ren Ng, and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2019

Project Website

Supplement

3D Motion Decomposition for RGBD Future Dynamic Scene Synthesis

Xiaojuan Qi*, Zhengzhe Liu*, Qifeng Chen, and Jiaya Jia

Conference on Computer Vision and Pattern Recognition (CVPR), 2019

Supplementary Video

Send an email to Xiaojuan or me for the source code.

Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search

Zhuwen Li, Qifeng Chen, and Vladlen Koltun

Conference on Neural Information Processing Systems (NeurIPS), 2018

Source code

Semi-parametric Image Synthesis

Xiaojuan Qi, Qifeng Chen, Jiaya Jia, and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Full Oral Presentation (2.1% acceptance rate)

Code and data

Demo Video

Interactive Image Segmentation with Latent Diversity

Zhuwen Li, Qifeng Chen, and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Source code

Single Image Reflection Separation with Perceptual Losses

Xuaner Zhang, Ren Ng, and Qifeng Chen

Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Supplementary Material

Source code

Learning to See in the Dark

Chen Chen, Qifeng Chen, Jia Xu, and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Project website

Speech Denoising with Deep Feature Losses

Francois G Germain, Qifeng Chen, and Vladlen Koltun

Interspeech 2019

arXiv preprint arXiv:1806.10522

Source Code

Project Website

Photographic Image Synthesis with Cascaded Refinement Networks

Qifeng Chen and Vladlen Koltun

International Conference on Computer Vision (ICCV), 2017

Full Oral Presentation (2.1% acceptance rate)

Project website

Fast Image Processing with Fully-Convolutional Networks

Qifeng Chen*, Jia Xu*, and Vladlen Koltun

International Conference on Computer Vision (ICCV), 2017

Project website

Full Flow: Optical Flow Estimation By Global Optimization over Regular Grids

Qifeng Chen and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2016

Full Oral Presentation (3.9% acceptance rate)

Project website (with source code)

Dense Monocular Depth Estimation in Complex Dynamic Scenes

René Ranftl, Vibhav Vineet, Qifeng Chen, and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2016

Robust Nonrigid Registration by Convex Optimization

Qifeng Chen and Vladlen Koltun

International Conference on Computer Vision (ICCV), 2015

Full Oral Presentation (3.3% acceptance rate)

Project website (with Matlab source code)

Fast MRF Optimization with Application to Depth Reconstruction

Qifeng Chen and Vladlen Koltun

Conference on Computer Vision and Pattern Recognition (CVPR), 2014

Project website (with C++ and Matlab source code)

A Simple Model for Intrinsic Image Decomposition with Depth Cues

Qifeng Chen and Vladlen Koltun

International Conference on Computer Vision (ICCV), 2013

Matlab source code (updated on 2 Dec 2015)
Supplementary material   Poster

Please email to sintel@tue.mpg.de for the MPI Sintel dataset.

Motion-Aware KNN Laplacian for Video Matting

Dingzeyu Li, Qifeng Chen, and Chi-Keung Tang

International Conference on Computer Vision (ICCV), 2013

Project website

KNN Matting (with extension to layer color estimation)

Qifeng Chen, Dingzeyu Li, and Chi-Keung Tang

Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2013

Matlab source code (for layer color estimation)

KNN Matting

Qifeng Chen, Dingzeyu Li, and Chi-Keung Tang

Conference on Computer Vision and Pattern Recognition (CVPR), 2012

Project website (with Matlab source code)