TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
Conference on Neural Information Processing Systems (NeurIPS), 2023
4D Panoptic Scene Graph Generation
Jingkang Yang, Jun Cen, Wenxuan Peng, Shuai Liu, Fangzhou Hong, Xiangtai Li, Kaiyang Zhou, Qifeng Chen, Ziwei Liu
AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections
Yue Wu*, Sicheng Xu*, Jianfeng Xiang, Fangyun Wei, Qifeng Chen, Jiaolong Yang, Xin Tong
ACM SIGGRAPH Asia 2023
Project Website
Neural Image Popularity Assessment with Retrieval-augmented Transformer
Liya Ji*, Chan Ho Park*, Zhefan Rao*, and Qifeng Chen
ACM International Conference on Multimedia (ACM MM), 2023
FateZero: Fusing Attentions for Zero-shot Text-based Video Editing
Chenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei, Xintao Wang, Ying Shan, and Qifeng Chen
International Conference on Computer Vision (ICCV), 2023
Full Oral Presentation
LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis
Jiapeng Zhu, Ceyuan Yang, Yujun Shen, Zifan Shi, Bo Dai, Deli Zhao, and Qifeng Chen
Bootstrap Motion Forecasting With Self-Consistent Constraints
Maosheng Ye, Jiamiao Xu, Xunnong Xu, Tengfei Wang, Tongyi Cao, and Qifeng Chen
International Conference on nd Computer Vision (ICCV), 2023
Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learning
Huimin Wu*, Chenyang Lei*, Xiao Sun, Peng-Shuai Wang, Qifeng Chen, Kwang-Ting Cheng, Stephen Lin, Zhirong Wu
Rotating without Seeing: Towards In-hand Dexterity through Touch
Zhao-Heng Yin, Binghao Huang, Yuzhe Qin, Qifeng Chen, and Xiaolong Wang
Robotics: Science and Systems (RSS), 2023
Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, and Baining Guo
Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Highlight (top 2.5%)
High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimization
Jiaxin Xie*, Hao Ouyang*, Jingtan Piao, Chenyang Lei, and Qifeng Chen
Source Code
Real-time 6K Image Rescaling with Rate-distortion Optimization
Chenyang Qi*, Xin Yang*, Ka Leong Cheng, Ying-Cong Chen, and Qifeng Chen
Blind Video Deflickering by Neural Filtering with a Flawed Atlas
Chenyang Lei*, Xuanchi Ren*, Zhaoxiang Zhang, and Qifeng Chen
Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint
Hongyu Liu, Yibing Song, and Qifeng Chen
Enlarge Instance-specific and Class-specific Information for Open-set Action Recognition
Jun Cen, Shiwei Zhang, Xiang Wang, Yixuan Pei, Zhiwu Qing, Yingya Zhang, and Qifeng Chen
DYNAFED: Tackling Client Data Heterogeneity with Global Dynamics
Renjie Pi*, Weizhong Zhang*, Yueqi Xie*, Jiahui Gao, Xiaoyu Wang, Sunghun Kim, and Qifeng Chen
Learning 3D-aware Image Synthesis with Unknown Pose Distribution
Zifan Shi, Yujun Shen, Yinghao Xu, Sida Peng, Yiyi Liao, Sheng Guo, Qifeng Chen, and Dit-Yan Yeung
MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptation
Bowen Zhang*, Chenyang Qi*, Pan Zhang, Bo Zhang, HsiangTao Wu, Dong Chen, Qifeng Chen, Yong Wang, and Fang Wen
Human MotionFormer: Transferring Human Motions with Vision Transformers
Hongyu Liu*, Xintong Han*, Chenbin Jin, Lihui Qian, Huawei Wei, Zhe Lin, Faqiang Wang, Haoye Dong, Yibing Song, Jia Xu, and Qifeng Chen
International Conference on Learning Representations (ICLR), 2023
The Devil is in the Wrongly-classified Samples: Towards Unified Open-set Recognition
Jun Cen, Di Luan, Shiwei Zhang, Yixuan Pei, Yingya Zhang, Deli Zhao, Shaojie Shen, and Qifeng Chen
Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenes
Qiang Wen, Yue Wu, and Qifeng Chen
International Conference on Robotics and Automation (ICRA), 2023
Flipbot: Learning Continuous Paper Flipping via Coarse-to-Fine Exteroceptive-Proprioceptive Exploration
Chao Zhao*, Chunli Jiang*, Junhao Cai, Michael Yu Wang, Hongyu Yu, and Qifeng Chen
Scene-level Point Cloud Colorization with Semantics-and-geometry-aware Networks
Rongrong Gao, Tian-Zhu Xiang, Chenyang Lei, Jaesik Park, and Qifeng Chen
Improving Video Super-Resolution with Long-Term Self-Exemplars
Guotao Meng*, Yue Wu*, and Qifeng Chen
Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator
Zifan Shi, Yinghao Xu, Yujun Shen, Deli Zhao, Qifeng Chen, and Dit-Yan Yeung
Conference on Neural Information Processing Systems (NeurIPS), 2022
Spotlight (5.2% acceptance rate)
AniFaceGAN: Animatable 3D-Aware Face Image Generation for Video Avatars
Yue Wu, Yu Deng, Jiaolong Yang, Fangyun Wei, Qifeng Chen, and Xin Tong
One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulations
Yiming Zhu*, Hongyu Liu*, Yibing Song, Ziyang Yuan, Xintong Han, Chun Yuan, Qifeng Chen, and Jue Wang
Planning for Sample Efficient Imitation Learning
Zhao-Heng Yin, Weirui Ye, Qifeng Chen, and Yang Gao
Volumetric-based Contact Point Detection for 7-DoF Grasping
Junhao Cai, Jingcheng Su, Zida Zhou, Hui Cheng, Qifeng Chen, and Michael Yu Wang
Conference on Robot Learning (CoRL), 2022
Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer
Junming Chen, Meirui Jiang, Qi Dou, and Qifeng Chen
Winter Conference on Applications of Computer Vision (WACV), 2023
3D-Aware Indoor Scene Synthesis with Depth Priors
Zifan Shi, Yujun Shen, Jiapeng Zhu, Dit-Yan Yeung, and Qifeng Chen
European Conference on Computer Vision (ECCV), 2022
Full Oral Presentation (acceptance rate 2.7%)
Real-Time Neural Character Rendering with Pose-Guided Multiplane Images
Hao Ouyang, Bo Zhang, Pan Zhang, Hao Yang, Jiaolong Yang, Dong Chen, Qifeng Chen, and Fang Wen
Optimizing Image Compression via Joint Learning with Denoising
Ka Leong Cheng*, Yueqi Xie*, and Qifeng Chen
Point Cloud Compression with Sibling Context and Surface Priors
Zhili Chen, Zian Qian, Sukai Wang, and Qifeng Chen
Efficient Point Cloud Segmentation with Geometry-aware Sparse Networks
Maosheng Ye, Rui Wan, Shuangjie Xu, Tongyi Cao, and Qifeng Chen
Real-time Streaming Video Denoising with Bidirectional Buffers
Chenyang Qi*, Junming Chen*, Xin Yang, and Qifeng Chen
ACM International Conference on Multimedia (ACM MM), 2022
Composite Photograph Harmonization with Complete Background Cues
Yazhou Xing, Yu Li, Xintao Wang, Ye Zhu, and Qifeng Chen
A Portable Multiscopic Camera for Novel View and Time Synthesis in Dynamic Scenes
Tianjia Zhang, Yuen-Fui Lau, and Qifeng Chen
International Conference on Intelligent Robots and Systems (IROS), 2022
Region-Based Semantic Factorization in GANs
Jiapeng Zhu, Yujun Shen, Yinghao Xu, Deli Zhao, and Qifeng Chen
International Conference on Machine Learning (ICML), 2022
Optimizing Video Prediction via Video Frame Interpolation
Yue Wu, Qiang Wen, and Qifeng Chen
Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Demo Video
Shape from Polarization for Complex Scenes in the Wild
Chenyang Lei*, Chenyang Qi*, Jiaxin Xie*, Na Fan, Vladlen Koltun, and Qifeng Chen
High-Fidelity GAN Inversion for Image Attribute Editing
Tengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang, and Qifeng Chen
FS6D: Few-Shot 6D Pose Estimation of Novel Objects
Yisheng He, Yao Wang, Haoqiang Fan, Jian Sun, and Qifeng Chen
An initial attempt for invertible image processing
Restorable Image Operators with Quasi-Invertible Networks
Hao Ouyang*, Tengfei Wang*, and Qifeng Chen
AAAI Conference on Artificial Intelligence (AAAI), 2022
Deep Video Prior for Video Consistency and Propagation
Chenyang Lei, Yazhou Xing, Hao Ouyang, and Qifeng Chen
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Low-Rank Subspaces in GANs
Jiapeng Zhu, Ruili Feng, Yujun Shen, Deli Zhao, Zhengjun Zha, Jingren Zhou, and Qifeng Chen
Conference on Neural Information Processing Systems (NeurIPS), 2021
Learning to Predict Vehicle Trajectories with Model-based Planning
Haoran Song, Di Luan, Wenchao Ding, Michael Yu Wang, and Qifeng Chen
Conference on Robot Learning (CoRL), 2021
Dual-Camera Super-Resolution with Aligned Attention Modules
Tengfei Wang*, Jiaxin Xie*, Wenxiu Sun, Qiong Yan, and Qifeng Chen
International Conference on Computer Vision (ICCV), 2021
Full Oral Presentation (3.4% acceptance rate)
Project Website with Code
Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving
Xuanchi Ren*, Tao Yang*, Li Erran Li, Alexandre Alahi, and Qifeng Chen
Xuanchi is an HKUST undergraduate.
Internal Video Inpainting by Implicit Long-range Propagation
DRINet: A Dual-Representation Iterative Learning Network for Point Cloud Segmentation
Maosheng Ye*, Shuangjie Xu*, Tongyi Cao, and Qifeng Chen
Embedding Novel Views in a Single JPEG Image
Yue Wu*, Guotao Meng*, and Qifeng Chen
IICNet: A Generic Framework for Reversible Image Conversion
Normalized Human Pose Features for Human Action Video Alignment
Jingyuan Liu, Mingyi Shi, Qifeng Chen, Hongbo Fu, and Chiew-Lan Tai
Enhanced Invertible Encoding for Learned Image Compression
Yueqi Xie*, Ka Leong Cheng*, and Qifeng Chen
ACM International Conference on Multimedia (ACM MM), 2021
Full Oral Presentation (9% acceptance rate)
Deep Generative Priors with Non-deterministic Degradation
Unsupervised Portrait Shadow Removal via Generative Priors
Yingqing He*, Yazhou Xing*, Tianjia Zhang, and Qifeng Chen
Stereo Waterdrop Removal with Row-wise Dilated Attention
Zifan Shi, Na Fan, Dit-Yan Yeung, and Qifeng Chen
International Conference on Intelligent Robots and Systems (IROS), 2021
Joint Depth and Normal Estimation from Real-world Time-of-flight Raw Data
Rongrong Gao*, Na Fan*, Changlin Li, Wentao Liu, and Qifeng Chen
Please email Na Fan <nfanaa@connect.ust.hk> for the ToF-100 dataset (for academic purpose only).
Stereo Matching by Self-supervision of Multiscopic Vision
Weihao Yuan, Yazhan Zhang, Bingkun Wu, Siyu Zhu, Ping Tan, Michael Yu Wang, and Qifeng Chen
Efficient internal learning for image manipulation (33x faster than SinGAN)
SinIR: Efficient General Image Manipulation with Single Image Reconstruction
Jihyeong Yoo and Qifeng Chen
International Conference on Machine Learning (ICML), 2021
Supplementary Material
Invertible Image Signal Processing
Yazhou Xing*, Zian Qian*, and Qifeng Chen
Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Robust Reflection Removal with Reflection-free Flash-only Cues
Chenyang Lei and Qifeng Chen
Dataset
Neural Camera Simulators
Hao Ouyang*, Zifan Shi*, Chenyang Lei, Ka Lung Law, and Qifeng Chen
TPCN: Temporal Point Cloud Networks for Motion Forecasting
Maosheng Ye, Tongyi Cao, and Qifeng Chen
Image Inpainting with External-internal Learning and Monochromic Bottleneck
Tengfei Wang*, Hao Ouyang*, and Qifeng Chen
Involution: Inverting the Inherence of Convolution for Visual Recognition
Duo Li, Jie Hu, Changhu Wang, Xiangtai Li, Qi She, Lei Zhu, Tong Zhang, and Qifeng Chen
FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation
Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, and Jian Sun
Full Oral Presentation (4% acceptance rate)
Learning to Denoise Astronomical Images with U-nets
Antonia Vojtekova, Maggie Lieu, Ivan Valtchanov, Bruno Altieri, Lyndsay Old, Qifeng Chen, Filip Hroch
Monthly Notices of the Royal Astronomical Society (MNRAS), 2021
Blind Video Temporal Consistency via Deep Video Prior
Chenyang Lei*, Yazhou Xing*, and Qifeng Chen
Conference on Neural Information Processing Systems (NeurIPS), 2020
Slides
Self-supervised Dance Video Synthesis Conditioned on Music
Xuanchi Ren, Haoran Li, Zijian Huang, and Qifeng Chen
ACM International Conference on Multimedia (ACM MM), 2020
Demo Video, Demo Video 2
Xuanchi, Haoran, and Zijian are HKUST undergraduates.
Robust Federated Learning with Attack-Adaptive Aggregation
Ching Pui Wan and Qifeng Chen
arXiv:2102.05257
FTL-IJCAI Workshop 2021
Best Paper Award
PiP: Planning-informed Trajectory Prediction for Autonomous Driving
Haoran Song, Wenchao Ding, Yuxuan Chen, Shaojie Shen, Michael Yu Wang, and Qifeng Chen
European Conference on Computer Vision (ECCV), 2020
Learning to Learn Parameterized Classification Networks for Scalable Input Images
Duo Li, Anbang Yao, and Qifeng Chen
PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer
Fully Convolutional Networks for Continuous Sign Language Recognition
Ka Leong CHENG, Zhaoyang Yang, Qifeng Chen, and Yu-Wing Tai
Video Depth Estimation by Fusing Flow-to-Depth Proposals
Jiaxin Xie, Chenyang Lei, Zhuwen Li, Li Erran Li, and Qifeng Chen
International Conference on Intelligent Robots and Systems (IROS), 2020
Self-supervised Object Tracking with Cycle-consistent Siamese Networks
Weihao Yuan, Michael Yu Wang, and Qifeng Chen
Depth Sensing Beyond LiDAR Range
Kai Zhang, Jiaxin Xie, Noah Snavely, and Qifeng Chen
Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Project website
Polarized Reflection Removal with Perfect Alignment in the Wild
Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun, and Qifeng Chen
Future Video Synthesis with Object Motion Prediction
Yue Wu, Rongrong Gao, Jaesik Park, and Qifeng Chen
Attack-Resistant Federated Learning with Residual-based Reweighting
Shuhao Fu, Chulin Xie, Bo Li, and Qifeng Chen
AAAI 2021 Workshop
MFuseNet: Robust Depth Estimation with Learned Multiscopic Fusion
Weihao Yuan, Rui Fan, Michael Yu Wang, and Qifeng Chen
International Conference on Robotics and Automation (ICRA), 2020
IEEE Robotics and Automation Letters, 2020
Hiding Video in Audio via Reversible Generative Models
Hyukyrul Yang*, Hao Ouyang*, Vladlen Koltun, and Qifeng Chen
International Conference on Computer Vision (ICCV), 2019
High-quality video reconstruction from raw sensor data.
Seeing Motion in the Dark
Chen Chen, Qifeng Chen, Minh Do, and Vladlen Koltun
Full Oral Presentation (4.3% acceptance rate)
The first dedicated video colorization method without any user input.
Fully Automatic Video Colorization with Self-Regularization and Diversity
Conference on Computer Vision and Pattern Recognition (CVPR), 2019
A novel loss (CoBi) for slightly misalighned image-to-image translation.
Zoom to Learn, Learn to Zoom
Xuaner Zhang, Qifeng Chen, Ren Ng, and Vladlen Koltun
Supplement
3D Motion Decomposition for RGBD Future Dynamic Scene Synthesis
Xiaojuan Qi*, Zhengzhe Liu*, Qifeng Chen, and Jiaya Jia
Supplementary Video
Send an email to Xiaojuan or me for the source code.
Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search
Zhuwen Li, Qifeng Chen, and Vladlen Koltun
Conference on Neural Information Processing Systems (NeurIPS), 2018
Source code
Semi-parametric Image Synthesis
Xiaojuan Qi, Qifeng Chen, Jiaya Jia, and Vladlen Koltun
Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Full Oral Presentation (2.1% acceptance rate)
Code and data
Interactive Image Segmentation with Latent Diversity
Single Image Reflection Separation with Perceptual Losses
Xuaner Zhang, Ren Ng, and Qifeng Chen
Learning to See in the Dark
Chen Chen, Qifeng Chen, Jia Xu, and Vladlen Koltun
Speech Denoising with Deep Feature Losses
Francois G Germain, Qifeng Chen, and Vladlen Koltun
Interspeech 2019
arXiv preprint arXiv:1806.10522
Photographic Image Synthesis with Cascaded Refinement Networks
Qifeng Chen and Vladlen Koltun
International Conference on Computer Vision (ICCV), 2017
Fast Image Processing with Fully-Convolutional Networks
Qifeng Chen*, Jia Xu*, and Vladlen Koltun
Full Flow: Optical Flow Estimation By Global Optimization over Regular Grids
Conference on Computer Vision and Pattern Recognition (CVPR), 2016
Full Oral Presentation (3.9% acceptance rate)
Project website (with source code)
Dense Monocular Depth Estimation in Complex Dynamic Scenes
René Ranftl, Vibhav Vineet, Qifeng Chen, and Vladlen Koltun
Robust Nonrigid Registration by Convex Optimization
International Conference on Computer Vision (ICCV), 2015
Full Oral Presentation (3.3% acceptance rate)
Project website (with Matlab source code)
Fast MRF Optimization with Application to Depth Reconstruction
Conference on Computer Vision and Pattern Recognition (CVPR), 2014
Project website (with C++ and Matlab source code)
A Simple Model for Intrinsic Image Decomposition with Depth Cues
International Conference on Computer Vision (ICCV), 2013
Matlab source code (updated on 2 Dec 2015) Supplementary material Poster
Please email to sintel@tue.mpg.de for the MPI Sintel dataset.
Motion-Aware KNN Laplacian for Video Matting
Dingzeyu Li, Qifeng Chen, and Chi-Keung Tang
KNN Matting (with extension to layer color estimation)
Qifeng Chen, Dingzeyu Li, and Chi-Keung Tang
Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2013
Matlab source code (for layer color estimation)
KNN Matting
Conference on Computer Vision and Pattern Recognition (CVPR), 2012