Nanxuan (Cherry) Zhao

nanxuanzhao [at] gmail [dot] com

About


I am a Research Scientist at Adobe Research. I was previously an Assistant Professor in the Department of Computer Science, University of Bath, and fortunate to work as a Postdoctoral Researcher at MMLab@The Chinese University of Hong Kong, advised by Prof. Dahua Lin. I received my Ph.D. degree from the Department of Computer Science, City University of Hong Kong under the supervision of Prof. Rynson W.H. Lau. During my Ph.D. study, I was lucky to be a visiting scholar at VCG@Harvard University under the supervision of Prof. Hanspeter Pfister, and closely collaborated with Zoya Bylinskii from Adobe Research. I was also lucky to work with Steve Lin and Zhirong Wu as an intern at Microsoft Research Asia (MSRA).

My research lies in the areas of computer graphics, computer vision/machine learning, and human-computer interaction. Recently I am interested in using data wisely for content generation & editing and data-driven graphic design. I am more focus on multi-modal control for customizing pixels, vectors, and 3D shapes.

We are actively looking for research interns. If you are interested in doing research project(s) at Adobe or remote collaboration with me, please drop me an email with your CV.



Selected Publications


GroupDiff: Diffusion-based Group Portrait Editing

Yuming Jiang, Nanxuan Zhao, Qing Liu, Krishna kumar Singh, Shuai Yang, Chen Change Loy, Ziwei Liu

European Conference on Computer Vision (ECCV), 2024


arXiv




SwapAnything: Enabling Arbitrary Object Swapping in Personalized Image Editing

Jing Gu, Nanxuan Zhao, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, HyunJoon Jung, Yilin Wang, Xin Eric Wang

European Conference on Computer Vision (ECCV), 2024


Project arXiv Code


GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting

Kai Zhang, Sai Bi, Hao Tan, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, Zexiang Xu

European Conference on Computer Vision (ECCV), 2024


Project arXiv


Text-to-vector Generation With Neural Path Representation

Peiying Zhang, Nanxuan Zhao, Jing Liao

ACM Transactions on Graphics (Proc. SIGGRAPH 2024)


Project arXiv


IntrinsicDiffusion: Joint Intrinsic Layers From Latent Diffusion Models

Jundan Luo, Duygu Ceylan, Jae Shin Yoon, Nanxuan Zhao, Julien Philip, Anna Frühstück, Wenbin Li, Christian Richardt, Tuanfeng Wang

Siggraph 2024


Project


NIVeL: Neural Implicit Vector Layers for Text-to-Vector Generation

Vikas Thamizharasan, Difan Liu, Matthew Fisher, Nanxuan Zhao, Evangelos Kalogerakis, Michal Lukáč

Computer Vision and Pattern Recognition (CVPR), 2024


Project arXiv





Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation

Mohammad Amin Shabani, Zhaowen Wang, Difan Liu, Nanxuan Zhao, Jimei Yang, Yasutaka Furukawa

Computer Vision and Pattern Recognition (CVPR), 2024


Project


Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Tasks

Yuhao Liu, Zhanghan Ke, Fang Liu, Nanxuan Zhao, Rynson W.H. Lau

Computer Vision and Pattern Recognition (CVPR), 2024


Project arXiv


Personalizing Products with Stylized Head Portraits for Self-Expression

Yang Shi, Yechun Peng, Shengqi Dang, Nanxuan Zhao, Nan Cao

ACM Conference on Human Factors in Computing Systems (CHI), 2024


Paper Video


Localizing and Editing Knowledge in Text-to-Image Generative Models

Samyadeep Basu, Nanxuan Zhao, Vlad Morariu, Soheil Feizi, Varun Manjunatha

International Conference on Learning Representations (ICLR) 2023


arXiv


PHOTOSWAP: Personalized Subject Swapping in Images

Jing Gu, Yilin Wang, Nanxuan Zhao, Tsu-Jui Fu, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, HyunJoon Jung, Xin Eric Wang

Conference on Neural Information Processing Systems (NeurIPS) 2023


arXiv Project


Text-Guided Vector Graphics Customization

Peiying Zhang, Nanxuan Zhao, Jing Liao

SIGGRAPH Asia 2023


arXiv Project


Bring Clipart to Life

Nanxuan Zhao, Shengqi Dang, Hexun Lin, Yang Shi, Nan Cao

International Conference on Computer Vision (ICCV), 2023


PDF Project


AssetField: Assets Mining and Reconfiguration in Ground Feature Plane Representation

Yuanbo Xiangli, Linning Xu, Xingang Pan, Nanxuan Zhao, Bo Dai, Dahua Lin

International Conference on Computer Vision (ICCV), 2023


arXiv Project


Language-based Photo Color Adjustment for Graphic Designs

Zhenwei Wang*, Nanxuan Zhao*, Gerhard Hancke, Rynson W.H. Lau

ACM Transactions on Graphics (Proc. SIGGRAPH 2023)


arXiv Project


FashionTex: Controllable Virtual Try-on with Text and Texture

Anran Lin, Nanxuan Zhao, Shuliang Ning, Yuda Qiu, Baoyuan Wang, Xiaoguang Han

SIGGRAPH 2023


arXiv


Neural Preset for Color Style Transfer

Zhanghan Ke, Yuhao Liu, Lei Zhu, Nanxuan Zhao, Rynson W.H. Lau

Computer Vision and Pattern Recognition (CVPR), 2023


arXiv Project Code Online Demo IOS App


Grid-guided Neural Radiance Fields for Large Urban Scenes

Linning Xu, Yuanbo Xiangli, Sida Peng, Xingang Pan, Nanxuan Zhao, Christian Theobalt, Bo Dai, Dahua Lin

Computer Vision and Pattern Recognition (CVPR), 2023


arXiv Project


UniColor: A Unified Framework for Multi-Modal Colorization with Transformer

Zhitong Huang*, Nanxuan Zhao*, Jing Liao

ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2022)


arXiv Project Code


Make Your Own Sprites: Aliasing-Aware and Cell-Controllable Pixelization

Zongwei Wu, Liangyu Chai, Nanxuan Zhao, Bailin Deng, Yongtuo Liu, Qiang Wen, Junle Wang, and Shengfeng He

ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2022)


Paper Code


BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering

Yuanbo Xiangli*, Linning Xu*, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, and Dahua Lin

European Conference on Computer Vision (ECCV), 2022


arxiv Project Code


TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognition

Haodong Duan, Nanxuan Zhao#, Kai Chen, Dahua Lin

Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)


arXiv Code


BlockPlanner: City Block Generation with Vectorized Graph Representation

Linning Xu*, Yuanbo Xiangli*, Anyi Rao, Nanxuan Zhao, Bo Dai, Ziwei Liu, Dahua Lin

International Conference on Computer Vision (ICCV), 2021


Paper Supp


Selective Region-based Photo Color Adjustment for Graphic Designs

Nanxuan Zhao, Quanlong Zheng, Jing Liao, Ying Cao, Hanspeter Pfister, Rynson W. H. Lau

ACM Transactions on Graphics (presented at SIGGRAPH 2021 and VIS 2021)


PDF Project


What Makes Instance Discrimination Good for Transfer Learning?

Nanxuan Zhao*, Zhirong Wu*, Rynson W. H. Lau, Stephen Lin

International Conference on Learning Representations (ICLR), 2021


arXiv Project


Distilling Localization for Self-Supervised Representation Learning

Nanxuan Zhao*, Zhirong Wu*, Rynson W. H. Lau, Stephen Lin

AAAI Conference on Artificial Intelligence (AAAI), 2021


arXiv Project


How Much Time Do You Have? Modeling Multi-duration Saliency

Camilo Fosco*, Anelise Newman*, Pat Sukhum, Yun Bin Zhang, Nanxuan Zhao, Aude Oliva, Zoya Bylinskii

Computer Vision and Pattern Recognition (CVPR), 2020


PDF Project


Exploring Visual Information Flows in Infographics

Min Lu, Chufeng Wang, Joel Lanir, Nanxuan Zhao, Hanspeter Pfister, Daniel Cohen-Or, Hui Huang

ACM Conference on Human Factors in Computing Systems (CHI), 2020


PDF Video Demo


ICONATE: Automatic Compound Icon Generation and Ideation

Nanxuan Zhao, Nam Wook Kim, Laura Mariah Herman, Hanspeter Pfister, Rynson W.H. Lau, Jose Echevarria, Zoya Bylinskii

ACM Conference on Human Factors in Computing Systems (CHI), 2020


PDF Project


Modeling Fonts in Context: Font Prediction on Web Designs

Nanxuan Zhao, Ying Cao, Rynson W.H. Lau

Computer Graphics Forum (Proc. Pacific Graphics 2018)


PDF Project


What Characterizes Personalities of Graphic Designs?

Nanxuan Zhao, Ying Cao, Rynson W.H. Lau

ACM Transactions on Graphics (Proc. SIGGRAPH 2018)


PDF Project


Experience and Collaborations