Zhiyuan You (尤志远)

I am a second-year first-year Ph.D. student of the joint program between MMLab, The Chinese University of Hong Kong (CUHK) and MMLab, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences (SIAT). I am supervised by Prof. Chao Dong and Prof. Tianfan Xue. I also work closely with Dr. Jinjin Gu.

Prior to that, I received my M.Eng. from Shanghai Jiao Tong University (SJTU) in 2023, supervised by Prof. Xinyi Le and Prof. Yu Zheng, and my B.Eng. from the same university in 2020. I spent a wonderful time in Horizon Robotics and SenseTime as a research intern, mentored by Dr. Yuelong Yu and Mr. Kai Yang, respectively.

My current research interest mainly lies in multi-modality vision for low-level vision, anomaly detection, few-shot learning, and industrial visual inspection.

CV  /  Google Scholar  /  Github
Email: zhiyuanyou [at] foxmail [dot] com

profile photo
News

[2024.07]    One paper to appear in ECCV 2024. See you in Milan.

[2023.08]    I become a Ph.D. student at MMLab in The Chinese University of Hong Kong.

Research

*: Equal Contribution, †: Corresponding Author

arXiv, preprint
Descriptive Image Quality Assessment in the Wild
Zhiyuan You, Jinjin Gu, Zheyuan Li, Xin Cai, Kaiwen Zhu, Chao Dong†, Tianfan Xue†
arXiv, 2024
paper / project page / code

We introduce DepictQA-Wild, a multi-functional in-the-wild descriptive image quality assessment model.

MaskMA: Towards Zero-Shot Multi-Agent Decision Making with Mask-Based Collaborative Learning
Jie Liu*, Yinmin Zhang*, Chuming Li, Zhiyuan You, Zhanhui Zhou, Chao Yang, Yaodong Yang†, Yu Liu, Wanli Ouyang
arXiv, 2023
paper

We release MaskMA, a masked pretraining framework for multi-agent decision-making.


Conference
Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models
Zhiyuan You*, Zheyuan Li*, Jinjin Gu*, Zhenfei Yin, Tianfan Xue†, Chao Dong†
European Conference on Computer Vision (ECCV), 2024
paper / project page / code

We introduce DepictQA, leveraging Multi-modal Large Language Models, allowing for detailed, language-based, and human-like evaluation of image quality.

Few-shot Object Counting with Similarity-Aware Feature Enhancement
Zhiyuan You, Kai Yang, Wenhan Luo, Xin Lu, Lei Cui, Xinyi Le†
Winter Conference on Applications of Computer Vision (WACV), 2023, Oral
paper / code / video

We propose a novel SAFECount block, equipped with a similarity comparison module and a feature enhancement module for few-shot object counting.

A Unified Model for Multi-class Anomaly Detection
Zhiyuan You*, Lei Cui*, Yujun Shen, Kai Yang, Xin Lu, Yu Zheng, Xinyi Le†
Neural Information Processing Systems (NeurIPS), 2022, Spotlight
paper / code

We present UniAD that accomplishes anomaly detection for multiple classes with a unified framework.

ADTR: Anomaly Detection Transformer with Feature Reconstruction
Zhiyuan You, Kai Yang, Wenhan Luo, Lei Cui, Yu Zheng, Xinyi Le†
International Conference on Neural Information Processing (ICONIP), 2022, Oral
paper

We propose ADTR to apply a transformer to reconstruct pre-trained features for anomaly detection, and propose novel losses to extend ADTR to anomaly-available case (both image-level & pixel-level labeled).


Journal
UTRAD: Anomaly detection and localization with u-transformer
Liyang Chen, Zhiyuan You, Nian Zhang, Juntong Xi, Xinyi Le†
Neural Networks (NN), 2022
paper / code

We introduce UTRAD, a U-TRansformer based Anomaly Detection framework.

Education
Ph.D. Student in Information Engineering @ The Chinese University of Hong Kong
Aug. 2023 - Current
Advisor: Prof. Chao Dong and Prof. Tianfan Xue
M.Eng. in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2020 - Mar. 2023
Advisor: Prof. Xinyi Le and Prof. Yu Zheng
B.Eng. in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2016 - Jun. 2020
GPA: 3.78 / 4.0, Ranking: 5 / 148
Experience
Horizon Robotics
Research Intern
Shanghai, China
Dec. 2022 - Mar. 2023
Mentor: Dr. Yuelong Yu
Perception Algorithm for Autonomous Driving
SenseTime
Research Intern
Shanghai, China
Dec. 2020 - Nov. 2022
Mentor: Mr. Kai Yang
Anomaly Detection & Few-Shot Learning

Template from JonBarron