Zhiyuan You (尤志远)

I am a first-year Ph.D. student of the joint program between MMLab, The Chinese University of Hong Kong (CUHK) and MMLab, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences (SIAT). I am supervised by Prof. Chao Dong and Prof. Tianfan Xue. I also work closely with Dr. Jinjin Gu.

Prior to that, I received my M.Eng. from Shanghai Jiao Tong University (SJTU) in 2023, supervised by Prof. Xinyi Le and Prof. Yu Zheng, and my B.Eng. from the same university in 2020. I spent a wonderful time in Horizon Robotics and SenseTime as a research intern, mentored by Dr. Yuelong Yu and Mr. Kai Yang, respectively.

My current research interest mainly lies in multi-modality vision for low-level vision, anomaly detection, few-shot learning, and industrial visual inspection.

CV  /  Google Scholar  /  Github
Email: zhiyuanyou [at] foxmail [dot] com

profile photo
Research

*: Equal Contribution, †: Corresponding Author

arXiv, preprint
Descriptive Image Quality Assessment in the Wild
Zhiyuan You, Jinjin Gu, Zheyuan Li, Xin Cai, Kaiwen Zhu, Chao Dong†, Tianfan Xue†
arXiv, 2024
paper / project page / code

We introduce DepictQA-Wild, a multi-functional in-the-wild descriptive image quality assessment model.

Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models
Zhiyuan You*, Zheyuan Li*, Jinjin Gu*, Zhenfei Yin, Tianfan Xue†, Chao Dong†
arXiv, 2023
paper / project page / code

We introduce DepictQA, leveraging Multi-modal Large Language Models, allowing for detailed, language-based, and human-like evaluation of image quality.

MaskMA: Towards Zero-Shot Multi-Agent Decision Making with Mask-Based Collaborative Learning
Jie Liu*, Yinmin Zhang*, Chuming Li, Zhiyuan You, Zhanhui Zhou, Chao Yang, Yaodong Yang†, Yu Liu, Wanli Ouyang
arXiv, 2023
paper

We release MaskMA, a masked pretraining framework for multi-agent decision-making.

Conference
A Unified Model for Multi-class Anomaly Detection
Zhiyuan You*, Lei Cui*, Yujun Shen, Kai Yang, Xin Lu, Yu Zheng, Xinyi Le†
NeurIPS, 2022   (Spotlight)
paper / code

We present UniAD that accomplishes anomaly detection for multiple classes with a unified framework.

Few-shot Object Counting with Similarity-Aware Feature Enhancement
Zhiyuan You, Kai Yang, Wenhan Luo, Xin Lu, Lei Cui, Xinyi Le†
WACV, 2023   (Oral)
paper / code / video

We propose a novel SAFECount block, equipped with a similarity comparison module and a feature enhancement module for few-shot object counting.

ADTR: Anomaly Detection Transformer with Feature Reconstruction
Zhiyuan You, Kai Yang, Wenhan Luo, Lei Cui, Yu Zheng, Xinyi Le†
ICONIP, 2022   (Oral)
paper

We propose ADTR to apply a transformer to reconstruct pre-trained features for anomaly detection, and propose novel losses to extend ADTR to anomaly-available case (both image-level & pixel-level labeled).

Journal
UTRAD: Anomaly detection and localization with u-transformer
Liyang Chen, Zhiyuan You, Nian Zhang, Juntong Xi, Xinyi Le†
Neural Networks, 2022
paper / code

We introduce UTRAD, a U-TRansformer based Anomaly Detection framework.

Education
Ph.D. Student in Information Engineering @ The Chinese University of Hong Kong
Aug. 2023 - Current
Advisor: Prof. Chao Dong and Prof. Tianfan Xue
M.Eng. in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2020 - Mar. 2023
Advisor: Prof. Xinyi Le and Prof. Yu Zheng
B.Eng. in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2016 - Jun. 2020
GPA: 3.78 / 4.0, Ranking: 5 / 148
Experience
Horizon Robotics
Research Intern
Shanghai, China
Dec. 2022 - Mar. 2023
Mentor: Dr. Yuelong Yu
Perception Algorithm for Autonomous Driving
SenseTime
Research Intern
Shanghai, China
Dec. 2020 - Nov. 2022
Mentor: Mr. Kai Yang
Anomaly Detection & Few-Shot Learning

Template from JonBarron