Zhiyuan You (尤志远)
I am a second-year first-year Ph.D. student of the joint program between
MMLab, The Chinese University of Hong Kong
(CUHK) and
MMLab,
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences
(SIAT).
I am supervised by Prof. Chao Dong
and Prof. Tianfan Xue.
I also work closely with Dr. Jinjin Gu.
Prior to that, I received my M.Eng. from Shanghai Jiao Tong University
(SJTU) in 2023, supervised by
Prof. Xinyi Le and
Prof. Yu Zheng,
and my B.Eng. from the same university in 2020.
I spent a wonderful time in Horizon Robotics and
SenseTime as a research intern, mentored by
Dr. Yuelong Yu and
Mr. Kai Yang, respectively.
My current research interest mainly lies in multi-modality vision for
low-level vision, anomaly detection, few-shot learning, and industrial visual inspection.
CV  / 
Google Scholar
 / 
Github
Email: zhiyuanyou [at] foxmail [dot] com
|
|
News
[2024.07] One paper to appear in ECCV 2024. See you in Milan.
[2023.08] I become a Ph.D. student at MMLab in The Chinese University of Hong Kong.
|
Research
*: Equal Contribution, †: Corresponding Author
|
arXiv, preprint
|
|
Descriptive Image Quality Assessment in the Wild
Zhiyuan You,
Jinjin Gu, Zheyuan Li, Xin Cai, Kaiwen Zhu, Chao Dong†, Tianfan Xue†
arXiv, 2024
paper
/
project page
/
code
We introduce DepictQA-Wild, a multi-functional in-the-wild descriptive image quality
assessment model.
|
|
MaskMA: Towards Zero-Shot Multi-Agent Decision Making with Mask-Based Collaborative Learning
Jie Liu*, Yinmin Zhang*, Chuming Li, Zhiyuan You,
Zhanhui Zhou, Chao Yang, Yaodong Yang†, Yu Liu, Wanli Ouyang
arXiv, 2023
paper
We release MaskMA, a masked pretraining framework for multi-agent decision-making.
|
Conference
|
|
Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language
Models
Zhiyuan You*,
Zheyuan Li*, Jinjin Gu*, Zhenfei Yin, Tianfan Xue†, Chao Dong†
European Conference on Computer Vision (ECCV), 2024
paper
/
project page
/
code
We introduce DepictQA, leveraging Multi-modal Large Language Models, allowing for detailed,
language-based, and human-like evaluation of image quality.
|
|
Few-shot Object Counting with Similarity-Aware Feature Enhancement
Zhiyuan You,
Kai Yang, Wenhan Luo, Xin Lu, Lei Cui, Xinyi Le†
Winter Conference on Applications of Computer Vision (WACV), 2023, Oral
paper
/
code
/
video
We propose a novel SAFECount block, equipped with a similarity comparison module and a
feature enhancement module for few-shot object counting.
|
|
A Unified Model for Multi-class Anomaly Detection
Zhiyuan You*,
Lei Cui*, Yujun Shen, Kai Yang, Xin Lu, Yu Zheng, Xinyi Le†
Neural Information Processing Systems (NeurIPS), 2022, Spotlight
paper
/
code
We present UniAD that accomplishes anomaly detection for multiple classes with a unified
framework.
|
|
ADTR: Anomaly Detection Transformer with Feature Reconstruction
Zhiyuan You,
Kai Yang, Wenhan Luo, Lei Cui, Yu Zheng, Xinyi Le†
International Conference on Neural Information Processing (ICONIP), 2022, Oral
paper
We propose ADTR to apply a transformer to reconstruct pre-trained
features for anomaly detection, and propose novel losses to extend ADTR to
anomaly-available case (both image-level & pixel-level labeled).
|
Journal
|
|
UTRAD: Anomaly detection and localization with u-transformer
Liyang Chen,
Zhiyuan You,
Nian Zhang,
Juntong Xi,
Xinyi Le†
Neural Networks (NN), 2022
paper /
code
We introduce UTRAD, a U-TRansformer based Anomaly Detection framework.
|
|
Ph.D. Student in Information Engineering @ The Chinese University of Hong Kong
Aug. 2023 - Current
Advisor: Prof. Chao Dong and
Prof. Tianfan Xue
|
|
M.Eng. in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2020 - Mar. 2023
Advisor: Prof. Xinyi Le
and Prof. Yu Zheng
|
![](images/sjtu.png) |
B.Eng. in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2016 - Jun. 2020
GPA: 3.78 / 4.0, Ranking: 5 / 148
|
|
Horizon Robotics
Research Intern
Shanghai, China
Dec. 2022 - Mar. 2023
Mentor: Dr. Yuelong
Yu
Perception Algorithm for Autonomous Driving
|
|
SenseTime
Research Intern
Shanghai, China
Dec. 2020 - Nov. 2022
Mentor: Mr. Kai Yang
Anomaly Detection & Few-Shot Learning
|
|