Zhiyuan You (尤志远)

I am a first-year Ph.D. student from MMLab, The Chinese University of Hong Kong, supervised by Prof. Tianfan Xue and Prof. Chao Dong. I received both my Bachelor's and Master's degrees from Shanghai Jiao Tong University, supervised by Prof. Xinyi Le and Prof. Yu Zheng.

I spent a wonderful time in Horizon Robotics and SenseTime as a research intern, mentored by Dr. Yuelong Yu and Mr. Kai Yang, respectively.

My current research interest mainly lies in multi-modality vision for low-level vision.

CV  /  Google Scholar  /  Github
Email: zhiyuanyou [at] foxmail [dot] com

profile photo
Research

My previous work mainly focused on anomaly detection, few-shot learning, and industrial visual inspection. (*: Equal Contribution, †: Corresponding Author)

Arxiv, preprint
Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models
Zhiyuan You*, Zheyuan Li*, Jinjin Gu*, Zhenfei Yin, Tianfan Xue†, Chao Dong†
Arxiv, 2023
paper / project page

We introduce DepictQA, leveraging Multi-modal Large Language Models, allowing for detailed, language-based, and human-like evaluation of image quality.

Conference
A Unified Model for Multi-class Anomaly Detection
Zhiyuan You*, Lei Cui*, Yujun Shen, Kai Yang, Xin Lu, Yu Zheng, Xinyi Le†
NeurIPS, 2022   (Spotlight)
paper / code

We present UniAD that accomplishes anomaly detection for multiple classes with a unified framework.

Few-shot Object Counting with Similarity-Aware Feature Enhancement
Zhiyuan You, Kai Yang, Wenhan Luo, Xin Lu, Lei Cui, Xinyi Le†
WACV, 2023   (Oral)
paper / code / video

We propose a novel SAFECount block, equipped with a similarity comparison module and a feature enhancement module for few-shot object counting.

ADTR: Anomaly Detection Transformer with Feature Reconstruction
Zhiyuan You, Kai Yang, Wenhan Luo, Lei Cui, Yu Zheng, Xinyi Le†
ICONIP, 2022   (Oral)
paper

We propose ADTR to apply a transformer to reconstruct pre-trained features for anomaly detection, and propose novel losses to extend ADTR to anomaly-available case (both image-level & pixel-level labeled).

Journal
UTRAD: Anomaly detection and localization with u-transformer
Liyang Chen, Zhiyuan You, Nian Zhang, Juntong Xi, Xinyi Le†
Neural Networks, 2022
paper / code

We introduce UTRAD, a U-TRansformer based Anomaly Detection framework.

Education
Ph.D. Student in Information Engineering @ The Chinese University of Hong Kong
Aug. 2023 - Current
Advisor: Prof. Tianfan Xue and Prof. Chao Dong
M.Eng in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2020 - Mar. 2023
Advisor: Prof. Xinyi Le and Prof. Yu Zheng
B.Eng in Mechanical Engineering @ Shanghai Jiao Tong University
Sep. 2016 - Jun. 2020
GPA: 3.78 / 4.0, Ranking: 5 / 148
Experience
Horizon Robotics
Research Intern
Shanghai, China
Dec. 2022 - Mar. 2023
Mentor: Dr. Yuelong Yu
Perception Algorithm for Autonomous Driving
SenseTime
Research Intern
Shanghai, China
Dec. 2020 - Nov. 2022
Mentor: Mr. Kai Yang
Anomaly Detection & Few-Shot Learning

Template from JonBarron