张宇
职称:副高
所在院系:计算机科学系
研究方向:计算机视觉和机器学习,包括图像识别、目标检测、行为图像/视频分析、3D姿态识别、文本图像/视频多模态学习等。
电话:
邮箱:zhang_yu@seu.edu.cn
职务:
个人简介

副教授,博导


本科和硕士毕业于西安电子科技大学通信工程专业,博士毕业于新加坡南洋理工大学计算机工程专业。曾在新加坡高级数字科学中心(ADSC, University of Illinois)及新加坡生物资讯研究所(BII, A*STAR)就职,目前是东南大学计算机学院PALM实验室成员主要研究方向为计算机视觉和机器学习,包括大规模图像识别、细粒度图像识别、多标签图像识别、行为图像/视频分析、3D姿态识别、OCR检测与识别等领域,并在多个计算机视觉顶级会议及期刊CVPRECCVTPAMIIJCVTIPPR等发表过论文。荣获江苏省双创博士、东南大学紫金青年学者称号。目前担任江苏省计算机学会青年工作委员会副主任和《Frontiers of Computer Science》青年编委。主持、参与二十余项国家级、省部级、横向合作项目。长期与国内外知名机构保持密切合作,包括:美国UIUC大学、美国Intel实验室、加拿大Alberta大学、澳洲Monash大学、新加坡NTU、新加坡ASTAR研究所、阿里达摩院、腾讯优图实验室等,有各种交流机会。


每年有多个硕士、博士、博士后、科研助理名额,欢迎申请和报考!


E-mail: zhang_yu at seu.edu.cn

联系地址:南京市江宁区东南大学计算机学院532。




研究方向
教育经历
工作经历
科研项目

6.面向不充分信息的神经网络模型研究,科技部重点研发项目。(参与)

5.机器人视觉仿真平台。(主持)

4.机动车安全技术检验之智能审核系统审核模块。(主持)

3.多源不确定数据挖掘方法与技术,科技部重点研发项目。(参与)

2. 基于视觉的智能无人货柜中人机交互技术的研究,江苏省双创博士(主持)

1. 基于深度骨架模型的多模态多视角3D手势识别的研究, 国家自然科学青年基金。(主持)


论文著作

Selected paper:

12.Fan Lin, Shuyi Xie, Yong Dai, Wenlin Yao, Tianjiao Lang, Yu Zhang, IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation, 38th Conference on Neural Information Processing Systems (NeurIPS 2024), 2024. (CCF A 推荐论文)

11.Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang, Learning Trajectory-Word Alignments for Video-Language Tasks,ICCV, 2023. (CCF A 推荐论文)

10.Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Ming Yan, Fei Huang, Zhangzikang Li, Yu Zhang, Transforming Visual Scene Graphs to Image Captions, ACL, 2023.(CCF A 推荐论文)

9. X. Geng, R. Zheng, J. Lv, and Y. Zhang. Multilabel Ranking with Inconsistent Rankers. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2021.(CCF A 推荐论文)

8. X. Geng, X. Qian, Z. Huo, and Y. Zhang. Head Pose Estimation Based on Multivariate Label Distribution. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2020.(CCF A 推荐论文)

7.Y. Gao, Y. Zhang, X. Geng, Label Enhancement for Label Distribution Learning via Prior Knowledge, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020.(CCF A 推荐论文)

6.Y. Liu, N. Xu, Y. Zhang, X. Geng, Label Distribution for Learning with Noisy Labels, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020.(CCF A 推荐论文)

5. Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng, Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups, International Journal of Computer Vision, 2017, pp. 1-25.(CCF A 推荐论文)

4. Yu Zhang, Li Cheng, Jianxin Wu, Jianfei Cai, Minh N. Do, and Jiangbo Lu, Action Recognition in Still Images with Minimum Annotation Efforts,  IEEE Transactions on Image Processing, 2016.(CCF A 推荐论文)
3. Yu Zhang, Jianxin Wu, Jianfei Cai,Compact Representation of High-Dimensional Feature Vectors for Large-Scale Image Recognition and Retrieval, IEEE Transactions on Image Processing, 2016.(CCF A 推荐论文)
2. Yu Zhang, Xiu-Shen Wei, Jianxin Wu, Jianfei Cai, Jiangbo Lu, Viet-Anh Nguyen, Minh N. Do, Weakly Supervised Fine-Grained Categorization with Part-Based Image Representation, IEEE Transactions on Image Processing, 2016.(CCF A 推荐论文)
1. Yu Zhang,  Jianxin Wu, Jianfei Cai, Weiyao Lin, Flexible Image Similarity Computation Using Hyper-Spatial Matching, IEEE Transactions on Image Processing, 2014.(CCF A 推荐论文)


Journal paper list:

32. Jiale Chang,Zhengxiao Zhou,Siya Mi,Yu Zhang, Radio Frequency Fingerprint Recognition Method Based on Prior InformationComputers and Electrical Engineering, 2024.

31. Yu Zhang, Zhengjie Chen, Tianyu Xu, Junjie Zhao, Siya Mi, Xin Geng, Min-Ling Zhang, Temporal Segment Dropout for Human Action Video Recognition, Pattern Recognition, 2024.

30. Yu Zhang, Sichen Cao, Siya Mi, Yali Bian, Learning sample representativeness for class‑imbalanced multi‑label classifcation, Pattern Analysis and Applications, 2024.

29. Zhengjie Chen, Yu Zhang, Siya Mi, Assisting Multimodal Named Entity Recognition by cross-modal auxiliary tasks, Pattern Recognition Letters, 2023.

28. Jiale Chang, Yanhui Wang, Siya Mi, Yu Zhang, MVL-Tra: Multi-View LFM Signal Source Classification Using Transformer, Computers and Electrical Engineering, 2023.

27. Wei Xiong, Haoliang Liu, Siya Mi and Yu Zhang, Asymmetric Bi-Encoder for Image-text Retrieval, Multimedia Systems, 2023. 

26. Yu Zhang, Fan Lin, Siya Mi, Yali Bian, Self-label correction for image classification with noisy labels, Pattern Analysis and Applications, 2023.

25. Yu Zhang, Junjie Zhao, Zhengjie Chen, Siya Mi, Hongyuan Zhu, and Xin Geng, A Closer Look at Video Sampling for Sequential Action Recognition, IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2023.

24. 张宇,徐天宇,米思娅,基于标记分布的视频动作质量评估,中国图象图形学报,2023.

23. Zihan Chen, Hongyuan Zhu, Hao Cheng, Siya Mi, Yu Zhang, Xin Geng, LPCL: Localized Prominence Contrastive Learning for Self-Supervised Dense Visual Pre-training, Pattern Recognition, 2022.

22. Haoyu Ma, Ningning Lu, Junjun Mei, Tao Guan, Yu Zhang, Xin Geng, Label Distribution Learning for Scene Text Detection, Frontiers of Computer Science (FCS), 2022.

21. Liu, Haoliang; Xiong, Wei; Zhang, Yu, YOLO-CORE: Contour Regression for Efficient Instance Segmentation, Machine Intelligence Research, 2022.

20. Yu Zhang, Zihua Wang, Jingyang Zhou, Siya Mi, Person Video Alignment with Human Pose Registration, Frontiers of Computer Science (FCS), 2022.

19. Yu Zhang, Wei Xiong, Siya Mi, Learning time-aware features for action quality assessment, Pattern Recognition Letters, 158, 2022, 104-110.

18. Siya Mi, Youwei An, Yu Zhang, A content-independent method for LFM signal source identification, AEU - International Journal of Electronics and Communications, 143, 2022. 

17. Hongsheng Xu, Zihan Chen, Yu Zhang, Xin Geng, Siya Mi, Zhihong Yang, Weakly Supervised Temporal Action Localization with Proxy Metric Modeling, Frontiers of Computer Science (FCS), 2021.

16. Siya Mi, Yu Zhang, Pose-Guided Action Recognition in Static Images using Lie-Group, Applied Intelligence, 2021.

15. 张宇,温光照,米思娅,张敏灵,耿新, 基于深度学习的二维人体姿态估计综述,软件学报,2021.

14. X. Geng, R. Zheng, J. Lv, and Y. Zhang. Multilabel Ranking with Inconsistent Rankers. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2021, in press.

13. Yu Zhang, Xinyu Shi, Siya Mi, Xu Yang, Image captioning with transformer and knowledge graph, Pattern Recognition Letters, 143, 2021, 43-49.

12. X. Geng, X. Qian, Z. Huo, and Y. Zhang. Head Pose Estimation Based on Multivariate Label Distribution. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2020, in press.

11. Yu Zhang, Siya Mi, Jianxin Wu, Xin Geng, Simultaneous 3D hand detection and pose estimation using single depth images, Pattern Recognition Letters, 140, 2020, 43-48.

10. Yu Zhang, Yin Wang, Xu-Ying Liu, Siya Mi, Min-Ling Zhang, Large-Scale Multi-Label Classification using Unknown Streaming Images, Pattern Recognition, 99, 2020.

9. H. Zhang, Y. Zhang, and X. Geng. Practical Age Estimation Using Deep Label Distribution Learning. Frontiers of Computer Science (FCS), 2020, in press.

8. Huiying Zhang, Xin Geng, Yu Zhang, Fanyong Cheng,  Recurrent age estimation, Pattern Recognition Letters, 2019, 125: 271-277.

7. Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng, Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups, International Journal of Computer Vision, 2017, pp. 1-25.

6. Yu Zhang, Li Cheng, Jianxin Wu, Jianfei Cai, Minh N. Do, and Jiangbo Lu, Action Recognition in Still Images with Minimum Annotation Efforts,  IEEE Transactions on Image Processing, 2016.
5. Yu Zhang, Jianxin Wu, Jianfei Cai,Compact Representation of High-Dimensional Feature Vectors for Large-Scale Image Recognition and Retrieval, IEEE Transactions on Image Processing, 2016.
4. Yu Zhang, Xiu-Shen Wei, Jianxin Wu, Jianfei Cai, Jiangbo Lu, Viet-Anh Nguyen, Minh N. Do, Weakly Supervised Fine-Grained Categorization with Part-Based Image Representation, IEEE Transactions on Image Processing, 2016.
3. Jianxin Wu, Yu Zhang, Weiyao Lin, Good Practices for Learning to Recognize Actions using FV and VLAD, IEEE Transactions on Cybernetics, 2015.
2. Yu Zhang,  Jianxin Wu, Jianfei Cai, Weiyao Lin, Flexible Image Similarity Computation Using Hyper-Spatial Matching, IEEE Transactions on Image Processing, 2014.
1. Yu Zhang, Zhaoyang Lu, Jing Li, Fabric defect classification using radial basis function network, Pattern Recognition Letters, 2010.


Conference paper list:

18.Fan Lin, Shuyi Xie, Yong Dai, Wenlin Yao, Tianjiao Lang, Yu Zhang, IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation, 38th Conference on Neural Information Processing Systems (NeurIPS 2024), 2024. 

17.Yihang Meng, Hao Cheng, Zihua Wang, Hongyuan Zhu, Xiuxian Lao, and Yu Zhang, Efficient Multi-modal Human-centric Contrastive Pre-training with A Pseudo Body-structured Prior, PRCV, 2024.

16.Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang, Learning Trajectory-Word Alignments for Video-Language Tasks,ICCV, 2023.

15.Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Ming Yan, Fei Huang, Zhangzikang Li, Yu Zhang, Transforming Visual Scene Graphs to Image Captions, ACL, 2023.

14.Xinyu Shi, Dong Wei, Yu Zhang, Donghuan Lu, Munan Ning, Jiashun Chen, Kai Ma, and Yefeng Zheng, Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation, ECCV, 2022.

13.Jiashun Chen, Donghuan Lu, Yu Zhang, Dong Wei, Munan Ning, Xinyu Shi, Zhe Xu, and Yefeng Zheng, Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration, International Conference on Medical Imaging Computing and Computer Assisted Intervention (MICCAI), Singapore, 2022.

12.Zhou, Y., Bai, S., Zhou, T., Zhang, Y., Fu, H., 2022. Delving into Local Features for Open-Set Domain Adaptation in Fundus Image Analysis. International Conference on Medical Imaging Computing and Computer Assisted Intervention (MICCAI), Singapore, 2022.

11.Junjie Zhao, Donghuan Lu, Kai Ma, Yu Zhang, Yefeng Zheng, Deep Image Clustering with Category-Style Representation, ECCV 2020, in press.

10.Y. Gao, Y. Zhang, X. Geng, Label Enhancement for Label Distribution Learning via Prior Knowledge, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020, in press.

9.Y. Liu, N. Xu, Y. Zhang, X. Geng, Label Distribution for Learning with Noisy Labels, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020, in press.

8. Haiping Lu, Jianxin Wu, Yu Zhang, Learning Compact Binary Codes from Higher-Order Tensors via Free-Form Reshaping and Binarized Multilinear PCA, IJCNN 2016.
7. Hao Yang, Joey Tianyi Zhou, Yu Zhang, Bin-Bin Gao, Jianxin Wu, Jianfei Cai, Exploit Bounding Box Annotations for Multi-label Object Recognition, CVPR 2016.
6. Tianyi Zhang, Yu Zhang, Jianfei Cai, Alex Kot, Efficient Object Feature Selection for Action Recognition, ICASSP, 2016.
5. Yu Zhang, Jianxin Wu, Jianfei Cai, Weakly Supervised Fine-Grained Image Categorization by Object Selection, Third Workshop on Fine-Grained Visual Categorization (FGVC3), CVPRW 2015.
4. Yu Zhang, Jianxin Wu, Jianfei Cai, Compact Representation for Image Classification: To Choose or to Compress? CVPR 2014.
3. Jianxin Wu, Yu Zhang, Weiyao Lin, Towards Good Practices for Action Video Encoding, CVPR 2014
2. Yu Zhang, Jianxin Wu, Weiyao Lin, Exclusive Visual Descriptor Quantization, ACCV 2012.
1. Yu Zhang, Zhaoyang Lu, Jing Li, Fabric defect detection and classification using gabor filters and gaussian mixture model, ACCV 2010.


专利
获奖情况

Demos of our works:

1. Age estimation: 年龄识别demo.mp4

2. Hand action recognition: 手势行为识别.mp4

3. Face detection and recognition:人脸识别.mp4


  • 联系方式
  • 通信地址:南京市江宁区东南大学路2号东南大学九龙湖校区计算机学院
  • 邮政编码:211189
  • ​办公地点:东南大学九龙湖校区计算机楼
  • 学院微信公众号