Hongli Zhou (周宏理)

About Me

I am currently a Ph.D. student in Computer Science at MI&T Lab, Faculty of Computing, Harbin Institute of Technology (HIT). My supervisor is Prof. Muyun Yang.

My research focuses on Large Language Models (LLMs). Key areas include:

(* equal contribution, ^# corresponding author)

Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory
Hongli Zhou*, Hui Huang*, Ziqing Zhao, Lvyuan Han, Huicheng Wang, Kehai Chen, Muyun Yang^#, Wei Bao^#, Jian Dong^#, Bing Xu, Conghui Zhu, Hailong Cao, Tiejun Zhao
Preprint, 2025
[Paper] [Code]
Think-J: Learning to Think for Generative LLM-as-a-Judge
Hui Huang*, Yancheng He*, Hongli Zhou*, Rui Zhang, Wei Liu, Weixun Wang, Wenbo Su, Bo Zheng, Jiaheng Liu^#
Preprint, 2025
[Paper] [Code]
An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4
Hui Huang*, Xingyuan Bu*, Hongli Zhou*, Yingqi Qu, Jing Liu, Muyun Yang^#, Bing Xu, Tiejun Zhao
Findings of Association for Computational Linguistics (ACL), 2025
[Paper] [Code]
Mitigating the Bias of Large Language Model Evaluation
Hongli Zhou, Hui Huang, Yunfei Long, Bing Xu, Conghui Zhu, Hailong Cao, Muyun Yang^#, Tiejun Zhao
China National Conference on Computational Linguistics (CCL), 2024
[Paper] [Code]
新质生产力背景下环保公益游戏设计策略探析
张子墨, 刘柏亨^#, 周宏理
艺术科技, 2024
[Paper]

[04/2025] Second-Class People Scholarship, Harbin Institute of Technology
[11/2023] Excellent Student, Harbin Institute of Technology
[11/2022] First Prize in Heilongjiang Province, Contemporary Undergraduate Mathematical Contest in Modeling