profile image

Hongli Zhou

Undergraduate Student @ HIT

Contact Me

About Me

I am a senior undergraduate student at Harbin Institute of Technology (HIT), majoring in Digital Media Technology. I am part of the MI&T Lab at HIT, advised by Prof. Muyun Yang. I will become a Ph.D. student in Computer Science at HIT in Fall 2025.

My research focuses on Large Language Models (LLMs). Key areas include:

  • LLM Evaluation
    • LLM-as-a-Judge
    • LLM Benchmarking
  • Reward Modeling

News

  • [05/2025] One paper is accepted to ACL 2025 Findings.
  • [09/2024] I'm admitted as a direct Ph.D. student in CS at HIT.
  • [05/2024] My first paper is accepted to CCL 2024.

Publications

(* equal contribution, # corresponding author)
  • Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory
    Hongli Zhou*, Hui Huang*, Ziqing Zhao, Lvyuan Han, Huicheng Wang, Kehai Chen, Muyun Yang#, Wei Bao#, Jian Dong#, Bing Xu, Conghui Zhu, Hailong Cao, Tiejun Zhao
    Preprint, 2025
    [Paper] [Code]
  • Think-J: Learning to Think for Generative LLM-as-a-Judge
    Hui Huang*, Yancheng He*, Hongli Zhou*, Rui Zhang, Wei Liu, Weixun Wang, Wenbo Su, Bo Zheng, Jiaheng Liu#
    Preprint, 2025
    [Paper] [Code]
  • An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4
    Hui Huang*, Xingyuan Bu*, Hongli Zhou*, Yingqi Qu, Jing Liu, Muyun Yang#, Bing Xu, Tiejun Zhao
    Findings of Association for Computational Linguistics (ACL), 2025
    [Paper] [Code]
  • Mitigating the Bias of Large Language Model Evaluation
    Hongli Zhou, Hui Huang, Yunfei Long, Bing Xu, Conghui Zhu, Hailong Cao, Muyun Yang#, Tiejun Zhao
    China National Conference on Computational Linguistics (CCL), 2024
    [Paper] [Code]
  • 新质生产力背景下环保公益游戏设计策略探析
    张子墨, 刘柏亨#, 周宏理
    艺术科技, 2024
    [Paper]

Honors and Awards

  • [04/2025] Second-Class People's Scholarship, Harbin Institute of Technology
  • [11/2023] Excellent Student, Harbin Institute of Technology
  • [11/2022] First Prize in Heilongjiang Province, Contemporary Undergraduate Mathematical Contest in Modeling