Person's photo

Qingyu Yin
Bachelor in English and Computer Science
Devoted to LLM, Interpretability and ML System
Zhejiang University / HICAI / ZJUNLP
Blog (Recommended)    GitHub    Email    Google Scholar    Zhihu    LinkedIn   

Latest News
29 / 9 / 2023
Our paper StableMask has been accepted by ICML'24!

20 / 1 / 2024
We have launched a review focused on the field of ScienceLLM! See Scientific Large Language Models: A Survey on Biochemical Domain.

all news
About Me
Hi there! My name is Qingyu Yin, and I am an undergraduate student from Zhejiang University, class of 2022. I am currently pursuing a dual degree in English and Computer Science. At present, I am fortunate to be interning at the HIC AI Lab with Prof. Qiang Zhang as my tutor. I'm also collaborating with Prof. Xiaoyu Shen from East Institute of Technology, Ningbo.

My research interests lie at (1) advanced architectures designed for future LLM, as well as (2) utilizing machine learning system techniques (hardware-efficient algorithm, cuda kernels, etc.) to advance scientific research in the field of LLM architecture . My work is dedicated to discovering more efficient LLM infrastructure and developing a universal framework suitable for various downstream task scenarios, while exploring the interpretability of these models.

I also focus on genomics and transcriptomics, and am exploring how to use AI tools to accelerate scientific discoveries in related fields.

This Page's design style comes from danfu.org. Thanks @DanFu_Stanford !


Leap into that sea of light.
跃入那光那海
--- Sonny Boy
PUBLICATIONS
StableMask: Refining Causal Masking in Decoder-only Transformer
[ICML'24]

Qingyu Yin, Xuzheng He, Xiang Zhuang, Yu Zhao, Jianhua Yao, Xiaoyu Shen, Qiang Zhang
ArXiv / Github / Notion / X(Twitter)

Scientific Large Language Models: A Survey on Biochemical Domain
Qiang Zhang*, Keyan Ding*, Tianwen Lyu, Xinda Wang, Qingyu Yin, Yiwen Zhang, Jing Yu, Zhouyi Xiang, Xiang Zhuang, Zeyuan Wang, Mengyao Zhang, Ming Qin, Renjun Xu, Huajun Chen†
ArXiv / Github / X(Twitter)

DLCNet: Enabling Data-Dependency into Long-Range Convolution
[Unpublished]

Qingyu Yin, Xiang Zhuang, Qiang Zhang†, Keyan Ding†
OpenReview
ALL NEWS
20 / 1 / 2024
We have launched a review focused on the field of ScienceLLM! See Scientific Large Language Models: A Survey on Biochemical Domain.

29 / 9 / 2023
Our paper DLCNet: Enabling Data-Dependency into Long-Range Convolution has been submitted to ICLR 2024!

19 / 7 / 2023
Talking with Prof. Jiannong Cao's team from Hongkong Polytechnique University

8 / 7 / 2023
Joined WAIC 2023, Automation Intelligence Molecular Manufacturing Conference and 'AI+Chemistry and Chemical Engineering' Sub-forum as a visitor

10 / 3 / 2023
Joined HIC-ZJU Prof. Qiang Zhang's Lab as an intern student

1 / 9 / 2022
Freshman of ZJU Class of 2022

20 / 10 / 2020
Got award of NOIP Shandong Second Prize, top 200
Got award of CSP Shandong Second Prize
Got award of NOIP Zibo First Prize, top 5

PROJECTS
MiniChatGPT
We designed a web-based ChatGPT interface program using Python, JavaScript, and MySQL. It includes features such as hotword search and data storage. Our project has successfully passed the course's evaluation.

OneAPI-based DeepLearning Architecture
Inter oneAPI competition: We designed an efficient matrix multiplication acceleration algorithm and neural network infrastructure based on Intel's oneAPI. Using our architecture, we have implemented quality detection for red wine. Collaborated with Shaojun Si (SDU)