Wataru Ikeda
1st Year Master's Student
Tohoku University
I'm a 1st year master's student at Tohoku University. My research interests include Natural Language Processing and Knowledge of language models.
Education
April 2025 - Present
Tohoku University
M.S in Information Science
Advisor: Prof. Jun Suzuki
April 2021 — March 2025
Tohoku University
B.S in Engineering
Advisor: Prof. Jun Suzuki
Publications
Conference on Language Modeling (COLM) 2025
Layerwise Importance Analysis of Feed-Forward Networks in Transformer-based Language Models
Wataru Ikeda, Kazuki Yano, Ryosuke Takahashi, Jaesung Lee, Keigo Shibata, Jun Suzuki
Layerwise importance analysis of FFNs through selective FFN deactivation during pretraining.
言語処理学会第31回年次大会 2025
🏆 若手奨励賞 [20/487]
Transformer LLMにおける層単位のFFN層の重要度検証
池田航, 矢野一樹, 高橋良允, 李宰成, 柴田圭吾, 鈴木潤