Genius is only a matter of seeing its threshold
Post
--
半沐
·
--
Achievements of Yang Zhilin, Founder of The Dark Side of the Moon
1. Academic achievements: laying the foundational bedrock for global long-context large language models (the highest-value long-term asset)
1) Transformer-XL (2018, co-first author)
- Core breakthrough: addressed the fatal limitations of the original Transformer—its fixed context window and inability to capture long-range text dependencies—by introducing a segment-level recurrent memory mechanism.
- Industry significance: one of the technical sources behind today’s long-context models. Many long-text optimization approaches in Claude, Kimi, and the GPT series borrow heavily from this idea. Without this work, models with one million-token long context would be next to impossible to even discuss. It also serves as a theoretical foundation for Kimi’s later focus on ultra-long documents.
2) XLNet (2019, first author, co-released with Google Brain)
- Core breakthrough: tackled information bias in BERT-style masked pretraining by adopting permutation language modeling; it surpassed BERT across 20 mainstream NLP benchmarks.
- Historical standing: widely recognized in the industry as one of the most important advances in pretraining models after BERT. Selected for a NeurIPS Oral presentation; the paper has been cited tens of thousands of times, making it one of the most influential foundational NLP works by a Chinese scholar.
3) Other academic contributions
- Collaborated with Turing Award winner Bengio to build the HotpotQA multi-turn reasoning question-answering dataset;
- Completed a PhD in just 4 years (regular program is 6 years), studied under Salakhutdinov, the former AI lead at Apple; interned at Google Brain and Meta FAIR, contributing to early R&D for Gemini and Bard;
- Among NLP papers by scholars under 35 in China, total citations have long remained in the top tier.
1. Academic achievements: laying the foundational bedrock for global long-context large language models (the highest-value long-term asset)
1) Transformer-XL (2018, co-first author)
- Core breakthrough: addressed the fatal limitations of the original Transformer—its fixed context window and inability to capture long-range text dependencies—by introducing a segment-level recurrent memory mechanism.
- Industry significance: one of the technical sources behind today’s long-context models. Many long-text optimization approaches in Claude, Kimi, and the GPT series borrow heavily from this idea. Without this work, models with one million-token long context would be next to impossible to even discuss. It also serves as a theoretical foundation for Kimi’s later focus on ultra-long documents.
2) XLNet (2019, first author, co-released with Google Brain)
- Core breakthrough: tackled information bias in BERT-style masked pretraining by adopting permutation language modeling; it surpassed BERT across 20 mainstream NLP benchmarks.
- Historical standing: widely recognized in the industry as one of the most important advances in pretraining models after BERT. Selected for a NeurIPS Oral presentation; the paper has been cited tens of thousands of times, making it one of the most influential foundational NLP works by a Chinese scholar.
3) Other academic contributions
- Collaborated with Turing Award winner Bengio to build the HotpotQA multi-turn reasoning question-answering dataset;
- Completed a PhD in just 4 years (regular program is 6 years), studied under Salakhutdinov, the former AI lead at Apple; interned at Google Brain and Meta FAIR, contributing to early R&D for Gemini and Bard;
- Among NLP papers by scholars under 35 in China, total citations have long remained in the top tier.
Disclaimer: Includes third-party opinions. No advice. Binance AI may be used without guarantee. See T&Cs.