WWW '21,April 19-23,2021,Ljubljana,Slovenia Zhiwei Jiang,Meng Liu,Yafeng Yin,Hua Yu,Zifeng Cheng,and Qing Gu [28]Jeffrey Pennington,Richard Socher,and Christopher D.Manning.2014.GloVe: [48]Attali Yigal,Bridgeman Brent,and Trapani Catherine.2010.Performance of a Global Vectors for Word Representation.In Proceedings of the 2014 Conference on Generic Approach in Automated Essay Scoring.Journal of Technology Learning Empirical Methods in Natural Language Processing (EMNLP).1532-1543 &Assessment10,3(2010),17. [29]Isaac Persing.Alan Davis,and Vincent Ng.2010.Modeling organization in [49]Li Yuan,Francis E.H.Tay,Guilin Li,Tao Wang,and Jiashi Feng.2020.Revisiting student essays.In Proceedings of the 2010 Conference on Empirical Methods in Knowledge Distillation via Label Smoothing Regularization.In 2020 IEEE/CVF Natural Language Processing.229-239. Conference on Computer Vision and Pattern Recognition,CVPR 2020,Seattle,WA, [30]Isaac Persing and Vincent Ng.2014.Modeling prompt adherence in student essays U54,7ne13-19,2020.IEEE.3902-3910. In Proceedings of the 52nd Annual Meeting of the Association for Computational [50]Sergey Zagoruyko and Nikos Komodakis.2017.Paying More Attention to Atten- Linguistics.1534-1543. tion:Improving the Performance of Convolutional Neural Networks via Attention [31]Matthew E.Peters,Mark Neumann,MohitI lyyer,Matt Gardn Kenton Lee and Luke Zettlemover 2018 Deep Contertualized w Transfer In 5th International Conference on Learning Representations,ICLR 2017. Toulon,France,April 24-26,2017,Conference Track Proceedings. resentations.In Proceedings of the 2018 Conference of the North American Chapter [51]Ying Zhang.Tao Xiang,Timothy M.Hospedales,and Huchuan Lu.2018.Deep of the Association for Computational Linguistics:Human Language Technologies, Mutual Learning.In 2018 IEEE Conference on Computer Vision and Pattern Recog- NAACL-HLT 2018.New Orleans,Louisiana,USA,June 1-6,2018,Volume 1 (Long nition,CVPR 2018.Salt Lake City.UT.USA.June 18-22.2018.4320-4328. Papers12227-2237 [52]Dengyong Zhou,Olivier Bousquet,Thomas Na vin Lal,Jason Weston,and Bern [32]Peter Phandi,Kian Ming Adam Chai,and Hwee Tou Ng.2015.Flexible Domain hard Sch Olkopf.2003.Learning with Local and Global Consistency.Advances in Adaptation for Automated Essay Scoring Using Correlated Linear Regression neural information processing systems 16.3(2003). In Proceedings of the 2015 Conference on Empirical Methods in Natural Language [53]X.Zhu.2002.Learning from Labeled and Unlabeled Data with Label Propagation. Processing.431-439. Tech Report (2002). [33]Antti Rasmus,Mathias Berglund,Mikko Honkala,Harri Valpola,and Tapan Raiko.2015.Semi-supervised Learning with Ladder Networks.In Advances in Neural Information Processi Systems 28:Annual Conference on Neural Infor mation Processing Systems 2015,December 7-12,2015,Montreal,Quebec,Canada. 3546-3554. [34]Pedro Uria Rodriguez,Amir Jafari,and Christopher M.Ormerod.2019.Lan- guage models and Automated Essay Scoring. .CoRR abs/1909.09482(2019). rXi1909.09482htp:axiv.org/ahs/1909.09482 [35]Haggai Roitman,Guy Feigenblat,Doron Cohen,Odellia Boni,and David Konop- nicki.2020.Unsupervised Dual-Cascade Learning with Pseudo-Feedback Dis- tillation for Query-Focused Extractive Summarization.In WWW '20:The Wel Conference 2020,Taipei,Taiwan,April 20-24,2020.2577-2584. [36]Adriana Romero,Nicolas Ballas,Samira Ebrahimi Kahou,Antoine Chassang. Carlo Gatta,and Yoshua Bengio.2015.FitNets:Hints for Thin Deep Nets.In 3rd International Conference on Learning Representations,ICLR 2015,San Diego,CA USA,May 7-9,2015,Conference Track Proceedings [37]Jake Snell,Kevin Swersky.and Richard S.Zemel.2017.Prototypical Networks for Few-shot Learning.In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017,4-9 December 2017,Long Beach,CA,USA,Isabelle Guyon,Ulrike von Luxburg.Samy Bengic Hanna M.Wallach,Rob Fergus,S.V.N.Vishwanathan,and Roman Garnett (Eds.). 4077-4087 [38]Swapna Somasundaran,Jill Burstein,and Martin Chodorow.2014.Lexical chain- ing for measuring discourse coherence quality in test-taker essays.In Proceedings of the 25th International conference on computational linguistics.950-961 [39]Kaveh Taghipour and Hwee Tou Ng.2016.A Neural Approach to Automated Essay Scoring.In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.1882-1891. [40]Antti Tarvainen and Harri Valpola.2017.Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results.In Advances in neural information processing systems.1195-1204. [41]Yi Tay,Minh C.Phan,Luu Anh Tuan,and Siu Ch ng Hui.2018.SkipFlow Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring In Proceedings of the 32nd Conference on Artificial Intelligence(AAAl-18).5948- 5955. [42]Vladimir Vapnik.1999.An overview of statistical learning theory.IEEE Trans. Neural Networks 10,5(1999).988-999. [43]Ashish Vaswani,Noam Shazeer,Niki Parmar,Jakob Uszkoreit,Llion Jones Aidan N.Gomez,Lukasz Kaiser, and Illia Polosukhin.2017.Attention is All you Need.In Advances in Neural Information Processing Systems 30:Annual Con- ference on Neural Information Processing Systems 2017,4-9 December 2017,Long Beach,CA,USA.5998-6008. [44]Yucheng Wang.Zhongyu Wei,Yaqian Zhou,and Xuanjing Huang.2018.Auto- matic Essay Scoring Incorporating Rating Scher ent Learning. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.791-797. [45]Qizhe Xie,Zihang Dai,Eduard Hovy,Minh-Thang Luong.and Quoc V Le 2019.Unsupervised data augmentation for consistency training.arXiv preprint rXiw1904.12848(2019). [46]Ruochen Xu and Yiming Yang.2017.Cross-lingual Distillation for Text Classifica- tion.In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,ACL 2017,Vancouver,Canada,July 30-August 4,Volume 1:Long Papers. 1415-1425. [47]Helen Yannakoudakis and Ted Briscoe.2012.Modeling coherence in ESOL learner texts.In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP,BEA@NAACL-HLT 2012 June 7,2012,Mon treal Canada Joel R.Tetreault,Jill Burstein,and Claudia Leacock(Eds.).The Association for Computer Linguistics,33-43. 2356WWW ’21, April 19–23, 2021, Ljubljana, Slovenia Zhiwei Jiang, Meng Liu, Yafeng Yin, Hua Yu, Zifeng Cheng, and Qing Gu [28] Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1532–1543. [29] Isaac Persing, Alan Davis, and Vincent Ng. 2010. Modeling organization in student essays. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. 229–239. [30] Isaac Persing and Vincent Ng. 2014. Modeling prompt adherence in student essays. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 1534–1543. [31] Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep Contextualized Word Rep￾resentations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers). 2227–2237. [32] Peter Phandi, Kian Ming Adam Chai, and Hwee Tou Ng. 2015. Flexible Domain Adaptation for Automated Essay Scoring Using Correlated Linear Regression. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 431–439. [33] Antti Rasmus, Mathias Berglund, Mikko Honkala, Harri Valpola, and Tapani Raiko. 2015. Semi-supervised Learning with Ladder Networks. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Infor￾mation Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada. 3546–3554. [34] Pedro Uria Rodriguez, Amir Jafari, and Christopher M. Ormerod. 2019. Lan￾guage models and Automated Essay Scoring. CoRR abs/1909.09482 (2019). arXiv:1909.09482 http://arxiv.org/abs/1909.09482 [35] Haggai Roitman, Guy Feigenblat, Doron Cohen, Odellia Boni, and David Konop￾nicki. 2020. Unsupervised Dual-Cascade Learning with Pseudo-Feedback Dis￾tillation for Query-Focused Extractive Summarization. In WWW ’20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020. 2577–2584. [36] Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. 2015. FitNets: Hints for Thin Deep Nets. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings. [37] Jake Snell, Kevin Swersky, and Richard S. Zemel. 2017. Prototypical Networks for Few-shot Learning. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 4077–4087. [38] Swapna Somasundaran, Jill Burstein, and Martin Chodorow. 2014. Lexical chain￾ing for measuring discourse coherence quality in test-taker essays. In Proceedings of the 25th International conference on computational linguistics. 950–961. [39] Kaveh Taghipour and Hwee Tou Ng. 2016. A Neural Approach to Automated Essay Scoring. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 1882–1891. [40] Antti Tarvainen and Harri Valpola. 2017. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. In Advances in neural information processing systems. 1195–1204. [41] Yi Tay, Minh C. Phan, Luu Anh Tuan, and Siu Cheung Hui. 2018. SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring. In Proceedings of the 32nd Conference on Artificial Intelligence(AAAI-18). 5948– 5955. [42] Vladimir Vapnik. 1999. An overview of statistical learning theory. IEEE Trans. Neural Networks 10, 5 (1999), 988–999. [43] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems 30: Annual Con￾ference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA. 5998–6008. [44] Yucheng Wang, Zhongyu Wei, Yaqian Zhou, and Xuanjing Huang. 2018. Auto￾matic Essay Scoring Incorporating Rating Schema via Reinforcement Learning. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 791–797. [45] Qizhe Xie, Zihang Dai, Eduard Hovy, Minh-Thang Luong, and Quoc V Le. 2019. Unsupervised data augmentation for consistency training. arXiv preprint arXiv:1904.12848 (2019). [46] Ruochen Xu and Yiming Yang. 2017. Cross-lingual Distillation for Text Classifica￾tion. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 1: Long Papers. 1415–1425. [47] Helen Yannakoudakis and Ted Briscoe. 2012. Modeling coherence in ESOL learner texts. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP, BEA@NAACL-HLT 2012, June 7, 2012, Montréal, Canada, Joel R. Tetreault, Jill Burstein, and Claudia Leacock (Eds.). The Association for Computer Linguistics, 33–43. [48] Attali Yigal, Bridgeman Brent, and Trapani Catherine. 2010. Performance of a Generic Approach in Automated Essay Scoring. Journal of Technology Learning & Assessment 10, 3 (2010), 17. [49] Li Yuan, Francis E. H. Tay, Guilin Li, Tao Wang, and Jiashi Feng. 2020. Revisiting Knowledge Distillation via Label Smoothing Regularization. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020. IEEE, 3902–3910. [50] Sergey Zagoruyko and Nikos Komodakis. 2017. Paying More Attention to Atten￾tion: Improving the Performance of Convolutional Neural Networks via Attention Transfer. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. [51] Ying Zhang, Tao Xiang, Timothy M. Hospedales, and Huchuan Lu. 2018. Deep Mutual Learning. In 2018 IEEE Conference on Computer Vision and Pattern Recog￾nition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018. 4320–4328. [52] Dengyong Zhou, Olivier Bousquet, Thomas Navin Lal, Jason Weston, and Bern￾hard Sch Olkopf. 2003. Learning with Local and Global Consistency. Advances in neural information processing systems 16, 3 (2003). [53] X. Zhu. 2002. Learning from Labeled and Unlabeled Data with Label Propagation. Tech Report (2002). 2356