Vanilla rnns EXample Application 1-of-N encoding How to represent each word as a vector? 1-of-N Encoding lexicon =(apple, bag, cat, dog, elephant The vector is lexicon size apple =[1000 0 Each dimension corresponds to a bag=[01000] word in the lexicon cat=[00100] The dimension for the word is 1, and others are o dog=[00010] elephant =[0000 1 Sourceofslidehttp://speech.ee.ntu.edu.tw/-tlkagk/coursesMl16.hTmlVanilla RNNs ▪ Example Application ▪ 1-of-N encoding How to represent each word as a vector? Each dimension corresponds to a word in the lexicon The dimension for the word is 1, and others are 0 lexicon = {apple, bag, cat, dog, elephant} apple = [ 1 0 0 0 0] bag = [ 0 1 0 0 0] cat = [ 0 0 1 0 0] dog = [ 0 0 0 1 0] elephant = [ 0 0 0 0 1] The vector is lexicon size. 1-of-N Encoding Source of slide: http://speech.ee.ntu.edu.tw/~tlkagk/courses_ML16.html