Maxout ReLU is a special cases of Maxout Z +Z1 Input w ReLU a Input w Max →a *Z21 maxz ,z2 区wx+0 Z1=Wx +b Z2=0Maxout Max x1 Input + 𝑧1 + 𝑧2 𝑎 𝑚𝑎𝑥 𝑧1 , 𝑧2 𝑤 𝑏 0 0 𝑥 𝑧 = 𝑤𝑥 + 𝑏 𝑎 x1 Input ReLU 𝑧 𝑤 𝑏 𝑎 𝑥 𝑧1 = 𝑤𝑥 + 𝑏 𝑎 𝑧2 =0 ReLU is a special cases of Maxout