Posted on November 8, 2016 d267: Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer