Mixture of Experts (MoE) Model

From GM-RKB
(Redirected from Mixture-of-Experts (MoE))
Jump to navigation Jump to search

A Mixture of Experts (MoE) Model is a machine learning algorithm where multiple experts (learners) are used to divide the problem space into homogeneous regions.



References

2022

  • (Wikipedia, 2022) ⇒ https://en.wikipedia.org/wiki/Mixture_of_experts Retrieved:2022-3-4.
    • Mixture of experts (MoE) refers to a machine learning technique where multiple experts (learners) are used to divide the problem space into homogeneous regions. An example from the computer vision domain is combining a neural network model for human detection with another for pose estimation. If the output is conditioned on multiple levels of probabilistic gating functions, the mixture is called a hierarchical mixture of experts.

      A gating network decides which expert to use for each input region. Learning thus consists of 1) learning the parameters of individual learners and 2) learning the parameters of the gating network.

2021

2018

2017

2016

2014