See MoE. Model where a routing network sends each token to a small subset of specialist sub-networks.