2026-08-03
Understanding MoE, MoT, and MoL
Notes on Mixture of Experts, Mixture of Transformers, and Mixture of LoRA.
#Model Architecture
Blog
Notes on AI for science, protein design, and learning systems.
Notes on AI for science, protein design, and learning systems.
Notes on Mixture of Experts, Mixture of Transformers, and Mixture of LoRA.
Notes toward a unified definition of scientific foundation models that reason over and generate native scientific modalities.