Semantic Specialization in MoE Appears with Scale: A Study of DeepSeek R1 Expert Specialization

15 February 2025

Papers citing "Semantic Specialization in MoE Appears with Scale: A Study of DeepSeek R1 Expert Specialization"

1 / 1 papers shown

Title
Domain-Specific Pruning of Large Mixture-of-Experts Models with Few-shot Demonstrations Zican Dong Han Peng Peiyu Liu Wayne Xin Zhao Dong Wu Feng Xiao Zhilin Wang MoE 33 0 0 09 Apr 2025