MoE vs Edge AI: They Are Not the Same Thing

Recently, I came across an X demo of a 35B language model running on an iPhone using only 1–2.5 GB of...