I have been pretty impressed with this paper arxiv.org/pdf/2403.00793 from Tencent.
It packs so much in one paper.
Embedding collapse, numerical encoding, MoE...
I think the best part is really how they just summarize the takeaway looking at impact and links it to other papers for further reading.