Daniel Kunin
@danielkunin.bsky.social
Reposted by Daniel Kunin
🚀 An other Exciting news! Our paper "From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks" has been accepted at ICLR 2025!
arxiv.org/abs/2409.14623
A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)
arxiv.org/abs/2409.14623
A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)
April 4, 2025 at 2:45 PM
🚀 An other Exciting news! Our paper "From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks" has been accepted at ICLR 2025!
arxiv.org/abs/2409.14623
A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)
arxiv.org/abs/2409.14623
A thread on how relative weight initialization shapes learning dynamics in deep networks. 🧵 (1/9)
Reposted by Daniel Kunin
Check out our #NeurIPS2024 spotlight "Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning."
Thu 12 Dec 4:30-7:30 pm
East Exhibit Hall A-C #2102
Paper: arxiv.org/abs/2406.06158
Thread: x.com/KuninDaniel/...
Thu 12 Dec 4:30-7:30 pm
East Exhibit Hall A-C #2102
Paper: arxiv.org/abs/2406.06158
Thread: x.com/KuninDaniel/...
Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning
While the impressive performance of modern neural networks is often attributed to their capacity to efficiently extract task-relevant features from data, the mechanisms underlying this rich feature le...
arxiv.org
December 12, 2024 at 12:24 AM
Check out our #NeurIPS2024 spotlight "Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning."
Thu 12 Dec 4:30-7:30 pm
East Exhibit Hall A-C #2102
Paper: arxiv.org/abs/2406.06158
Thread: x.com/KuninDaniel/...
Thu 12 Dec 4:30-7:30 pm
East Exhibit Hall A-C #2102
Paper: arxiv.org/abs/2406.06158
Thread: x.com/KuninDaniel/...
Come check out our #NeurIPS2024 spotlight poster on feature learning tomorrow!
📍 East Exhibit Hall A-C #2102
📅 Thu 12 Dec 4:30 p.m. — 7:30 p.m. PST
📝 arxiv.org/abs/2406.06158
📍 East Exhibit Hall A-C #2102
📅 Thu 12 Dec 4:30 p.m. — 7:30 p.m. PST
📝 arxiv.org/abs/2406.06158
December 11, 2024 at 10:07 PM
Come check out our #NeurIPS2024 spotlight poster on feature learning tomorrow!
📍 East Exhibit Hall A-C #2102
📅 Thu 12 Dec 4:30 p.m. — 7:30 p.m. PST
📝 arxiv.org/abs/2406.06158
📍 East Exhibit Hall A-C #2102
📅 Thu 12 Dec 4:30 p.m. — 7:30 p.m. PST
📝 arxiv.org/abs/2406.06158
Reposted by Daniel Kunin
Had an amazing time with @marcofm.bsky.social @danielkunin.bsky.social @david-klindt.bsky.social and Feng Chen doing science 🧑🔬 and surfing 🌊 in Santa Barbara for the Follow-on Program at the Kavli Institute for Theoretical Physics! 🌴 #ScienceAndSurf #KITP
December 5, 2024 at 10:21 PM
Had an amazing time with @marcofm.bsky.social @danielkunin.bsky.social @david-klindt.bsky.social and Feng Chen doing science 🧑🔬 and surfing 🌊 in Santa Barbara for the Follow-on Program at the Kavli Institute for Theoretical Physics! 🌴 #ScienceAndSurf #KITP