Torsten Hoefler 🇨🇭
@thoefler.bsky.social
Professor ETHZ, head of SPCL, Chief Architect ML at CSCS researching large-scale #HPC and #AI systems and #Climate computing - youtube: http://bit.ly/3h1VgIU
It's always exciting when research topics receive attention on national TV. CNA, one of Asia's premier TV stations reports on Singapore's $1bn AI for Science and highlights our AI for Health collaboration with Ben Helgason and Bryan Tan, part of my AI Visiting Professorship!
Watch: buff.ly/28Ck77Q
Watch: buff.ly/28Ck77Q
February 5, 2026 at 5:10 AM
It's always exciting when research topics receive attention on national TV. CNA, one of Asia's premier TV stations reports on Singapore's $1bn AI for Science and highlights our AI for Health collaboration with Ben Helgason and Bryan Tan, part of my AI Visiting Professorship!
Watch: buff.ly/28Ck77Q
Watch: buff.ly/28Ck77Q
Rio Yokota on the #SCA2026 fishbowl panel: "I don't think humans are in any way more trustworthy than an advanced AI" - "In the same way we trust other humans, we could develop trust to AIs" - "If people or AI generate code - how do we know there is no bug inside?" profound thoughts by a wise man.
January 28, 2026 at 2:35 AM
Rio Yokota on the #SCA2026 fishbowl panel: "I don't think humans are in any way more trustworthy than an advanced AI" - "In the same way we trust other humans, we could develop trust to AIs" - "If people or AI generate code - how do we know there is no bug inside?" profound thoughts by a wise man.
On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
January 26, 2026 at 2:42 AM
On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
January 25, 2026 at 6:30 AM
Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff!
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
January 21, 2026 at 5:00 AM
Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff!
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
January 12, 2026 at 7:46 AM
The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
January 6, 2026 at 11:15 PM
I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
A special memory of Piz Daint - once Europe's fastest and first large #GPU #supercomputer
After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!
Better than spatulas #nvidia? Enjoy the festive season 🎄 #AI #HPC
After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!
Better than spatulas #nvidia? Enjoy the festive season 🎄 #AI #HPC
December 26, 2025 at 6:00 AM
Switzerland, where you go with your hybrid car by electric train to the mountains 🏔️. Always cool.
Happy holidays! ❄️
Happy holidays! ❄️
December 24, 2025 at 7:42 AM
Switzerland, where you go with your hybrid car by electric train to the mountains 🏔️. Always cool.
Happy holidays! ❄️
Happy holidays! ❄️
NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
December 22, 2025 at 6:00 AM
NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
December 17, 2025 at 6:00 AM
Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
December 15, 2025 at 6:00 AM
Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!
Watch: buff.ly/c9hBJcV
Watch: buff.ly/c9hBJcV
December 8, 2025 at 6:00 AM
Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!
Watch: buff.ly/c9hBJcV
Watch: buff.ly/c9hBJcV
Ilya Sutskever: "Compression is prediction and vice versa." (15:10).
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
December 3, 2025 at 6:00 AM
Ilya Sutskever: "Compression is prediction and vice versa." (15:10).
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
December 1, 2025 at 6:00 AM
I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Congrats to Saleh Ashkboos, SPCL's 13th PhD graduate (another prime number). A new expert in quantization and LLM optimization is born.
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
November 25, 2025 at 5:36 PM
Congrats to Saleh Ashkboos, SPCL's 13th PhD graduate (another prime number). A new expert in quantization and LLM optimization is born.
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
I am very honored to be part of to the two brilliant teams winning the 2025 Gordon Bell Prize for Climate Modeling and the 2025 Gordon Bell Prize (Honorable Mention). Both among the highest honors in #HPC. 🍾
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
November 24, 2025 at 6:00 AM
I am very honored to be part of to the two brilliant teams winning the 2025 Gordon Bell Prize for Climate Modeling and the 2025 Gordon Bell Prize (Honorable Mention). Both among the highest honors in #HPC. 🍾
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
Former member of SPCL, collaborator, and friend Daniele De Sensi speaks at both Broadcom's booth and at the main track of the Supercomputing conference.
Onward! We're all proud of you 🎉
Onward! We're all proud of you 🎉
November 21, 2025 at 12:18 PM
Former member of SPCL, collaborator, and friend Daniele De Sensi speaks at both Broadcom's booth and at the main track of the Supercomputing conference.
Onward! We're all proud of you 🎉
Onward! We're all proud of you 🎉
Pumps and energy delivery infrastructure, e.g.,
November 21, 2025 at 11:46 AM
Pumps and energy delivery infrastructure, e.g.,
Rajeev Thakur is kicking off our Advanced MPI tutorial at #SC25. It's always an honor to teach this long standing tutorial with esteemed colleagues including Bill Gropp and Pavan Balaji. Great attendance 👌, still some seats in 122.
We're looking forward to a productive session.
We're looking forward to a productive session.
November 17, 2025 at 2:36 PM
Rajeev Thakur is kicking off our Advanced MPI tutorial at #SC25. It's always an honor to teach this long standing tutorial with esteemed colleagues including Bill Gropp and Pavan Balaji. Great attendance 👌, still some seats in 122.
We're looking forward to a productive session.
We're looking forward to a productive session.
Kurt Ferreira opens the 14th addition of our ROSS workshop at #SC25! Supercomputer operating systems and middleware going strong! Packed room as always 😀.
Starting with an invited talk by NVIDIA's Jeff Hammond on communication systems.
Trivia: he probably traveled furthest ✈️
Starting with an invited talk by NVIDIA's Jeff Hammond on communication systems.
Trivia: he probably traveled furthest ✈️
November 16, 2025 at 8:15 PM
Kurt Ferreira opens the 14th addition of our ROSS workshop at #SC25! Supercomputer operating systems and middleware going strong! Packed room as always 😀.
Starting with an invited talk by NVIDIA's Jeff Hammond on communication systems.
Trivia: he probably traveled furthest ✈️
Starting with an invited talk by NVIDIA's Jeff Hammond on communication systems.
Trivia: he probably traveled furthest ✈️
Arrived at #SC25 and just moved into the SPCL den 🏠 - our homebase for the whole on-site team this week. Readying ourselves for a crazy time - my three talks for tomorrow should mainly be set 😀.
Looking forward to seeing all of you in person - for those who I have not already met 🤝.
Looking forward to seeing all of you in person - for those who I have not already met 🤝.
November 16, 2025 at 3:17 PM
Arrived at #SC25 and just moved into the SPCL den 🏠 - our homebase for the whole on-site team this week. Readying ourselves for a crazy time - my three talks for tomorrow should mainly be set 😀.
Looking forward to seeing all of you in person - for those who I have not already met 🤝.
Looking forward to seeing all of you in person - for those who I have not already met 🤝.
Ilya Sutskever "Three lines of math can prove all of supervised learning. That's nice" (4:33)
"I have not seen an exposition of unsupervised learning that I found satisfying" (7:50)
Its optimization objective has little relation to the actual objective you care about
Watch: buff.ly/Bnvazym
"I have not seen an exposition of unsupervised learning that I found satisfying" (7:50)
Its optimization objective has little relation to the actual objective you care about
Watch: buff.ly/Bnvazym
November 10, 2025 at 6:00 AM
Ilya Sutskever "Three lines of math can prove all of supervised learning. That's nice" (4:33)
"I have not seen an exposition of unsupervised learning that I found satisfying" (7:50)
Its optimization objective has little relation to the actual objective you care about
Watch: buff.ly/Bnvazym
"I have not seen an exposition of unsupervised learning that I found satisfying" (7:50)
Its optimization objective has little relation to the actual objective you care about
Watch: buff.ly/Bnvazym