Torsten Hoefler 🇨🇭
@thoefler.bsky.social
Professor ETHZ, head of SPCL, Chief Architect ML at CSCS researching large-scale #HPC and #AI systems and #Climate computing - youtube: http://bit.ly/3h1VgIU
On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
January 26, 2026 at 2:42 AM
On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉!
Looking forward to see many of you in Osaka this week!
Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
January 25, 2026 at 6:30 AM
Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏
Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff!
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
January 21, 2026 at 5:00 AM
Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff!
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
It currently tops the list of trending articles 🚀.
Check it out: buff.ly/sz4yGzk
#HPC #Networking
🌍 Shape the future of HPC for Climate Research in Germany!
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
Job advertisement
Faculties
www.uni-hamburg.de
January 19, 2026 at 6:41 AM
🌍 Shape the future of HPC for Climate Research in Germany!
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
Uni Hamburg is hiring a director for computing center—advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.
Apply 👉 buff.ly/aF6wruR
#HPC #Climate #Supercomputing
I'm looking forward to speak about MDDI's #AI for #Climate at next week's Lorong AI meetup in Singapore next Tuesday!
Join us if you are around:
Join us if you are around:
AI for Climate Sciences · Luma
What would it actually take to build an AI climate scientist? Climate research already relies on large-scale simulations, physical models, and vast…
buff.ly
January 16, 2026 at 4:00 AM
The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
January 12, 2026 at 7:46 AM
The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
Thanks for the great organization!
We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-)
My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.
I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
January 6, 2026 at 11:15 PM
I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
buff.ly/JQMSRcf
I will talk about #AI for #Climate - join us if you're around!
I'm very much looking forward to my plenary lecture and fireside chat at the 10th iteration of the famous GYSS summit in Singapore.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
Global Young Scientists Summit
The Global Young Scientists Summit in Singapore brings together bright young researchers and top scientific minds from around the world...
buff.ly
January 5, 2026 at 1:00 AM
I'm very much looking forward to my plenary lecture and fireside chat at the 10th iteration of the famous GYSS summit in Singapore.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
buff.ly/aVKwfbc
A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here 😀.
Just as we start into the new year, our Ultra Ethernet tutorial with all background exceeds 1,000 views on youtube!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
Ultra Ethernet for next-generation AI and HPC workloads
Host: Sujata Banerjee
Speakers: Torsten Hoefler, Microsoft and ETH Zurich; Abdul Kabbani, Microsoft
The Ultra Ethernet Consortium set out to redefine Ethernet-based interconnects for AI and…
buff.ly
January 2, 2026 at 6:00 AM
Just as we start into the new year, our Ultra Ethernet tutorial with all background exceeds 1,000 views on youtube!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
If you prefer reading: buff.ly/Pmq1Xrr
Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!
📽️ buff.ly/UGvjR1N
Building future #AI and #HPC #networking!
A special memory of Piz Daint - once Europe's fastest and first large #GPU #supercomputer
After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!
Better than spatulas #nvidia? Enjoy the festive season 🎄 #AI #HPC
After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!
Better than spatulas #nvidia? Enjoy the festive season 🎄 #AI #HPC
December 26, 2025 at 6:00 AM
Switzerland, where you go with your hybrid car by electric train to the mountains 🏔️. Always cool.
Happy holidays! ❄️
Happy holidays! ❄️
December 24, 2025 at 7:42 AM
Switzerland, where you go with your hybrid car by electric train to the mountains 🏔️. Always cool.
Happy holidays! ❄️
Happy holidays! ❄️
Reposted by Torsten Hoefler 🇨🇭
With the year slowly winding down, we took a bit of time to get together, celebrate and reflect on the amazing 2025 journey and all the learnings and achievements during our Xmas dinner last Friday.🎄
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
December 22, 2025 at 8:04 AM
With the year slowly winding down, we took a bit of time to get together, celebrate and reflect on the amazing 2025 journey and all the learnings and achievements during our Xmas dinner last Friday.🎄
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
Happy holidays & 2026, here we come!🚀🥳
#HPC #AI @thoefler.bsky.social @csateth.bsky.social
NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
December 22, 2025 at 6:00 AM
NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
The idea is to preserve the largest value in each block.
buff.ly/SjwVr6w (16:00 ff)
We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF
Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
December 17, 2025 at 6:00 AM
Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
buff.ly/K85kokX
Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!
buff.ly/wPnHfaJ
buff.ly/65mQo7q
Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
December 15, 2025 at 6:00 AM
Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
buff.ly/kMPnbBf (04:00)
Learn more about NCCL details in our paper: buff.ly/doin5bt
Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!
Watch: buff.ly/c9hBJcV
Watch: buff.ly/c9hBJcV
December 8, 2025 at 6:00 AM
Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!
Watch: buff.ly/c9hBJcV
Watch: buff.ly/c9hBJcV
Ilya Sutskever: "Compression is prediction and vice versa." (15:10).
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
December 3, 2025 at 6:00 AM
Ilya Sutskever: "Compression is prediction and vice versa." (15:10).
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.
Watch: buff.ly/Bnvazym
I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
December 1, 2025 at 6:00 AM
I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.
Watch now: buff.ly/7qeGuqf
Bill Dally on NVIDIA networking: "Jensen said: 'Absolutely not, we don't do networking, we're a GPU company'".
buff.ly/iUHv62C (4:30)
Then he talked the DOE into paying 100%, launching NVLINK
Example how a research lab changed the course of its organization. Another example is "all of AI" :-)
buff.ly/iUHv62C (4:30)
Then he talked the DOE into paying 100%, launching NVLINK
Example how a research lab changed the course of its organization. Another example is "all of AI" :-)
Insights From NVIDIA Research S73202 | GTC 2025 | NVIDIA On-Demand
The talk will give some highlights from NVIDIA Research for the past year. Detailed topics will be disclosed closer to the event.
buff.ly
November 26, 2025 at 6:00 AM
Bill Dally on NVIDIA networking: "Jensen said: 'Absolutely not, we don't do networking, we're a GPU company'".
buff.ly/iUHv62C (4:30)
Then he talked the DOE into paying 100%, launching NVLINK
Example how a research lab changed the course of its organization. Another example is "all of AI" :-)
buff.ly/iUHv62C (4:30)
Then he talked the DOE into paying 100%, launching NVLINK
Example how a research lab changed the course of its organization. Another example is "all of AI" :-)
Congrats to Saleh Ashkboos, SPCL's 13th PhD graduate (another prime number). A new expert in quantization and LLM optimization is born.
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
November 25, 2025 at 5:36 PM
Congrats to Saleh Ashkboos, SPCL's 13th PhD graduate (another prime number). A new expert in quantization and LLM optimization is born.
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
Thanks also to the great collaboration with Dan Alistarh from ISTA and James Hensman at Microsoft!
I am very honored to be part of to the two brilliant teams winning the 2025 Gordon Bell Prize for Climate Modeling and the 2025 Gordon Bell Prize (Honorable Mention). Both among the highest honors in #HPC. 🍾
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
November 24, 2025 at 6:00 AM
I am very honored to be part of to the two brilliant teams winning the 2025 Gordon Bell Prize for Climate Modeling and the 2025 Gordon Bell Prize (Honorable Mention). Both among the highest honors in #HPC. 🍾
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
buff.ly/gCkjDRN and buff.ly/4ewhdZ9
Congrats teams - Switzerland 🇨🇭 going strong - onward!
Former member of SPCL, collaborator, and friend Daniele De Sensi speaks at both Broadcom's booth and at the main track of the Supercomputing conference.
Onward! We're all proud of you 🎉
Onward! We're all proud of you 🎉
November 21, 2025 at 12:18 PM
Former member of SPCL, collaborator, and friend Daniele De Sensi speaks at both Broadcom's booth and at the main track of the Supercomputing conference.
Onward! We're all proud of you 🎉
Onward! We're all proud of you 🎉
Reposted by Torsten Hoefler 🇨🇭
🌍 A 26-member team has been awarded the 2025 Gordon Bell Prize for Climate Modelling for their project, “Computing the Full Earth System at 1 km Resolution.”
Congratulations to this year’s outstanding team!
buff.ly/GKDYnH3
Congratulations to this year’s outstanding team!
buff.ly/GKDYnH3
November 20, 2025 at 8:30 PM
🌍 A 26-member team has been awarded the 2025 Gordon Bell Prize for Climate Modelling for their project, “Computing the Full Earth System at 1 km Resolution.”
Congratulations to this year’s outstanding team!
buff.ly/GKDYnH3
Congratulations to this year’s outstanding team!
buff.ly/GKDYnH3