Don't miss out! Use the coupon code BLACKFRIDAY to get a generous 50% OFF your first order on Cat2Cloud. 💰
This offer is valid until Cyber Monday (Dec 1st), so don't delay! ⏳
Get it today! 👉 ironarray.io/pricing
Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. ✨
Ready to see it in action? Try our online demo server today! 👉 cat2cloud.com/demo/
#HDF5 #CloudComputing
Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. ✨
Ready to see it in action? Try our online demo server today! 👉 cat2cloud.com/demo/
#HDF5 #CloudComputing
Dinosaurs lived on the other side the Galaxy.
Dinosaurs lived on the other side the Galaxy.
Interact with your vasts remote datasets right in your phone!
cat2.cloud/demo/roots/@...
#Cat2Cloud #Blosc2 #BigData
Interact with your vasts remote datasets right in your phone!
cat2.cloud/demo/roots/@...
#Cat2Cloud #Blosc2 #BigData
With Cat2Cloud released this week we continue our 💊ironPill series with another video, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client!
Visualise and manage all kinds of data formats - from arrays to jpgs 🖼️, markdown to PDFs 📄 !
With Cat2Cloud released this week we continue our 💊ironPill series with another video, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client!
Visualise and manage all kinds of data formats - from arrays to jpgs 🖼️, markdown to PDFs 📄 !
Cat2Cloud's most exciting feature: 𝗿𝗲𝗺𝗼𝘁𝗲 𝗷𝘂𝗽𝘆𝘁𝗲𝗿 𝗻𝗼𝘁𝗲𝗯𝗼𝗼𝗸𝘀!
☁️ cloud-based computation
☁️ cloud-hosted data
☁️ cloud-hosted jupyter notebooks!
⚡No environment headaches, no waiting for computations - all in a seamless interface from the browser!
Bring computation directly to your data. Host, run, and share workflows with incredible speed. ⚡
Read the announcement: ironarray.io/blog/cat2clo...
#Cat2Cloud #BigData #DataScience #Python #HPC
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
Blosc2 is part of the NumPy array library ecosystem: numpy.org
In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object:
𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱)
for 𝙰, 𝙱 PyTorch, Jax, Tensorflow, Zarr... arrays!
#Compute
#Tensor
#PyTorch
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
See how Blosc2 powers heavy-duty linear algebra (100GB!) workflows
⚡1.5-2x faster than PyTorch + h5py!
🧱 optimised chunking for your cache hierarchy
🐍 one line syntax 𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱, 𝚞𝚛𝚕𝚙𝚊𝚝𝚑='𝚘𝚞𝚝.𝚋𝟸𝚗𝚍')
See blog here: ironarray.io/blog/la-blosc
#Blosc2
#Data
#LinearAlgebra
Equally crucial is vertical integration. When SSD storage, memory hierarchies, compression, and computation are seamlessly orchestrated 💃, the performance gains can be transformative. 🚀
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Blosc2 calculates Fourier approximations:
⚡5x faster than NumPy
👣 fraction of the memory footprint
🐍 one-line syntax 𝚜𝚞𝚖(𝚊 * 𝚌𝚘𝚜(𝚝) + 𝚋 * 𝚜𝚒𝚗(𝚝), 𝚊𝚡𝚒𝚜=𝟷)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/652403...
Paper: www.blosc.org/docs/Explori...
#napari
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
Blosc2 as a mature computation engine >>>
• Array API standard compliance - 70 new functions
• Fast linalg: tensordot 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays !
• Fast calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
Thanks to the array API standard effort; without it we could not possible reach this level of generality 🙏
Compress Better, Compute Faster
For ultimate speed, native Blosc2 containers are still king. 🏎️
Code: gist.github.com/FrancescAlte...
#Python #DataScience #NumPy #Performance #Blosc
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!
#arrayapi #Blosc2
From its humble beginnings in 2010 as a compressor for PyTables, it has evolved into a powerful n-dimensional container. 💪
There's more to come, but what a fantastic milestone! ✨
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.
For more info, see the release notes in:
github.com/Blosc/c-blos...
Compress Better, Compute Bigger
Enjoy!
We can help! 💪 We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).
Ready to dive in? 🚀
🔹 EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
🔹 Tutorial: github.com/Blosc/EuroSc...
#HPC #Blosc2
Check out compress-image: a new C++/Python library for working with compressed images directly in memory.
Kudos to Emil Dohne for this fantastic work!
Project here: github.com/EmilDohne/co...
#Blosc2 #FOSS #ImageProcessing
#urbanism #owgf #solarpunk #climateaction
#urbanism #owgf #solarpunk #climateaction
#urbanism #owgf #solarpunk #climateaction