Tested polars/pandas on 128GB workstation. Under 10 minutes processing time.
Question: Are we defaulting to distributed systems for workloads that fit in RAM?
www.linkedin.com/pulse/data-s...
#DataEngineering #DataSovereignty
Tested polars/pandas on 128GB workstation. Under 10 minutes processing time.
Question: Are we defaulting to distributed systems for workloads that fit in RAM?
www.linkedin.com/pulse/data-s...
#DataEngineering #DataSovereignty