The DuckDB community is so nice. I hit an OOM issue and asked for help and great advices from the DuckDB team and user groups within few hours. www.linkedin.com/pulse/etl-30...
March 31, 2025 at 10:19 PM
The DuckDB community is so nice. I hit an OOM issue and asked for help and great advices from the DuckDB team and user groups within few hours. www.linkedin.com/pulse/etl-30...
If you have billions of keys in a dimension table, you may want such a dictionary 1)never out-of-memory 2)work in multi-node 3)cache the hot data to minimize hit miss 4)when the hot data changes in upstream, the cache update itself proactively.. Too good to be true? Well, we just did it, in Timeplus
February 10, 2025 at 12:37 AM
If you have billions of keys in a dimension table, you may want such a dictionary 1)never out-of-memory 2)work in multi-node 3)cache the hot data to minimize hit miss 4)when the hot data changes in upstream, the cache update itself proactively.. Too good to be true? Well, we just did it, in Timeplus
A new way to generate TPCH dataset in MySQL(or other databases):
1. Simply run `CALL dbgen(sf = 1);` in @duckdb.org 10 million rows generated in few seconds
2. Setup a MySQL locally or via Aiven
3. Download the single binary from slingdata.io Configure the yaml. Then `sling run -r your.yaml`
DONE
1. Simply run `CALL dbgen(sf = 1);` in @duckdb.org 10 million rows generated in few seconds
2. Setup a MySQL locally or via Aiven
3. Download the single binary from slingdata.io Configure the yaml. Then `sling run -r your.yaml`
DONE
February 6, 2025 at 11:12 PM
A new way to generate TPCH dataset in MySQL(or other databases):
1. Simply run `CALL dbgen(sf = 1);` in @duckdb.org 10 million rows generated in few seconds
2. Setup a MySQL locally or via Aiven
3. Download the single binary from slingdata.io Configure the yaml. Then `sling run -r your.yaml`
DONE
1. Simply run `CALL dbgen(sf = 1);` in @duckdb.org 10 million rows generated in few seconds
2. Setup a MySQL locally or via Aiven
3. Download the single binary from slingdata.io Configure the yaml. Then `sling run -r your.yaml`
DONE
Have you tried napkin.ai? Write down bullet points and one-click to generate various options for diagrams. Good to illustrate your ideas, and do more fine tuning if needed
January 17, 2025 at 3:24 AM
Have you tried napkin.ai? Write down bullet points and one-click to generate various options for diagrams. Good to illustrate your ideas, and do more fine tuning if needed
Before everyone knows it, go notes.cleve.ai/unwrapped to gen such infograph for your LinkedIn "metrics" (I don't think you will read a 12-page PDF, so I did some PS work to create "Executive Summary"). Happy Holiday 🎄🎁
December 23, 2024 at 6:40 PM
Before everyone knows it, go notes.cleve.ai/unwrapped to gen such infograph for your LinkedIn "metrics" (I don't think you will read a 12-page PDF, so I did some PS work to create "Executive Summary"). Happy Holiday 🎄🎁
I created too many boring roadmap slides. This is how a road-map should be really is (credit: Frostpunk 2 steam page)
December 21, 2024 at 5:56 PM
I created too many boring roadmap slides. This is how a road-map should be really is (credit: Frostpunk 2 steam page)
What's best way to visualize software releases? I don't know. Here is how I abuse #SQL to turn our 27 releases of our open source repo this year as a line chart github.com/timeplus-io/...
#data #viz #chart
#data #viz #chart
December 20, 2024 at 2:44 AM
What's best way to visualize software releases? I don't know. Here is how I abuse #SQL to turn our 27 releases of our open source repo this year as a line chart github.com/timeplus-io/...
#data #viz #chart
#data #viz #chart
Anyone using flyway? One of our customers prefer using it and we added a Timeplus plugin for it, and I found a bug to handle protobuf in SQL statement, so I filed an issue on their repo and got lucky number 4000 github.com/flyway/flywa...
Semicolon inside $$ block are treated as statement delimiter · Issue #4000 · flyway/flyway
Which version and edition of Flyway are you using? Flyway OSS Edition 11.1.0 by Redgate If this is not the latest version, can you reproduce the issue with the latest one as well? (Many bugs are fi...
github.com
December 18, 2024 at 10:53 PM
Anyone using flyway? One of our customers prefer using it and we added a Timeplus plugin for it, and I found a bug to handle protobuf in SQL statement, so I filed an issue on their repo and got lucky number 4000 github.com/flyway/flywa...
Looking at such realtime chart for #bitcoin is both satisfying and terrifying [You can try this via demo.timeplus.cloud and choose the marketdata demo set, and go Dashboards]
December 12, 2024 at 11:27 PM
Looking at such realtime chart for #bitcoin is both satisfying and terrifying [You can try this via demo.timeplus.cloud and choose the marketdata demo set, and go Dashboards]
You can use a single command to load live #bluesky feed to a SQL database and build viz/alerts. Say you can check how people are talking about you or your brand and take some actions, or train an AI model. 10min short video, or just check the first 30s www.youtube.com/watch?v=QjIb...
Real-time social listening and action with Bluesky and Timeplus
YouTube video by Timeplus
www.youtube.com
December 12, 2024 at 6:05 AM
You can use a single command to load live #bluesky feed to a SQL database and build viz/alerts. Say you can check how people are talking about you or your brand and take some actions, or train an AI model. 10min short video, or just check the first 30s www.youtube.com/watch?v=QjIb...
www.apache.org/logos/ is such a nice site to download the official logos for Apache projects. I used to download them via wikipedia or crop from different websites
Apache Project logosWelcome to The Apache Software Foundation!
www.apache.org
December 4, 2024 at 5:56 AM
www.apache.org/logos/ is such a nice site to download the official logos for Apache projects. I used to download them via wikipedia or crop from different websites
I just knew something new: Oracle doesn't support AS for table alias.. github.com/dbeaver/dbea...
December 3, 2024 at 6:32 AM
I just knew something new: Oracle doesn't support AS for table alias.. github.com/dbeaver/dbea...
Speed-run🏃♂️➡️ Setup a EC2 box and build a real-time dashboard with Timeplus for #BitCoin price in just 2 mins
* The free-trier t2.micro, with 1 vCPU and 1 G memory, and 8GB disk is just fine
* Download the 200MB Timeplus package
* You can grab the live price from #coinbase with 3 clicks.
* #OHLC viz
* The free-trier t2.micro, with 1 vCPU and 1 G memory, and 8GB disk is just fine
* Download the 200MB Timeplus package
* You can grab the live price from #coinbase with 3 clicks.
* #OHLC viz
December 3, 2024 at 12:39 AM
Speed-run🏃♂️➡️ Setup a EC2 box and build a real-time dashboard with Timeplus for #BitCoin price in just 2 mins
* The free-trier t2.micro, with 1 vCPU and 1 G memory, and 8GB disk is just fine
* Download the 200MB Timeplus package
* You can grab the live price from #coinbase with 3 clicks.
* #OHLC viz
* The free-trier t2.micro, with 1 vCPU and 1 G memory, and 8GB disk is just fine
* Download the 200MB Timeplus package
* You can grab the live price from #coinbase with 3 clicks.
* #OHLC viz
I am a weekly-active-user of @sidequery.ai , if not DAU
Our AWS security groups are `launch-wizard-` and they cannot be renamed 😭 I don't think there is an easy way in AWS console to see which port is allowed in which SG. Well, you can export the data to CSV. Don't use a text editor to search. Try SQL, such as sidequery.ai with in memory duckdb
December 2, 2024 at 6:42 PM
I am a weekly-active-user of @sidequery.ai , if not DAU
Some of my BlackFriday purchases:
* Filmora, video editor, perpetual license, 80->60. Reasons: all-in-one video editor, AI features LGTM, support the developers
* TablePlus, SQL client, perpetual license, 90->68. Reasons: lightweight SQL client on Mac, support the developers
* God of War: Ragnarök
* Filmora, video editor, perpetual license, 80->60. Reasons: all-in-one video editor, AI features LGTM, support the developers
* TablePlus, SQL client, perpetual license, 90->68. Reasons: lightweight SQL client on Mac, support the developers
* God of War: Ragnarök
November 29, 2024 at 6:41 PM
Some of my BlackFriday purchases:
* Filmora, video editor, perpetual license, 80->60. Reasons: all-in-one video editor, AI features LGTM, support the developers
* TablePlus, SQL client, perpetual license, 90->68. Reasons: lightweight SQL client on Mac, support the developers
* God of War: Ragnarök
* Filmora, video editor, perpetual license, 80->60. Reasons: all-in-one video editor, AI features LGTM, support the developers
* TablePlus, SQL client, perpetual license, 90->68. Reasons: lightweight SQL client on Mac, support the developers
* God of War: Ragnarök
Our AWS security groups are `launch-wizard-` and they cannot be renamed 😭 I don't think there is an easy way in AWS console to see which port is allowed in which SG. Well, you can export the data to CSV. Don't use a text editor to search. Try SQL, such as sidequery.ai with in memory duckdb
November 28, 2024 at 8:15 PM
Our AWS security groups are `launch-wizard-` and they cannot be renamed 😭 I don't think there is an easy way in AWS console to see which port is allowed in which SG. Well, you can export the data to CSV. Don't use a text editor to search. Try SQL, such as sidequery.ai with in memory duckdb
After getting a few good deals on Xbox and PS Store, I am waiting for Steam Autumn Sale.. Why they don't call this BlackFriday❓https://steamdb.info/sales/history/
November 27, 2024 at 6:27 AM
After getting a few good deals on Xbox and PS Store, I am waiting for Steam Autumn Sale.. Why they don't call this BlackFriday❓https://steamdb.info/sales/history/
Many organizations standardize streaming processing with Apache Flink and use OLAP databases (e.g. ClickHouse) as the downstream or serving layer. Nothing wrong with it. But what if you can use a single system to do both Flink and ClickHouse's job. That's why we built Timeplus, a C++ based Flink+CH
November 27, 2024 at 4:16 AM
Many organizations standardize streaming processing with Apache Flink and use OLAP databases (e.g. ClickHouse) as the downstream or serving layer. Nothing wrong with it. But what if you can use a single system to do both Flink and ClickHouse's job. That's why we built Timeplus, a C++ based Flink+CH