im not sure what is involved in making extensions to torch in R but—this is working for me
github.com/mlverse/torc...

rlang::list2(...)

<3

heard, thanks! :)

you can use the @posit.co Ark kernel with Zed but it's not the console type vibe i want :/
zed.dev/docs/repl#in...

At my last use, duckplyr uses the in-memory duckdb database which doesn’t support out-of-core processing. does it now set up a temporary duckdb database?

say it with me!!!

duck👏🏼 plyr 👏🏼 doesn't 👏🏼 support 👏🏼 larger 👏🏼 than 👏🏼 memory 👏🏼 workloads 👏🏼 but 👏🏼 DuckDB 👏🏼 with 👏🏼 {dbplyr} 👏🏼 does

We did this with Azure Blobfuse. This requires that you also have an .Rprofile to update your `.libPaths()` as well.

Just pure pain.

databricks clusters are also ephemeral so if you want any libraries you have to install em with a startup script. One way to get around it is to use Docker container based images which have the packages you use installed. OR you use a startup script to mount the persistent dir to your runtime.

What we did in my previous role was that we had 2 docker images: one for interactive development that had RStudio Workbench (now Posit Workbench) and another that did not have it. The latter was used for integration into the Databricks jobs—b/c you cannot use Job scheduler when using brickster

(sorry, jeremy gonna give an outside view on this one :P )
the R + Databricks "story" tends to be "use your own infrastructure with an Databricks connect and use {dbplyr}". Like 90% of the use case of Databricks is their compute so having to standup additional infra is a tough call.

its absolute crap.

Awesome! there's also an example "highly performant" shiny app in there too
github.com/flrsh-dev/fl...

"live" link: flrsh.dev/courses/duck...

i started drafting what i thought was the most important about duckdb a while ago. never finished tho...classic.
github.com/flrsh-dev/fl...

multiple

I cannot for the life of me figure out how to use this feature. It _seems_ so cool but I just dont get it