Post #2516500
2026-05-12 22:09 UTC
What's the current state of remote parquet-querying tools (duckdb, arrow, maybe polars) and WebR? That is, if I want a WebR/Shinylive app to query a remote parquet file and only transfer the query results? Or is the way to go, say, loading duckdb's WASM build and have a shiny call it via eval_js? Any examples?
@hrbrmstr @jeroenooms @gws @kirill
#RStats #WebR #DuckDB
Replies (2)
-
@dplattsf@sfba.social 2026-05-12 23:58
@noamross@ecoevo.social @hrbrmstr@mastodon.social @jeroenooms@fosstodon.org @gws@fosstodon.org @kirill@fosstodon.org duckdb against s3 buckets is phenomenal. It’s the only tool/library I use for serious data retrieval of column oriented data structures. You want to prep your parquet files thoughtfully. decent row group size and sort order but it does the rest.
-
@dplattsf@sfba.social 2026-05-12 23:59
@noamross@ecoevo.social @hrbrmstr@mastodon.social @jeroenooms@fosstodon.org @gws@fosstodon.org @kirill@fosstodon.org https://stackoverflow.com/questions/76696239/predicate-pushdown-in-duckdb-for-a-parquet-file-in-s3#76718937