Post #2154508
2026-04-02 20:14 UTC
@emjonaitis
a local DBMS instance with appropriate indexes defined and using the relevant R-dbms interface might be worth the hassle in this case? (Or pre-processing in DBMS to small extract files.)
Replies (1)
-
@jmcastagnetto@mastodon.social 2026-04-03 02:09
@BRicker @emjonaitis I have had good experience dealing with datasets in the hundreds of millions, using duckdb as the local database. Also, judicious use of parquet partitions might help.