Post #2312781
2026-05-07 23:50 UTC
@LeafyEricScott@hachyderm.io
Somewhat coincidentally, Daniel Lakeland recently asked a similar question, but he was using Julia. My recommendation is the same: import the data to a database using SQL tools and then connect to the database or export to a cleaned CSV. Here's a SQL tool that has all the metacommands and configuration options you need: https://pypi.org/project/execsql/ (disclaimer: I wrote it).
Replies (1)
-
@LeafyEricScott@hachyderm.io 2026-05-08 00:08
@rdnielsen@floss.social Hmm... yeah maybe a SQL or @duckdb@mastodon.social way to ingest all these CSVs into a database despite the differing number of columns.