Who's On First

version 0.0.4 of the https://github.com/whosonfirst/go-dedupe/tree/main/embeddings#llamafileembedder package which we are using to de-duplicate venues has been released / adding support for generating text embeddings using mozilla's https://github.com/Mozilla-Ocho/llamafile application / background – https://whosonfirst.org/blog/2024/08/16/dedupe/

version 0.0.2 of the https://github.com/whosonfirst/go-dedupe package which we are using to de-duplicate venues has been released / adding support for storing and querying locations using duckdb and the vss extension / background – https://whosonfirst.org/blog/2024/08/16/dedupe/

today's venue de-duplication news includes / 1,500 freshly deprecated duplicate records, 15,000 new overture place concordances and 800 new all the places venue concordances in the whosonfirst-data-venue-us-ma repository / and working implementations of the location and vector database interfaces using duckdb which will be merged in to the main branch shortly / background – https://whosonfirst.org/blog/2024/08/16/dedupe/

there is a kitchen-sink "wof" command line tool that I've been working on / which deserves its own long and twisty blog post soon / but for now I'll just say that / it has learned how to produce geoparquet databases from one or more who's on first repositories – https://github.com/whosonfirst/wof-cli?tab=readme-ov-file#example-geoparquet

"Using four Who’s On First different venue repositories for testing, I have been able to first deprecate about 45,000 duplicate records and then, second, derive over 100,000 concordances with Overture Data place records, 8,000 concordances with All The Places venues and another 500 concordances with ILMS museum records. There are almost certainly still bugs, or at least “gotchas”, but importantly the work so far passes the “better than yesterday” test." – https://whosonfirst.org/blog/2024/08/16/dedupe/

"Who’s On First shapefile downloads in QGIS and on HDX" by @kelsoscorner@mstdn.party – https://whosonfirst.org/blog/2024/07/18/more-shapefiles/

there is now a handy "wof-cli" tool / for performing common operations on one or more who's on first documents / from the command line – https://github.com/whosonfirst/wof-cli

have you ever wanted to produce a geoparquet database file / from all repositories containing who's on first style documents in a github organization / now you can – https://github.com/whosonfirst/go-whosonfirst-geoparquet

recent changes to the go-whosonfirst-spatial-pmtiles package result in container files that 30% smaller / recent changes to tippecanoe means that container can create a protomaps tiles database for reverse-geocoding with global coverage / that is 50% smaller (4GB instead of 8GB) – https://github.com/whosonfirst/go-whosonfirst-spatial-pmtiles

have you ever wanted to filter bags of line-separated geojson overture maps data / in to new bags of line-separated geojson data but with a who's on first parent id, hierarchy and placetype appended to each record / now you can – https://github.com/whosonfirst/go-overture#append-wof

have you ever wanted to filter bags of line-separated geojson overture maps data / in to new bags of line-separated geojson data grouped by country code / now you can – https://github.com/whosonfirst/go-overture#to-country-jsonl

In case you were wanting to export all the data in the Overture venues release/ to plain-vanilla line-separated geojson files / so you can process each record atomically without having to parse a n-GB feature collection file / here is one way to do that – https://gist.github.com/thisisaaronland/55061c8a4c0f0618be58531436540002

@ian@social.modest.com @mvexel@en.osm.town we have always been at war with the past – https://whosonfirst.org/blog/2017/10/24/whosonfirst-sotmus-2017/#outofdate

"Who’s On First now provides the best open data for towns and villages in India, with 915,468 locality records and 190,397 neighbourhood records (with 579,116 detailed polygons), thanks to the Karmashapes initiative." – https://whosonfirst.org/blog/2023/06/19/introducting-karmashapes/

if you've found yourself asking / what is "the state of the whosonfirst gazetteer?" in 2023 / @kelsoscorner@mstdn.party has the answer – https://whosonfirst.org/blog/2023/06/07/state-of-the-gazetteer/

@kelsoscorner@mstdn.party did the heavy-lifting to compile all the updates to the who's on first data repositories / between 2015 and the present / and it is full of updates – https://github.com/whosonfirst-data/whosonfirst-data/blob/master/CHANGELOG.md

have you ever wanted to use the various Who's On First placetype methods written in Go in your JavaScript / now you can – https://github.com/whosonfirst/go-whosonfirst-placetypes-wasm

this has not been integrated in to any of the who's on first python packages yet / but that's the plan – https://millsfield.sfomuseum.org/blog/2023/02/16/py-edtf/