Sept. 2, 2021
Here is the link.
40:40/ 55:07
Anthouny Fox
Director / Lead developer
Spatial and Spatio-temporal data
AIS - Automatically identified information - vessel broadcast location every six seconds - satellite picks up
Strava collects up - produces 8 millions a day - fitness - every second - measure
- heart rate
- more ...
Open source project - spatial data - LocationTech GeoMesa
Apache Kafka -
LocationTech GeoMesa
Indexing Spatio-temporal data in Bigtable
- Bigtable has a single dimension lexicographic sorted index.
- What if we concatenated latitude and longitude?
Indexing Spatio-temporal data in Bigtable using Space-filling curves
We need to encode latitude, longitude, and time into a lexicographically sortable Bigtable key so that data that is nearby in physical space is nearby in index space
- Space-filling curves project multiple dimensions into a single dimension while preserving locality
- Hilbert curve - good locality
- Z-order curve - simple
- Google S2 - minimizes distortion
Regions translate to range scans - Bigtable index [0, 2^32]
No comments:
Post a Comment