Release v5.3.x

2025-03-12

Version description of the v5.3.0 release of SlideRule Earth.

New Functionality

  • v5.3.0 - #598 - Added h5x endpoint for GeoDataFrames of arbitrary h5 resources

  • v5.3.0 - #599 - Added atl09_fields parameter for ATL09 sampling for atl03x, atl06x, atl08x, and atl13x

  • v5.3.0 - #600 - Authenticator supports affiliate organization role

  • v5.3.0 - Clusters support user service capacity requests; authorized users can request an autoscaling group of nodes on the public cluster dedicated just to them, similar to how a private cluster works, but going through the public load balancer

  • v5.3.0 - 2e25ecf - added segment_id to atl03x dataframe

  • v5.3.2 - b5e47e9 - SurfaceBlanket runner iceat2.blanket provides ground and canopy heights for ATL03 data

  • v5.3.2 - 4c87b9e - Deduplicator frame runner dedup provided for remove duplicate rows in dataframes

  • v5.3.2 - ATL13 AMS support upgraded to release 007, along with internal optimizations and full support for geospatial queries

Issues Resolved

  • v5.3.0 - 2e25ecf - ATL09 sampling now uses delta_time only for bckgrd_atlas group and uses segment_id for high_rate and low_rate groups.

  • v5.3.1 - 581a221 - Orchestrator fix for service names that are break prometheus metric collection

  • v5.3.1 - 2c55f19, 514c01f - User service fixes and documentation

  • v5.3.1 - f5c172b - h5x to use NAME_INDEX_OPTION

  • v5.3.1 - 4c87b9e - base64 encoding support for standard and URL encodings

  • v5.3.2 - bd0e9a8 - ATL09 sampler alignment fixes

  • v5.3.2 - #603 - support for trailing slashes in h5x group names; enhanced h5coro docs

Development Updates

  • v5.3.0 - 4c6ca35 - removed hard coded host zone in certbot yml

  • v5.3.0 - 4c6ca35 - improved user friendliness of makefile cluster target outputs

  • v5.3.0 - 4c6ca35 - trimmed the package list from the version output

  • v5.3.1 - Third-party support for ChatGPT authorization

  • v5.3.2 - Job runner updates and fixes

Getting This Release

https://github.com/SlideRuleEarth/sliderule/releases/tag/v5.3.0

Metrics

clients/python/utils/benchmark.py

atl06_aoi <776718 x 16> - 30.087476 secs
atl06_ancillary <916 x 17> - 3.353301 secs
atl03_ancillary <916 x 17> - 2.959630 secs
atl06_parquet <1600 x 18> - 2.908771 secs
atl03_parquet <23072 x 23> - 1.624614 secs
atl06_sample_landsat <916 x 20> - 64.363435 secs
atl06_sample_zonal_arcticdem <1695 x 27> - 4.863028 secs
atl06_sample_nn_arcticdem <1695 x 20> - 4.558551 secs
atl06_msample_nn_arcticdem <1695 x 20> - 4.688760 secs
atl06_no_sample_arcticdem <1695 x 16> - 2.671152 secs
atl03_rasterized_subset <51832 x 22> - 2.950499 secs
atl03_polygon_subset <50615 x 22> - 2.139540 secs

clients/python/utils/baseline.py

GEDI / 3DEP = 2661.4238434013237
ICESat-2 / ArcticDEM = 1598.2301327720206
ICESat-2 / ATL06p = 1809.893690173468
ICESat-2 / PhoREAL = 3.245903730392456