End-to-end examples

The following examples demonstrate the use of VirtualiZarr to create virtual datasets of various kinds.

V2 Examples

These examples use the VirtualiZarr 2.x API with obstore for cloud storage access:

1. Virtualizing GOES-16 satellite data (basic) - Virtualizes a GOES-16 file using a standard obstore. Use as a baseline for performance comparison.
2. Virtualizing GOES-16 satellite data with optimized store wrappers - Demonstrates using CachingReadableStore and SplittingReadableStore from obspec-utils to optimize metadata access when virtualizing remote HDF5/NetCDF files.

V1 Examples

Note

The V1 examples listed here use a pre-2.0 release of VirtualiZarr.

1. Appending new daily NOAA SST data to Icechunk
2. Parallel reference generation using Coiled Functions
3. Serverless parallel reference generation using Lithops
4. MUR SST Virtual and Zarr Icechunk Store Generation using Lithops