or
or
By clicking below, you agree to our terms of service.
New to HackMD? Sign up
Syntax | Example | Reference | |
---|---|---|---|
# Header | Header | 基本排版 | |
- Unordered List |
|
||
1. Ordered List |
|
||
- [ ] Todo List |
|
||
> Blockquote | Blockquote |
||
**Bold font** | Bold font | ||
*Italics font* | Italics font | ||
~~Strikethrough~~ | |||
19^th^ | 19th | ||
H~2~O | H2O | ||
++Inserted text++ | Inserted text | ||
==Marked text== | Marked text | ||
[link text](https:// "title") | Link | ||
 | Image | ||
`Code` | Code |
在筆記中貼入程式碼 | |
```javascript var i = 0; ``` |
|
||
:smile: | ![]() |
Emoji list | |
{%youtube youtube_id %} | Externals | ||
$L^aT_eX$ | LaTeX | ||
:::info This is a alert area. ::: |
This is a alert area. |
On a scale of 0-10, how likely is it that you would recommend HackMD to your friends, family or business associates?
Please give us some advice and help us improve HackMD.
Do you want to remove this version name and description?
Syncing
---
Pangeo Machine Learning working group presentation
Monday 7 Nov 2022, 17:00-17:15 (UTC)
by Wei Ji Leong
P.S. Slides are at https://hackmd.io/@weiji14/2022zen3geo
Why not zen3geo
Why zen3geo
Design patterns
Relation of GeoML libraries - https://github.com/weiji14/zen3geo/discussions/70
Minimal core, optional extras
pip install ...
zen3geo
zen3geo[raster]
zen3geo[spatial]
zen3geo[stac]
zen3geo[vector]
Write libraries, not frameworks
Composition over Inheritance
Chaining or 'Pipe'-ing a series of operations, rather than subclassing
E.g. RioXarrayReader - Given a source list of GeoTIFFs, read them into an xarray.DataArray one by one
I/O readers, custom processors, joiners, chippers, batchers, etc. More at https://zen3geo.rtfd.io/en/v0.5.0/api.html
Xarray data model
Labelled multi-dimensional data arrays!
Store multiple bands/variables, time indexes, and metadata!
The features you've been waiting for
Cloud-native geospatial with STAC
Standards based spatiotemporal metadata!
From querying STAC APIs to stacking STAC Items,
stream data directly from cloud to compute!
More info at https://github.com/weiji14/zen3geo/discussions/48
Transforms as functions, not classes
Do conversions in original data structure (
xarray
)vs
on tensors with no labels (
torch
) via subclassingFeatures you never thought you needed
Multiple coordinate reference systems
without reprojecting!
E.g. if you have many satellite scenes spanning several UTM zones
Enabled by torchdata's data agnostic Batcher iterable-style DataPipe
Multiple dimensions
stack co-located data
E.g. time-series data or multivariate climate/ocean model outputs
Enabled by xarray's rich data structure
Beyond zen3geo v0.5.0
Multiple spatiotemporal resolutions
10m, 20m, 60m, …
Handle in xbatcher via datatree - https://github.com/xarray-contrib/xbatcher/issues/93
Allows for:
From
Pytorch
toNone
Once
torchdata
becomes standalone frompytorch
,see https://github.com/pytorch/data/issues/293
Dropping the
torch
dependency frees up space for other ML libraries - e.g. cuML, Tensorflow, etcUnleash your
data