UDP fails on small area and 7 month time series #1
Description
EFAST run with relatively small area of extent fails when allocating a 1.87 GB in _compute_normalized_composite.
{
"process_graph": {
"efast": {
"arguments": {
"interval_days": 5,
"output_ndvi": true,
"s2_data_bands": [
"B04",
"B8A"
],
"s3_data_bands": [
"Syn_Oa08_reflectance",
"Syn_Oa17_reflectance",
"CLOUD_flags"
],
"spatial_extent": {
"coordinates": [
[
[
-0.7995209522876185,
51.444249079728195
],
[
-1.4233190424180517,
51.444249079728195
],
[
-1.4233190424180517,
51.74084945003008
],
[
-0.7995209522876185,
51.74084945003008
],
[
-0.7995209522876185,
51.444249079728195
]
]
],
"type": "Polygon"
},
"temporal_extent": [
"2025-03-15T00:00:00Z",
"2025-10-15T00:00:00Z"
]
},
"description": "The Efficient Fusion Algorithm Across Spatio-Temporal Scales (EFAST) is a method to create time-series with a fine resolution in space and time from a fine spatial but coarse temporal resolution source (Sentinel-2) and a coarse temporal but fine spatial resolution source (Sentinel-3).",
"namespace": https://raw.githubusercontent.com/bcdev/efast-process-graph/refs/heads/main/process_graph.json,
"process_id": "efast",
"result": true
}
}
}Stacktrace from OpenEO Logs:
OpenEO batch job failed: UDF exception while evaluating processing graph. Please check your user defined functions. stacktrace: File "<string>", line 36, in apply_datacube File "<string>", line 97, in _compute_combined_score_no_intermediates File "/opt/venv/lib64/python3.11/site-packages/xarray/core/computation.py", line 1268, in apply_ufunc return apply_dataarray_vfunc( ^^^^^^^^^^^^^^^^^^^^^^ ... skipped stack frames ... File "<string>", line 114, in _compute_normalized_composite File "/opt/venv/lib64/python3.11/site-packages/numpy/_core/einsumfunc.py", line 1610, in einsum return c_einsum(*operands, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ numpy._core._exceptions._ArrayMemoryError: Unable to allocate 1.87 GiB for an array with shape (43, 357, 128, 128) and data type float64