FuseTS udf Artifactory usage error

1

Hi all,

I am trying to use the FuseTS MOGPR mapping package for temporal reconstruction of netCDFs-geoTiffs.

I would like to use an “udf” as per described in the documentation for MOGPR (JSON for MOGPR udf).

I am also using the execute_batch function to run the process, with these artifacts: Artifact “fusets.zip” and Artifact “fusets_venv.zip”.

Now, since I would like to customize my workflow, specifically setting the Tstep = 20 in the mogpr.py file, I have created my own artifactory where I host the code, which is exactly the same as for VITO’s fusets.zip, with Tstep =20.

The resulting error I get is the following:

OpenEoApiError: [500] Internal: Server error: Failed to start batch job (YARN submit failure). (ref: r-240226868335410d8214068e0a706144)

Any help would be greatly appreciated, I’ve been battling with this for weeks now.
Thanks in advance
Dávid

2

hi Dávid,

How are you submitting/creating your job?

In the error logs of r-240226868335410d8214068e0a706144 I see things like

java.net.URISyntaxException: Expected scheme-specific part at index 6: https:
3

Hi Stefaan

Here is my code with which I submit the job:

merged_datacube = sensor_1.merge(sensor_2) # used .load_disk_collection to load data from Terrascope VM

service = 'mogpr'
namespace = 'u:fusets'
mogpr = connection.datacube_from_process(service,
                                         namespace=f'https://openeo.vito.be/openeo/1.1/processes/{namespace}/{service}',
                                         data=merged_datacube)

mogpr_output_file = './mogpr-multisource.nc'

mogpr_job = mogpr.execute_batch(mogpr_output_file,
                                out_format="netcdf",
                                title=f'{band_var_sensor1}_HAIN_MOGPR',
                                job_options={
        'executor-memory': '10g',
        'udf-dependency-archives': [
            'https://artifactory.vgt.vito.be:443/artifactory/auxdata-public/ai4food/fusets_venv.zip#tmp/venv',
            'https://davidka.jfrog.io/artifactory/mogpr-generic-local/fusets.zip#tmp/venv_static'
        ]
    })
4

Stefaan,
do you have any updates/suggestion on how could I solve this issue?

Thanks
Dávid

5

That URL from your custom artifactory apparently requires authentication, which is probably the reason or related to the failure:

$ curl https://davidka.jfrog.io/artifactory/mogpr-generic-local/fusets.zip
{
  "errors" : [ {
    "status" : 401,
    "message" : "Authentication is required"
  } ]
}