update cmems insitu from FTP to copernicusmarine files service

[veenstrajelmer]

Update 8-4-2024: ftp was discontinued, so we have to use an alternative.

Subset is still not yet possible for insitu, only direct download from website. When trying import copernicusmarine; copernicusmarine.open_dataset(dataset_id="cmems_obs-ins_glo_phy-ssh_my_na_PT1H"), this currently (9-4-2024) raises: "NoServiceAvailable: No service available for dataset with command load"

However, we can use the copernicusmarine "files" service:

import copernicusmarine
import dfm_tools as dfmt
# dfmt.download.copernicusmarine_reset()

copernicusmarine.get(
dataset_id="cmems_obs-ins_glo_phy-ssh_my_na_PT1H",
service="files",
filter="*BO_TS_TG_Dragor_60minute.nc",
# filter="*index_history.txt",
output_directory=".",
overwrite_output_data=True,
# force_download=True,
no_directories=True,
download_file_list=True
)

The index_history.txt file is found with the index_parts=True argument:

copernicusmarine.get(
dataset_id="cmems_obs-ins_glo_phy-ssh_my_na_PT1H",
service="files",
# filter="*BO_TS_TG_Dragor_60minute.nc",
filter="*index_history.txt",
index_parts=True,
output_directory=".",
overwrite_output_data=True,
# force_download=True,
no_directories=True,
)

Todo:

• also requires a higher copernicusmarine version (1.1.0 works), so update pyproject.toml
• move to this copernicusmarine files service
• simplify dfmt.copernicusmarine_credentials() (no need to return user/pass anymore)
• update whatsnew.md