Description
I have a storage account (V2) with hierarchical namespace enabled and cannot get any of the mkdir
, mkdirs
, makedir
or makedirs
to actually create a directory:
Here is a minimal example:
fs = fsspec.filesystem('abfs', connection_string=connection_string)
fs.makedir("test/test-dir/")
What happened:
In both cases, when test
container exists and if it does not, behavior is the same and without exist_ok=True
gives me
...
StorageErrorException: Operation returned an invalid status 'Server encountered an internal error. Please try again after some time.'
...
During handling of the above exception, another exception occurred:
FileExistsError: Cannot overwrite existing Azure container -- test already exists. with Azure error Server encountered an internal error. Please try again after some time.
RequestId:efdce538-d01e-0002-0f21-24942d000000
Time:2021-03-28T22:23:39.9321554Z
ErrorCode:InternalError
Error:None
With exist_ok=True
it just hangs for some time, does not give any output and does not create the directory.
What you expected to happen:
To the directory to be created for the specified path.
Anything else we need to know?:
I went through #137 and can create directories when hierarchical namespace option is disabled but then even when I include a trailing /
a bunch of empty <no_name>
files are produced in the dirs. I guess this is an artifact of creating virtual dirs.
Environment:
- Dask version: 2021.3.1
- Python version: 3.8.5
- Operating System: linux mint 20.1
- Install method (conda, pip, source): poetry