Skip to content

mkdir does not create dirs with herarchical namespace enabled #203

Closed
@lmmentel

Description

@lmmentel

I have a storage account (V2) with hierarchical namespace enabled and cannot get any of the mkdir, mkdirs, makedir or makedirs to actually create a directory:

Here is a minimal example:

fs = fsspec.filesystem('abfs', connection_string=connection_string)
fs.makedir("test/test-dir/")

What happened:

In both cases, when test container exists and if it does not, behavior is the same and without exist_ok=True gives me

...
StorageErrorException: Operation returned an invalid status 'Server encountered an internal error. Please try again after some time.'
...
During handling of the above exception, another exception occurred:

FileExistsError: Cannot overwrite existing Azure container -- test already exists.                         with Azure error Server encountered an internal error. Please try again after some time.
RequestId:efdce538-d01e-0002-0f21-24942d000000
Time:2021-03-28T22:23:39.9321554Z
ErrorCode:InternalError
Error:None

With exist_ok=True it just hangs for some time, does not give any output and does not create the directory.

What you expected to happen:

To the directory to be created for the specified path.

Anything else we need to know?:

I went through #137 and can create directories when hierarchical namespace option is disabled but then even when I include a trailing / a bunch of empty <no_name> files are produced in the dirs. I guess this is an artifact of creating virtual dirs.

Environment:

  • Dask version: 2021.3.1
  • Python version: 3.8.5
  • Operating System: linux mint 20.1
  • Install method (conda, pip, source): poetry

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions