Skip to content

Getting Error While Extracting #1470

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
emirardagn opened this issue Feb 3, 2025 · 4 comments · May be fixed by #1484
Open

Getting Error While Extracting #1470

emirardagn opened this issue Feb 3, 2025 · 4 comments · May be fixed by #1484

Comments

@emirardagn
Copy link

Extracting flash_attn-3.0.0b1-py3.12-linux-x86_64.egg to /data/conda/envs/vllm/lib/python3.12/site-packages

Adding flash-attn 3.0.0b1 to easy-install.pth file

Installed /data/conda/envs/vllm/lib/python3.12/site-packages/flash_attn-3.0.0b1-py3.12-linux-x86_64.egg

Processing dependencies for flash-attn==3.0.0b1

Searching for ninja==1.11.1.3

Best match: ninja 1.11.1.3

Processing ninja-1.11.1.3-py3.12-linux-x86_64.egg

Adding ninja 1.11.1.3 to easy-install.pth file

Traceback (most recent call last):

File "/home/A06506/test/flash-attention/hopper/setup.py", line 600, in

 setup(

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/init.py", line 117, in setup

 return distutils.core.setup(**attrs)

        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 183, in setup

 return run_commands(dist)

        ^^^^^^^^^^^^^^^^^^

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 199, in run_commands

 dist.run_commands()

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 954, in run_commands

 self.run_command(cmd)

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/dist.py", line 950, in run_command

 super().run_command(command)

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 973, in run_command

 cmd_obj.run()

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/install.py", line 97, in run

 self.do_egg_install()

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/install.py", line 158, in do_egg_install

 cmd.run(show_deprecation=False)

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 439, in run

 self.easy_install(spec, not self.no_deps)

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 689, in easy_install

 return self.install_item(None, spec, tmpdir, deps, True)

        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 739, in install_item

 self.process_distribution(spec, dist, deps)

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 799, in process_distribution

 self.easy_install(dist.as_requirement())

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 712, in easy_install

 return self.install_item(spec, dist.location, tmpdir, deps)

        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 742, in install_item

 self.process_distribution(spec, dists[0], deps, "Using")

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 770, in process_distribution

 self.install_egg_scripts(dist)

File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 639, in install_egg_scripts

 dist, script_name, dist.get_metadata('scripts/' + script_name)

                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/data/conda/envs/vllm/lib/python3.12/site-packages/pkg_resources/init.py", line 1703, in get_metadata

 return value.decode('utf-8')

        ^^^^^^^^^^^^^^^^^^^^^

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xac in position 25: invalid start byte in scripts/ninja file at path: /data/conda/envs/vllm/lib/python3.12/site-packages/ninja-1.11.1.3-py3.12-linux-x86_64.egg/EGG-INFO/scripts/ninja

@tridao
Copy link
Member

tridao commented Feb 3, 2025

Can you say what steps are required to reproduce this?

@kevmo314
Copy link
Contributor

kevmo314 commented Feb 9, 2025

I am able to reproduce this by installing FA3 on a GH200 in a clean virtualenv.

$ python3 --version
Python 3.10.12

kevmo314 added a commit to kevmo314/flash-attention that referenced this issue Feb 9, 2025
Fixes Dao-AILab#1470

This section is for runtime dependencies and `ninja` is more necessary at build time, not at run time. I'm not sure why adding it is causing the error in the linked issue but removing it resolves the error.
@kevmo314 kevmo314 linked a pull request Feb 9, 2025 that will close this issue
@RuiWang1998
Copy link

Got the exact same issue here.

@zobinHuang
Copy link

Got the same issue here, with official CUDA 12.8 container environment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants