add python CLI bindings

[kevinjqliu]

Closes #113

This PR creates the tpchgen-cli pypi package using maturin and exposes the rust binary as python executable.
It also adds the .github/workflows/tpchgen-cli-publish-pypi.yml Github Action to publish to pypi on new release.

This PR allows tpchgen-cli to be installed via pip and used like so:

pip install tpchgen-cli
tpchgen-cli --help

.github/workflows/tpchgen-cli-publish-pypi.yml is generated using maturin generate-ci github and then edited.
The github action is tested using my fork and published the package to testpypi.
Try it out:

pip install -i https://test.pypi.org/simple/ tpchgen-cli
tpchgen-cli --help

I added both kevinjqliu/tpchgen-rs and clflushopt/tpchgen-rs as trusted publishers in testpypi

I think we should merge this PR as is, pointing to testpypi. Run the github action on main, verify that it can publish to testpypi, and then edit the github action to publish to pypi.

Dev Env

Setup

cd tpchgen-cli
python -m venv .venv                                   
source .venv/bin/activate
pip install -U pip maturin

Develop

maturin develop --release

Run

tpchgen-cli --help
tpchgen-cli

[alamb]

That is pretty sweet.

Maybe we can get a homebrew recipe too ?

[kevinjqliu]

Thanks @alamb I created #126 to track homebrew installation.

[alamb]

Thank yoU @kevinjqliu -- do you have any idea how to test this? I feel if we merged this PR the CI would likely not work on our next release but I don't know that for sure

[clflushopt]

This is great @kevinjqliu - thank you ! Btw, do you expect a need for having bindings from the core crate so it's usable as Python library ?

Edit: I'll review and test after the long weekend, I will also setup the publishing workflow via PyPi.

[kevinjqliu]

Btw, do you expect a need for having bindings from the core crate so it's usable as Python library ?

I dont see a need right now. Personally, I just wanted to pip install it. In the future, we can create python bindings for the core crate and release it under the tpchgen pypi package.

I'll review and test after the long weekend, I will also setup the publishing workflow via PyPi.

Sounds good! No rush.

Do you have a testpypi account? I can add you to the project in testpypi

[kevinjqliu]

I tested the github action run using my fork and published the package to testpypi.

I added both kevinjqliu/tpchgen-rs and clflushopt/tpchgen-rs as trusted publishers in testpypi

I think we should merge this PR as is, pointing to testpypi. Run the github action on main, verify that it can publish to testpypi, and then edit the github action to publish to pypi.

[alamb]

@kevinjqliu I think this is a great idea and will expand the reach of tpchgen a lot.

Unfortuantely I don't have time to help manage / test this, but I think we should just give you the permissions to do it yourself:

• #131