Skip to content

Migrate the app (ktransformers) to SYCL/oneAPI #2684

Open
@zhimingwang36

Description

@zhimingwang36

Target to migrate https://github.com/kvcache-ai/ktransformers.git to SYCL with the SYCLomatic tool: Analysis the migration gap, and fix the migration gap if possible.

  1. Migrate each CUDA file to SYCL file with the SYCLomatic tool.

  2. Build the SYCL file with SYCL compiler, fix the issues manually.

    a. For API/ASM not supported by the tool, it’s better to manual write an equal functionality with SYCL/oneAPI lib (which can be used to extent the migration capability of SYCLomatic).
    b. Or, Just comment out to make sure other code build well if SYCL/oneAPI side doesn’t have similar functionality.

  3. Report migration issue if there is CUDA code does not migrate well.

    a. It’s better to have small reproducer for each migration issues.

  4. Doc the migration steps and manual fix details.

a. Ref to readme file available in: https://github.com/oneapi-src/SYCLomatic-test/tree/SYCLomatic/third-party-programs/Velocity-Bench

  1. Commit the migration as test case into SYCLomatic-test repo.

a. Ref to: https://github.com/oneapi-src/SYCLomatic-test/tree/SYCLomatic/third-party-programs/Velocity-Bench

  1. For issues in step3, fix in SYCLomaitc if possible with some guide.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions