Add all fbgemm kernel Tensors into Int4WeightOnlyConfig and Float8DynamicActivationInt4WeightConfig

[jerryzh168]

Stacked PRs:

• ->Add all fbgemm kernel Tensors into Int4WeightOnlyConfig and Float8DynamicActivationInt4WeightConfig #2474
• Add Float8Tensor #2463
• Rename torchao.float8.Float8Tensor to torchao.float8.Float8TrainingTensor #2479
• Add support for float8 activation for Int4GroupwisePreshuffleTensor #2437

---

Add all fbgemm kernel Tensors into Int4WeightOnlyConfig and Float8DynamicActivationInt4WeightConfig

Summary:
att, we will deprecate FbgemmConfig since it's a single kernel.
we'd like to categorize things to derived dtype + packed format

Test Plan:
python test/quantization/quantize_/test_int4_groupwise_preshuffle.py

Reviewers:

Subscribers:

Tasks:

Tags:

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2474

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 11 New Failures, 1 Unrelated Failure

As of commit 7412903 with merge base 1fd34e4 ():

NEW FAILURES - The following jobs have failed:

• Code Analysis with Ruff / build (3.9) (gh)
  Process completed with exit code 1.
• Run Float8 Tests / test (H100, linux.aws.h100, --pre torch torchvision torchaudio --index-url https://download.pytor... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Linear::test_quantize
• Run Float8 Tests / test (SM-89, linux.g6.4xlarge.experimental.nvidia.gpu, --pre torch --index-url https://download.p... / linux-job (gh)
  test/float8/test_base.py::TestFloat8Linear::test_quantize
• Run Regression Tests / test (CPU 2.5.1, linux.4xlarge, torch==2.5.1 --index-url https://download.pytorch.org/whl/cpu, cp... / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test (CPU 2.6, linux.4xlarge, torch==2.6.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test (CPU 2.7, linux.4xlarge, torch==2.7.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test (CUDA 2.5.1, linux.g5.12xlarge.nvidia.gpu, torch==2.5.1 --index-url https://download.pytorch... / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test (CUDA 2.6, linux.g5.12xlarge.nvidia.gpu, torch==2.6.0, cuda, 12.6) / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test (CUDA 2.7, linux.g5.12xlarge.nvidia.gpu, torch==2.7.0, cuda, 12.6) / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test-nightly (CPU Nightly, linux.4xlarge, --pre torch --index-url https://download.pytorch.org/wh... / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle
• Run Regression Tests / test-nightly (CUDA Nightly, linux.g5.12xlarge.nvidia.gpu, --pre torch --index-url https://downloa... / linux-job (gh)
  test/integration/test_serialization_bc.py::TestSerializationBC::test_load_model_and_run_model_name_torchao-testing/opt-125m-int4wo-preshuffle

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Run TorchAO Experimental Tests / test-mps-ops (macos-m1-stable) (gh) (trunk failure)
  Process completed with exit code 127.

This comment was automatically generated by Dr. CI and updates every 15 minutes.