feat: Make scaffolding Controller more generic #3408

[WeiHaocheng]

We need to do some optimizations to make the Controller more generic, which will help with better modularity.
These changes will not affect the existing API.

• We hope the Controller such as MajorityVoteController can be constructed by any Generation Controller. For a example, the Generation Controller may be a dynasor cot Controller which will yield for different and uncertainly turns between different sample. To resolve that, we support yield "ParallelProcess" to "ScaffoldingLlm". The code of majority vote controller looks like:

`

controllers = [self.generation_controller.clone() for _ in range(sample_num)]

tasks_list = [[copy.deepcopy(tasks[0])] for _ in range(sample_num)]

kwargs_list = [kwargs for _ in range(sample_num)]

yield ParallelProcess(generation_controllers, tasks_list,
                          generation_kwargs_list)`

Then the "ScaffoldingLlm" will run the "process" of each controller with tasks and kwargs parallel. And the generation controller here can be someone which customized by user. In other words, users can pass any class of generation controller into majority vote controller without changing the code of majority vote controller.

• We make the reward method in BestOfNController more generic as we observe that reward methods become various in recently paper and works.

• We remove most of type check for Task as users may override them.

[WeiHaocheng]

/bot run

[tensorrt-cicd]

PR_Github #1604 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #1604 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #1201 completed with status: 'FAILURE'

[WeiHaocheng]

/bot run

[tensorrt-cicd]

PR_Github #1674 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #1674 [ run ] completed with state FAILURE
/LLM/main/L0_MergeRequest_PR pipeline #1252 completed with status: 'FAILURE'

[WeiHaocheng]

/bot run

[tensorrt-cicd]

PR_Github #1686 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #1686 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #1260 completed with status: 'SUCCESS'

[WeiHaocheng]

bot run

[WeiHaocheng]

/bot run

[tensorrt-cicd]

PR_Github #1939 [ run ] triggered by Bot

[tensorrt-cicd]

PR_Github #1939 [ run ] completed with state SUCCESS
/LLM/main/L0_MergeRequest_PR pipeline #1428 completed with status: 'SUCCESS'

[WeiHaocheng]

/bot reuse-pipeline

[tensorrt-cicd]

PR_Github #2020 [ reuse-pipeline ] triggered by Bot

[tensorrt-cicd]

PR_Github #2020 [ reuse-pipeline ] completed with state SUCCESS
Reusing PR_Github #1939 for commit ac41845