Multi agent parallel testing in CI #18523
Conversation
✅ No release notes required |
|
This kind of worked, but now Linux is the bottleneck, oh well :) |
|
Linux and MacOs will likely alternate in being the slowest, MacOs also has the smallest pool of available machines. I do like the numbers very much. |
| let addBatchTrait (testCase: ITestCase) = | ||
| let data = Text.Encoding.UTF8.GetBytes testCase.DisplayName | ||
| let hashCode = BitConverter.ToUInt32(sha.ComputeHash(data), 0) | ||
| let batch = hashCode % 4u + 1u |
There was a problem hiding this comment.
just to get a number from 1 to 4. this is hardcoded just for now.
There was a problem hiding this comment.
I wanted to get the batch number from a custom hashCode that is stable between executions. I heard bad things about String.GetHashcode() in this regard.
|
Now it's important to verify the that number of tests add up correctly 😅 |
|
.. number of unique executed tests. I would recommend to download testlog.xml files and have a script count unique test entries and compare two sets (prior exection, new execution from 4 jobs) |
Make #18517 work.