Skip to content

Make integration tests shorter and more stable #1790

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

dgageot
Copy link
Contributor

@dgageot dgageot commented Mar 13, 2019

This PR improves the integration tests to make them easier to debug and more reliable.

  • Use k8s's watch mechanism instead of polling to check for what was deployed
  • Add more logs
  • Mark a few tests as remoteOnly
  • Ensure all go samples use the same code to maximize caching
  • Use smaller base images when possible

Also make TravisCI run faster by not fetching the submodules

@dgageot dgageot force-pushed the improve-test-logs-and-polling branch from 691432e to cfb994b Compare March 13, 2019 15:54
@codecov-io
Copy link

codecov-io commented Mar 13, 2019

Codecov Report

Merging #1790 into master will decrease coverage by 0.58%.
The diff coverage is 0%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1790      +/-   ##
==========================================
- Coverage   46.08%   45.49%   -0.59%     
==========================================
  Files         142      142              
  Lines        6577     6607      +30     
==========================================
- Hits         3031     3006      -25     
- Misses       3243     3301      +58     
+ Partials      303      300       -3
Impacted Files Coverage Δ
pkg/skaffold/kubernetes/wait.go 0% <ø> (-28.09%) ⬇️
integration/util.go 0% <0%> (ø) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 89c4c79...1a80a53. Read the comment docs.

@dgageot
Copy link
Contributor Author

dgageot commented Mar 13, 2019

kokoro seems to be running forever. Let's wait for the logs to see if the changes help the debugging

@dgageot dgageot force-pushed the improve-test-logs-and-polling branch from cfb994b to bc2a13a Compare March 14, 2019 07:31
@dgageot
Copy link
Contributor Author

dgageot commented Mar 14, 2019

Let's try to run this PR a few times:
So far, 9 green runs

@dgageot dgageot force-pushed the improve-test-logs-and-polling branch 3 times, most recently from 735ccd2 to c07b12a Compare March 14, 2019 09:15
@dgageot dgageot force-pushed the improve-test-logs-and-polling branch from c07b12a to 88b4e68 Compare March 14, 2019 09:30
dgageot added 5 commits March 14, 2019 10:55
This makes it faster to build on the CI

Signed-off-by: David Gageot <[email protected]>
Signed-off-by: David Gageot <[email protected]>
Signed-off-by: David Gageot <[email protected]>
@dgageot dgageot force-pushed the improve-test-logs-and-polling branch from 8e611af to 85b3c9c Compare March 14, 2019 10:05
dgageot added 3 commits March 14, 2019 11:16
Also update the development guide

Signed-off-by: David Gageot <[email protected]>
@dgageot dgageot changed the title Improve test logs and polling Make integration tests shorter and more stable Mar 14, 2019
@dgageot dgageot merged commit fc64059 into GoogleContainerTools:master Mar 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants