Integration tests depend on minio kes experimental environment

[danielblando]

Describe the bug
We depend on the experimental env from minio to run our s3 kes integration tests.
TestS3Client use endpoint https://play.min.io:7373 to generate keys.

We are recently failing on this test without any code change. It can be simply because the endpoint is down

=== RUN   TestS3Client/config-with-sse-s3
10:46:19 minio-9000: API: PutObject(bucket=cortex, object=key-config-with-sse-s3)
10:46:19 minio-9000: Time: 17:46:19 UTC 10/29/2021
10:46:19 minio-9000: DeploymentID: a997074b-4bc1-40c6-a61b-79ab6fefe5b3
10:46:19 minio-9000: RequestID: 16B29175BEA3F08C
10:46:19 minio-9000: RemoteHost: 172.31.0.1
10:46:19 minio-9000: Host: 127.0.0.1:55356
10:46:19 minio-9000: UserAgent: aws-sdk-go/1.40.37 (go1.17.2; darwin; amd64)
10:46:19 minio-9000: Error: Post https://play.min.io:7373/v1/key/generate/my-minio-key: dial tcp 147.75.201.93:7373: i/o timeout
10:46:19 minio-9000: 4: cmd/api-errors.go:1743:cmd.toAPIErrorCode()
10:46:19 minio-9000: 3: cmd/api-errors.go:1768:cmd.toAPIError()
10:46:19 minio-9000: 2: cmd/object-handlers.go:1273:cmd.objectAPIHandlers.PutObjectHandler()
10:46:19 minio-9000: 1: net/http/server.go:2007:http.HandlerFunc.ServeHTTP()
10:46:19 minio-9000: API: PutObject(bucket=cortex, object=key-config-with-sse-s3)
10:46:19 minio-9000: Time: 17:46:19 UTC 10/29/2021
10:46:19 minio-9000: DeploymentID: a997074b-4bc1-40c6-a61b-79ab6fefe5b3
10:46:19 minio-9000: RequestID: 16B29175BEA3F08C
10:46:19 minio-9000: RemoteHost: 172.31.0.1
10:46:19 minio-9000: Host: 127.0.0.1:55356
10:46:19 minio-9000: UserAgent: aws-sdk-go/1.40.37 (go1.17.2; darwin; amd64)
10:46:19 minio-9000: Error: Post https://play.min.io:7373/v1/key/generate/my-minio-key: dial tcp 147.75.201.93:7373: i/o timeout
10:46:19 minio-9000: 4: cmd/api-errors.go:1743:cmd.toAPIErrorCode()
10:46:19 minio-9000: 3: cmd/api-errors.go:1768:cmd.toAPIError()
10:46:19 minio-9000: 2: cmd/object-handlers.go:1273:cmd.objectAPIHandlers.PutObjectHandler()
10:46:19 minio-9000: 1: net/http/server.go:2007:http.HandlerFunc.ServeHTTP()
    s3_storage_client_test.go:106: 
        	Error Trace:	s3_storage_client_test.go:106
        	Error:      	Received unexpected error:
        	            	InternalError: We encountered an internal error, please try again.
        	            		status code: 500, request id: 16B29175BEA3F08C, host id: 
        	Test:       	TestS3Client/config-with-sse-s3
10:46:19 Killing minio-9000
    --- FAIL: TestS3Client/config-with-sse-s3 (29.98s)

To Reproduce
Steps to reproduce the behavior:

1. Make cortex image
2. Run integration test: go test -v -tags=requires_docker ./integration -run "^TestS3Client$"

Expected behavior
We always succeed integration tests without depending on external source.

Environment:

• Infrastructure: [e.g., Kubernetes, bare-metal, laptop]
• Deployment tool: [e.g., helm, jsonnet]

Storage Engine

• Blocks
• Chunks

Additional Context
The project already have some quick instruction on how to implement a server for integration tests
minio/kes#137

They also have a docker image to run the server
https://hub.docker.com/r/minio/kes/dockerfile

[bboreham]

Great diagnosis, @danielblando! I have proposed a change to run KES locally - #4547.