Improve logging

[VOID404]

Description

client -> gateway -> service
       ^A         ^B
client <- gateway <- service
       ^C         ^D

We already had logging of A and C (in some form).
Logging of B and D would be helpful.

Changes proposed in this pull request:

• Add logging for B
• Change (and clean up) logging system

Related issue(s)

#17905
#17265

[netlify]

✅ Deploy Preview for kyma-project-docs-preview ready!

Name	Link
🔨 Latest commit	2941e2e
🔍 Latest deploy log	https://app.netlify.com/sites/kyma-project-docs-preview/deploys/64f81a2638ad6a0008875646
😎 Deploy Preview	https://deploy-preview-18016--kyma-project-docs-preview.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[kyma-bot]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[netlify]

👷 Deploy request for kyma-project pending review.

Visit the deploys page to approve it

Name	Link
🔨 Latest commit	2941e2e

[VOID404]

Example req:

GET http://localhost:8080/httpbin/raw/status/500
Accept: application/json

response:

<!-- GET http://localhost:8080/httpbin/raw/status/500 -->
<!-- HTTP/1.1 502 Bad Gateway -->
<!-- Access-Control-Allow-Credentials: true -->
<!-- Access-Control-Allow-Origin: * -->
<!-- Content-Length: 0 -->
<!-- Content-Type: text/html; charset=utf-8 -->
<!-- Date: Mon, 21 Aug 2023 16:35:03 GMT -->
<!-- Server: gunicorn/19.9.0 -->
<!-- Target-System-Status: 500 -->
<!-- Request duration: 0.089449s -->

logs:

{"level":"debug","ts":1692635703.967423,"caller":"proxy/reverseproxy.go:133","msg":"GET localhost:3000 /status/500 HTTP/1.1","requestID":null,"method":"GET","host":"localhost:3000","url":"/status/500","proto":"HTTP/1.1","code":500,"contentLength":0,"kind":"response"}
{"level":"debug","ts":1692635703.967733,"caller":"httptools/logging.go:71","msg":"GET localhost:8080 status/500 HTTP/1.1","label":"Internal handler: ","duration":80,"code":502,"requestID":"bc5c5573-7012-455a-98b2-3f5d9372d24b","method":"GET","host":"localhost:8080","url":"status/500","proto":"HTTP/1.1","kind":"request"}

There is a problem with requestID, but this already seems way more helpful

[kyma-bot]

@VOID404: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
pull-kyma-governance	2941e2e	link	false	/test pull-kyma-governance

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.