Ensure that tracing (jaeger, oltp) is working

[ctron]

Right now it seems that the tracing integration is broken.

✅ Expectations

• we can deploy jaeger on minikube (all in one configuration)
• we can tell trustify v2 to send tracing information to this instance

🔥 Problem

1. I see the following errors in the pod logs:

   OpenTelemetry trace error occurred. Exporter otlp encountered the following error(s): the grpc server returns error (The service is currently unavailable): , detailed error message: tcp connect error: Connection refused (os error 111)
   

2. I don't see tracing information in the jaeger instance.

♻️ Reproduce

• Clone helm chart repository

  git clone git@github.com:trustification/trustify-helm-charts.git
  cd trustify-helm-charts

• Run minikube

  minikube start --cpus 4 --memory 12288 --disk-size 20gb --addons ingress,dashboard

• Set env

  NAMESPACE=trustify
  APP_DOMAIN=.$(minikube ip).nip.io
  kubectl create ns $NAMESPACE
  kubectl config set-context --current --namespace=$NAMESPACE

• Deploy infrastructure chart with jaeger enabled

  helm upgrade --install --dependency-update -n $NAMESPACE infrastructure charts/trustify-infrastructure --values values-minikube.yaml --set-string keycloak.ingress.hostname=sso$APP_DOMAIN --set-string appDomain=$APP_DOMAIN --set jaeger.enabled=true --set-string jaeger.allInOne.ingress.hosts[0]=jaeger$APP_DOMAIN --set tracing.enabled=true

• Deploy application with tracing enabled

  helm upgrade --install -n $NAMESPACE trustify charts/trustify --values values-minikube.yaml --set-string appDomain=$APP_DOMAIN --set tracing.enabled=true

⬇️ Steps

• Try to reproduce the issue
• Solve the connection issue (this may include changes in the helm chart repo or trustify itself)
• Verify that the traces show up in jaeger

[helio-frota]

progress 👍 I was able to see some traces on jaeger (locally) using a bit-hacked pm-mode version

[helio-frota]

progress 👍 able to see traces with

cargo run --bin trustd api --db-password trustify --devmode --auth-disabled --tracing enabled

Although:

• This is not related to the original error in this issue
• Need to increase trace ratio to something > 1
• Need to comment EnvFilter as I have no idea how to make it work:

[helio-frota]

progress 👍
the issue changed now to received message with invalid compression flag: 60 (valid flags are 0 and 1)
trustification/trustify-helm-charts#11