Serde configs are deleted when changes are made in the Wizard

[stalbot15]

Issue submitter TODO list

• I've looked up my issue in FAQ
• I've searched for an already existing issues here
• I've tried running master-labeled docker image and the issue still persists there
• I'm running a supported version of the application which is listed here

Describe the bug (actual behavior)

I have a glue schema registry serde configured for viewing avro messages in the UI. But when any config changes are performed in the UI wizard, the serde configs are deleted (or it at least becomes unavailable). There is also no way to configure a serde in the config wizard, so a redeploy is required to get the serde back.

Expected behavior

Changes made in the config wizard should not delete existing serde configs.

Your installation details

1. App version: 56fa824
2. Environment: ECS Fargate
3. App config:

KAFKA_CLUSTERS_0_NAME: 'my-cluster',
KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS: '<my-sasl-iam-endpoints>',
KAFKA_CLUSTERS_0_READONLY: 'false',
KAFKA_CLUSTERS_0_PROPERTIES_SECURITY_PROTOCOL: 'SASL_SSL',
KAFKA_CLUSTERS_0_PROPERTIES_SASL_MECHANISM: 'AWS_MSK_IAM',
KAFKA_CLUSTERS_0_PROPERTIES_SASL_JAAS_CONFIG: 'software.amazon.msk.auth.iam.IAMLoginModule required;',
KAFKA_CLUSTERS_0_PROPERTIES_SASL_CLIENT_CALLBACK_HANDLER_CLASS: 'software.amazon.msk.auth.iam.IAMClientCallbackHandler',
KAFKA_CLUSTERS_0_SERDE_0_NAME: 'GlueSchemaRegistry',
KAFKA_CLUSTERS_0_SERDE_0_FILEPATH: '/usr/lib/kafkaui-glue-serde-v1.1.0-jar-with-dependencies.jar',
KAFKA_CLUSTERS_0_SERDE_0_CLASSNAME: 'com.provectus.kafka.ui.serdes.glue.GlueSerde',
KAFKA_CLUSTERS_0_SERDE_0_PROPERTIES_REGION: 'us-east-1',
KAFKA_CLUSTERS_0_SERDE_0_PROPERTIES_REGISTRY: 'default-registry',
KAFKA_CLUSTERS_0_SERDE_0_PROPERTIES_KEYSSCHEMANAMETEMPLATE: '%s-key',
KAFKA_CLUSTERS_0_SERDE_0_PROPERTIES_VALUESSCHEMANAMETEMPLATE: '%s-value',
KAFKA_CLUSTERS_0_DEFAULTVALUESERDE: 'GlueSchemaRegistry'

Steps to reproduce

• Run app with serde configured
• Have an existing topic on the cluster so that we can access the serde dropdowns in the Messages tab
• Use the config wizard to change anything on the cluster and save
• Go to a topic's Messages tab and the serde will no longer be available.

Screenshots

No response

Logs

No response

Additional context

No response

[Haarolean]

Hi, thanks for reaching out!

Editing serdes in the wizard is planned within #3501

However, it's not okay for the config parts to disappear.

Please clarify, which config you have serdes specified in. Env vars, probably, or does the dynamic config file contain it?

[stalbot15]

@Haarolean sorry for the delay. To your question: I am using env vars for my configs. I don't think I have remote exec set up for my fargate tasks, so I'm not able to look at the dynamic config file as it's updated on the container.

[Haarolean]

@stalbot15 thanks for the clarification. We found the underlying issue and will find a fix.