События системного журнала#

Программный компонент SEDR сохраняет информацию о происходящих событиях в файл $replicator_logs_dir/kafka-connect-<наименование экземпляра SEDR>.log.

Наиболее часто встречающиеся события в файлах логов типа ERROR:

Не подошел пароль от хранилища (ssl.keystore.password или ssl.truststore.password):

2021-11-30 19:37:01.195 [main] ERROR org.apache.kafka.connect.cli.ConnectDistributed  - Stopping due to error
org.apache.kafka.common.KafkaException: Failed to create new KafkaAdminClient<br>
    at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:535)
    at org.apache.kafka.clients.admin.Admin.create(Admin.java:75)<br>
    at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:50)
    at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:97)
    at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: org.apache.kafka.common.KafkaException: Failed to load SSL keystore ssl/kafka-cluster-1.jks of type JKS
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory$FileBasedStore.load(DefaultSslEngineFactory.java:377)
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory$FileBasedStore.<init>(DefaultSslEngineFactory.java:349)
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory.createKeystore(DefaultSslEngineFactory.java:299)
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory.configure(DefaultSslEngineFactory.java:161)
    at org.apache.kafka.common.security.ssl.SslFactory.instantiateSslEngineFactory(SslFactory.java:138)
    at org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:95)
    at org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:71)
    at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:157)
    at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:73)
    at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:105)
    at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:508)
    ... 4 common frames omitted
Caused by: java.io.IOException: Keystore was tampered with, or password was incorrect
    at java.base/sun.security.provider.JavaKeyStore.engineLoad(JavaKeyStore.java:795)
    at java.base/sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:222)
    at java.base/java.security.KeyStore.load(KeyStore.java:1479)
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory$FileBasedStore.load(DefaultSslEngineFactory.java:374)
    ... 14 common frames omitted
Caused by: java.security.UnrecoverableKeyException: Password verification failed
    at java.base/sun.security.provider.JavaKeyStore.engineLoad(JavaKeyStore.java:793)
    ... 17 common frames omitted| Не подошел пароль от хранилища (ssl.keystore.password или ssl.truststore.password)|

Не подошел пароль от ключа в хранилище (ssl.key.password):

2021-11-30 19:38:49.313 [main] ERROR org.apache.kafka.connect.cli.ConnectDistributed  - Stopping due to error
org.apache.kafka.common.KafkaException: Failed to create new KafkaAdminClient
    at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:535)
    at org.apache.kafka.clients.admin.Admin.create(Admin.java:75)
    at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:50)
    at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:97)
    at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: org.apache.kafka.common.KafkaException: java.security.UnrecoverableKeyException: Cannot recover key
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory.createSSLContext(DefaultSslEngineFactory.java:268)
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory.configure(DefaultSslEngineFactory.java:173)
    at org.apache.kafka.common.security.ssl.SslFactory.instantiateSslEngineFactory(SslFactory.java:138)
    at org.apache.kafka.common.security.ssl.SslFactory.configure(SslFactory.java:95)
    at org.apache.kafka.common.network.SslChannelBuilder.configure(SslChannelBuilder.java:71)
    at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:157)
    at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:73)
    at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:105)
    at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:508)
    ... 4 common frames omitted
Caused by: java.security.UnrecoverableKeyException: Cannot recover key
    at java.base/sun.security.provider.KeyProtector.recover(KeyProtector.java:304)
    at java.base/sun.security.provider.JavaKeyStore.engineGetKey(JavaKeyStore.java:144)
    at java.base/sun.security.util.KeyStoreDelegator.engineGetKey(KeyStoreDelegator.java:90)
    at java.base/java.security.KeyStore.getKey(KeyStore.java:1057)
    at java.base/sun.security.ssl.SunX509KeyManagerImpl.<init>(SunX509KeyManagerImpl.java:145)
   at java.base/sun.security.ssl.KeyManagerFactoryImpl$SunX509.engineInit(KeyManagerFactoryImpl.java:70)
    at java.base/javax.net.ssl.KeyManagerFactory.init(KeyManagerFactory.java:271)
    at org.apache.kafka.common.security.ssl.DefaultSslEngineFactory.createSSLContext(DefaultSslEngineFactory.java:251)
    ... 12 common frames omitted

Ключом из conf/encrypt.pass не смогли расшифровать любое зашифрованное значение в конфиге вида ${decode:C5eoLl0iVSaYIzTMYFs+DQ==}:

2021-11-30 19:40:56.194 [main] ERROR org.apache.kafka.connect.cli.ConnectDistributed  - Stopping due to error
 org.jasypt.exceptions.EncryptionOperationNotPossibleException: null
     at org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
     at org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
     at org.jasypt.util.text.BasicTextEncryptor.decrypt(BasicTextEncryptor.java:112)
     at ru.sbt.ss.password.decoder.EsPasswordDecoder.decode(EsPasswordDecoder.java:57)
     at ru.sbt.ss.kafka.DecryptionConfigProvider.$anonfun$get$1(DecryptionConfigProvider.scala:51)
     at scala.collection.StrictOptimizedIterableOps.map(StrictOptimizedIterableOps.scala:99)
     at scala.collection.StrictOptimizedIterableOps.map$(StrictOptimizedIterableOps.scala:86)
     at scala.collection.convert.JavaCollectionWrappers$JSetWrapper.map(JavaCollectionWrappers.scala:180)
     at ru.sbt.ss.kafka.DecryptionConfigProvider.get(DecryptionConfigProvider.scala:51)
     at org.apache.kafka.common.config.ConfigTransformer.transform(ConfigTransformer.java:103)
     at org.apache.kafka.common.config.AbstractConfig.resolveConfigVariables(AbstractConfig.java:495)
     at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:107)
     at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:129)
     at org.apache.kafka.connect.runtime.WorkerConfig.<init>(WorkerConfig.java:452)
     at org.apache.kafka.connect.runtime.distributed.DistributedConfig.<init>(DistributedConfig.java:405)
     at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:95)
     at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)

Для текущего хранилища нет прав на использование системных топиков (в данном случае connect-offsets):

2021-11-30 19:48:43.865 [KafkaBasedLog Work Thread - connect-offsets] WARN  org.apache.kafka.clients.consumer.internals.Fetcher  - [Consumer clientId=replicator.tkleq-snaps0003.vm.esrt.cloud.example.ru, groupId=pcidss-to-alpha-group] Not authorized to read from partition connect-offsets-11.
 2021-11-30 19:48:43.865 [KafkaBasedLog Work Thread - connect-offsets] ERROR org.apache.kafka.connect.util.KafkaBasedLog  - Error polling: org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [connect-offsets]
 2021-11-30 19:48:43.865 [KafkaBasedLog Work Thread - connect-offsets] WARN  org.apache.kafka.clients.consumer.internals.Fetcher  - [Consumer clientId=replicator.tkleq-snaps0003.vm.esrt.cloud.example.ru, groupId=pcidss-to-alpha-group] Not authorized to read from partition connect-offsets-9.
 2021-11-30 19:48:43.866 [KafkaBasedLog Work Thread - connect-offsets] ERROR org.apache.kafka.connect.util.KafkaBasedLog  - Error polling: org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [connect-offsets]
 2021-11-30 19:48:43.866 [KafkaBasedLog Work Thread - connect-offsets] WARN  org.apache.kafka.clients.consumer.internals.Fetcher  - [Consumer clientId=replicator.tkleq-snaps0003.vm.esrt.cloud.example.ru, groupId=pcidss-to-alpha-group] Not authorized to read from partition connect-offsets-15.
 2021-11-30 19:48:43.866 [KafkaBasedLog Work Thread - connect-offsets] ERROR org.apache.kafka.connect.util.KafkaBasedLog  - Error polling: org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [connect-offsets]
 2021-11-30 19:48:43.866 [KafkaBasedLog Work Thread - connect-offsets] WARN  org.apache.kafka.clients.consumer.internals.Fetcher  - [Consumer clientId=replicator.tkleq-snaps0003.vm.esrt.cloud.example.ru, groupId=pcidss-to-alpha-group] Not authorized to read from partition connect-offsets-13.
 2021-11-30 19:48:43.866 [KafkaBasedLog Work Thread - connect-offsets] ERROR org.apache.kafka.connect.util.KafkaBasedLog  - Error polling: org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [connect-offsets]