I found the following problems using kettle 8.3 multitasking concurrency, but I haven't found the reason. Can you help me have a look? I suspect it's the machine memory. I don't know whether it's correct. There is no log support
the karaf mavn has the commons-lang-2.6.jar , i use the kettle8.3.0.0-371
/tmp/karaf7201359731257126033/system/commons-lang/commons-lang/2.6
Below is the error task log:
#######################################################################
WARNING: no libwebkitgtk-1.0 detected, some features will be unavailable
Consider installing the package with apt-get or yum.
e.g. 'sudo apt-get install libwebkitgtk-1.0-0'
#######################################################################
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
log4j:WARN Continuable parsing error 45 and column 76
log4j:WARN Element type "rollingPolicy" must be declared.
log4j:WARN Continuable parsing error 52 and column 14
log4j:WARN The content of element type "appender" must match "(errorHandler?,param*,layout?,filter*,appender-ref*)".
log4j:WARN Please set a rolling policy for the RollingFileAppender named 'pdi-execution-appender'
10:14:41,415 INFO [KarafBoot] link file /tmp/karaf5150650906876662316already existed
10:14:41,418 INFO [KarafBoot] link file /tmp/karaf5150650906876662316already existed
10:14:43,218 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
10:14:43,334 INFO [KarafInstance]
*******************************************************************************
-
-
- Karaf Instance Number: 11 at /tmp/karaf5150650906876662316/caches/kitch ***
- en/data-1 ***
- FastBin Provider Port:52911 ***
- Karaf Port:8812 ***
- OSGI Service Port:9061 ***
*******************************************************************************
Jul 04, 2022 10:14:44 AM org.apache.karaf.main.Main launch
INFO: Installing and starting initial bundles
Jul 04, 2022 10:14:45 AM org.apache.karaf.main.Main launch
INFO: All initial bundles installed and set to start
Jul 04, 2022 10:14:46 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2022/07/04 10:14:47 - Kitchen - Logging is at level : Debug
2022/07/04 10:14:47 - Kitchen - Start of run.
2022/07/04 10:14:47 - Kitchen - Allocate new job.
2022/07/04 10:14:47 - Kitchen - Parsing command line options.
Creating configuration from org.pentaho.caching-default.cfg
Creating configuration from org.apache.karaf.shell.cfg
Creating configuration from org.apache.karaf.kar.cfg
Creating configuration from org.apache.karaf.webconsole.cfg
Creating configuration from org.ops4j.pax.url.mvn.cfg
Creating configuration from jmx.acl.cfg
Creating configuration from org.apache.karaf.command.acl.feature.cfg
Creating configuration from org.apache.karaf.jaas.cfg
Creating configuration from org.pentaho.pdi.engine.spark.cfg
Creating configuration from jmx.acl.java.lang.Memory.cfg
Creating configuration from org.apache.karaf.log.cfg
Creating configuration from mondrian.cfg
Creating configuration from jmx.acl.osgi.compendium.cm.cfg
Creating configuration from pentaho.marketplace.di.cfg
Creating configuration from org.apache.karaf.features.cfg
Creating configuration from org.apache.karaf.features.repos.cfg
Creating configuration from org.apache.aries.rsa.provider.fastbin.cfg
Creating configuration from org.apache.karaf.command.acl.scope_bundle.cfg
Creating configuration from org.apache.activemq.webconsole.cfg
Creating configuration from org.apache.felix.fileinstall-deploy.cfg
Creating configuration from jmx.acl.org.apache.karaf.security.jmx.cfg
Creating configuration from jmx.acl.org.apache.karaf.config.cfg
Creating configuration from pentaho.geo.roles.cfg
Creating configuration from org.apache.karaf.command.acl.bundle.cfg
Creating configuration from jmx.acl.org.apache.karaf.bundle.cfg
Creating configuration from org.apache.karaf.command.acl.config.cfg
Creating configuration from pentaho.metaverse.cfg
Creating configuration from org.apache.karaf.features.obr.cfg
Creating configuration from org.apache.karaf.command.acl.shell.cfg
Creating configuration from org.apache.karaf.command.acl.kar.cfg
Creating configuration from pentaho.big.data.impl.cluster.cfg
Creating configuration from org.apache.karaf.command.acl.jaas.cfg
Creating configuration from org.ops4j.pax.logging.cfg
Creating configuration from org.ops4j.pax.web.cfg
Creating configuration from org.apache.karaf.command.acl.system.cfg
Creating configuration from org.apache.karaf.management.cfg
Creating configuration from org.apache.activemq.server-default.cfg
Creating configuration from org.pentaho.features.cfg
10:14:59,070 ERROR [BlueprintContainerImpl] Unable to start blueprint container for bundle org.apache.karaf.features.core
org.osgi.service.blueprint.container.ComponentDefinitionException: Unable to convert value BeanRecipename='#recipe-105' to type class java.lang.Object
at org.apache.aries.blueprint.di.CollectionRecipe.internalCreate(CollectionRecipe.java:92)
at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:106)
at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.createListeners(AbstractServiceReferenceRecipe.java:278)
at org.apache.aries.blueprint.container.ReferenceListRecipe.internalCreate(ReferenceListRecipe.java:77)
at org.apache.aries.blueprint.di.AbstractRecipe$1.call(AbstractRecipe.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:88)
at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:245)
at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:183)
at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:682)
at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:377)
at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:269)
at org.apache.aries.blueprint.container.BlueprintExtender.createContainer(BlueprintExtender.java:294)
at org.apache.aries.blueprint.container.BlueprintExtender.createContainer(BlueprintExtender.java:263)
at org.apache.aries.blueprint.container.BlueprintExtender.modifiedBundle(BlueprintExtender.java:253)
at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$Tracked.customizerModified(BundleHookBundleTracker.java:500)
at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$Tracked.customizerModified(BundleHookBundleTracker.java:433)
at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$AbstractTracked.track(BundleHookBundleTracker.java:725)
at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$Tracked.bundleChanged(BundleHookBundleTracker.java:463)
at org.apache.aries.util.tracker.hook.BundleHookBundleTracker$BundleEventHook.event(BundleHookBundleTracker.java:422)
at org.apache.felix.framework.util.SecureAction.invokeBundleEventHook(SecureAction.java:1103)
at org.apache.felix.framework.util.EventDispatcher.createWhitelistFromHooks(EventDispatcher.java:695)
at org.apache.felix.framework.util.EventDispatcher.fireBundleEvent(EventDispatcher.java:483)
at org.apache.felix.framework.Felix.fireBundleEvent(Felix.java:4403)
at org.apache.felix.framework.Felix.startBundle(Felix.java:2092)
at org.apache.felix.framework.Felix.setActiveStartLevel(Felix.java:1291)
at org.apache.felix.framework.FrameworkStartLevelImpl.run(FrameworkStartLevelImpl.java:304)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.osgi.service.blueprint.container.ComponentDefinitionException: Unable to initialize bean featuresService
at org.apache.aries.blueprint.container.BeanRecipe.runBeanProcInit(BeanRecipe.java:714)
at org.apache.aries.blueprint.container.BeanRecipe.internalCreate2(BeanRecipe.java:824)
at org.apache.aries.blueprint.container.BeanRecipe.internalCreate(BeanRecipe.java:787)
at org.apache.aries.blueprint.di.AbstractRecipe$1.call(AbstractRecipe.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:88)
at org.apache.aries.blueprint.di.RefRecipe.internalCreate(RefRecipe.java:62)
at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:106)
at org.apache.aries.blueprint.container.BeanRecipe.setProperty(BeanRecipe.java:933)
at org.apache.aries.blueprint.container.BeanRecipe.setProperties(BeanRecipe.java:907)
at org.apache.aries.blueprint.container.BeanRecipe.setProperties(BeanRecipe.java:888)
at org.apache.aries.blueprint.container.BeanRecipe.internalCreate2(BeanRecipe.java:820)
at org.apache.aries.blueprint.container.BeanRecipe.internalCreate(BeanRecipe.java:787)
at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:106)
at org.apache.aries.blueprint.di.CollectionRecipe.internalCreate(CollectionRecipe.java:90)
... 27 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils
at shaded.org.apache.maven.wagon.providers.file.FileWagon.resolveDestinationPath(FileWagon.java:206)
at shaded.org.apache.maven.wagon.providers.file.FileWagon.resourceExists(FileWagon.java:265)
at shaded.org.eclipse.aether.transport.wagon.WagonTransporter$PeekTaskRunner.run(WagonTransporter.java:518)
at shaded.org.eclipse.aether.transport.wagon.WagonTransporter.execute(WagonTransporter.java:427)
at shaded.org.eclipse.aether.transport.wagon.WagonTransporter.peek(WagonTransporter.java:398)
at shaded.org.eclipse.aether.connector.basic.BasicRepositoryConnector$GetTaskRunner.checkRemoteAccess(BasicRepositoryConnector.java:402)
at shaded.org.eclipse.aether.connector.basic.PartialFile$LockFile.lock(PartialFile.java:89)
at shaded.org.eclipse.aether.connector.basic.PartialFile$LockFile.(PartialFile.java:58)
at shaded.org.eclipse.aether.connector.basic.PartialFile$Factory.newInstance(PartialFile.java:210)
at shaded.org.eclipse.aether.connector.basic.BasicRepositoryConnector$GetTaskRunner.runTask(BasicRepositoryConnector.java:432)
at shaded.org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:350)
at shaded.org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
at shaded.org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:581)
at shaded.org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:249)
at shaded.org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:520)
at shaded.org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:421)
at shaded.org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246)
at shaded.org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifact(DefaultArtifactResolver.java:223)
at shaded.org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveArtifact(DefaultRepositorySystem.java:294)
at org.ops4j.pax.url.mvn.internal.AetherBasedResolver.resolve(AetherBasedResolver.java:476)
at org.ops4j.pax.url.mvn.internal.AetherBasedResolver.resolve(AetherBasedResolver.java:433)
at org.ops4j.pax.url.mvn.internal.AetherBasedResolver.resolve(AetherBasedResolver.java:411)
at org.ops4j.pax.url.mvn.internal.AetherBasedResolver.resolve(AetherBasedResolver.java:386)
at org.ops4j.pax.url.mvn.internal.Connection.getInputStream(Connection.java:124)
at org.apache.karaf.features.internal.FeatureValidationUtil.load(FeatureValidationUtil.java:93)
at org.apache.karaf.features.internal.FeatureValidationUtil.validate(FeatureValidationUtil.java:58)
at org.apache.karaf.features.internal.FeaturesServiceImpl.validateRepository(FeaturesServiceImpl.java:162)
at org.apache.karaf.features.internal.FeaturesServiceImpl.internalAddRepository(FeaturesServiceImpl.java:233)
at org.apache.karaf.features.internal.FeaturesServiceImpl.initState(FeaturesServiceImpl.java:894)
at org.apache.karaf.features.internal.FeaturesServiceImpl.start(FeaturesServiceImpl.java:906)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:297)
at org.apache.aries.blueprint.container.BeanRecipe.invoke(BeanRecipe.java:958)
at org.apache.aries.blueprint.container.BeanRecipe.runBeanProcInit(BeanRecipe.java:712)
... 41 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils not found by org.ops4j.pax.url.mvn [1]
at org.apache.felix.framework.BundleWiringImpl.findClassOrResourceByDelegation(BundleWiringImpl.java:1532)
at org.apache.felix.framework.BundleWiringImpl.access$400(BundleWiringImpl.java:75)
at org.apache.felix.framework.BundleWiringImpl$BundleClassLoader.loadClass(BundleWiringImpl.java:1955)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 78 more
10:16:36,132 ERROR [KarafLifecycleListener] The Kettle Karaf Lifecycle Listener failed to execute properly after waiting for 100 seconds. Releasing lifecycle hold, but some services may be unavailable.
Processing stopped because of an error:
Unable to load the job from XML file [/home/hive/scheduler/DFAC/0_PUB/ODS_AUTO/pub_ods_hana.kjb]
Unable to load job info from XML node
Unable to load database connection info from XML node
Unable to create new database interface
database type with plugin id [HIVE2] couldn't be found!
ERROR: Kitchen can't continue because the job couldn't be loaded.