Pentaho

 View Only

 Pentaho Data Integration v9.1 crashing on repository explore

  • Pentaho
  • Kettle
  • Pentaho
  • Pentaho Data Integration PDI
Kevin Casemore's profile image
Kevin Casemore posted 12-14-2020 18:02

I have recently upgraded my Mac OS X to Big Sur 11.0.1. Since then my PDI (v8.3) consistently crashes whenever I try to do File > Open > job/transform from my file repository.

 

It seems to be related to the repository connection. If I disconnects from that I can then open a job on my local filesystem. But it will crash again if I reconnect.

 

I have attempted to install a later version of PDI, version 9.1. But again, the same issue. I am using AdoptOpenJDK (build 1.8.0_275). It looks like I do have some java errors on the startup using ./spoon.sh

 

2020/12/14 17:49:48 - RepositoriesMeta - Reading repositories XML file: /Users/kevin/.kettle/repositories.xml

2020-12-14 17:49:48.740 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:48.740 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint

2020-12-14 17:49:49.418 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.418 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.418 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.418 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.419 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.420 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020/12/14 17:49:49 - Spoon - Connected to metastore : ETL, added to delegating metastore

2020/12/14 17:49:49 - RepositoriesMeta - Reading repositories XML file: /Users/kevin/.kettle/repositories.xml

2020-12-14 17:49:49.575 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.575 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.575 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.575 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

2020-12-14 17:49:49.576 java[2216:37909] nil host used in call to allowsSpecificHTTPSCertificateForHost

2020-12-14 17:49:49.576 java[2216:37909] nil host used in call to allowsAnyHTTPSCertificateForHost:

Dec 14, 2020 5:49:49 PM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess

INFO: New Caching Service registered

 

 

 

... but I can't find what might be causing these errors.

 

> java -version

openjdk version "1.8.0_275"

OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_275-b01)

OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.275-b01, mixed mode)

 

> jenv version

1.8 (set by /Users/kevin/.jenv/version)

 

In addition.... I get this output from the terminal when it crashes. I would think that the $PENTAHO_JAVA is key here but I don't know why.

 

INFO: Registering new instance of "/cxf" servlet

2020-12-14 17:49:49.787:INFO:oejws.WebSocketServerFactory:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): No DecoratedObjectFactory provided, using new org.eclipse.jetty.util.DecoratedObjectFactory[decorators=1]

2020-12-14 17:49:49.797:INFO:oejsh.ContextHandler:CM Configuration Updater (ManagedService Update: pid=[org.apache.cxf.osgi]): Started HttpServiceContext{httpContext=DefaultHttpContext [bundle=org.apache.cxf.cxf-rt-transports-http [164], contextID=default]}

#

# A fatal error has been detected by the Java Runtime Environment:

#

# SIGILL (0x4) at pc=0x00007fff34d48f1a, pid=2216, tid=0x0000000000000307

#

# JRE version: OpenJDK Runtime Environment (8.0_275-b01) (build 1.8.0_275-b01)

# Java VM: OpenJDK 64-Bit Server VM (25.275-b01 mixed mode bsd-amd64 compressed oops)

# Problematic frame:

# C [WebKitLegacy+0x13df1a] _ZN15WebEditorClient29requestCandidatesForSelectionERKN7WebCore16VisibleSelectionE+0x94a

#

# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

#

# An error report file with more information is saved as:

# /Applications/data-integration/hs_err_pid2216.log

#

# If you would like to submit a bug report, please visit:

#  https://github.com/AdoptOpenJDK/openjdk-support/issues

# The crash happened outside the Java Virtual Machine in native code.

# See problematic frame for where to report the bug.

#

./spoon.sh: line 270: 2216 Abort trap: 6      "$_PENTAHO_JAVA" $OPT -jar "$STARTUP" -lib $LIBPATH "${1+$@}" 

 

 

If anyone has any pointers here that would be great. At the moment I'm not properly able to use the product.

Thanks

 

 


#Kettle
#Pentaho
#PentahoDataIntegrationPDI
Carolina CRUZ's profile image
Carolina CRUZ posted 12-21-2020 15:38

I have the same issue.

I have been using pentaho for 3 years and after I got my new computer I can not open any transformation. I can start pentaho but it crashes when I try to open a transformation. I am using a mac.

Christophe Radja's profile image
Christophe Radja posted 12-28-2020 10:42

I got same issue too. On Mac Os X Big Sur. It seems to be related to JVM version and swt.jar, I've tried to use jdk1.8.0_271 and swt.jar 4.18 with Pentaho 8.3. But then an other issue raised when the connect to repo window open:

http://localhost:9051/@pentaho/di-plugin-repositories@8.3.0.10-816/index.html#/connect/Wesco%20DI%20repo Page load failed with error: The resource could not be loaded because the App Transport Security policy requires the use of a secure connection.

 

 

Alexei Ivanov's profile image
Alexei Ivanov posted 12-28-2020 23:14

You should return swt.jar to original version and downgrade java to jdk8u202 https://www.oracle.com/java/technologies/javase/javase8-archive-downloads.html

Christophe Radja's profile image
Christophe Radja posted 12-29-2020 18:46

I did what you say Alexei and then I fall back to the crash issue described by Kevin

Kevin Casemore's profile image
Kevin Casemore posted 01-04-2021 09:15

Thanks for the responses Christophe, Alexei, Carolina. I too attempted downgrading the java version to jdk8u202, no good for me. Bizarrely a colleague of mine doesn't experience these issues, despite using the same java install. We have tried to find any other differences; the only thing we can assume is that there is some graphics setting (or similar) on my mac that is causing this. I have tried resetting the NVRAM & SMC, but again, no fix. I have now resorted to creating a bootable install of Catalina to external USB and I'm now attempting to install that to a separate APFS volume to see if I can get back to where I was. I'll keep you updated...

Kevin Casemore's profile image
Kevin Casemore posted 01-06-2021 08:31

Update on this... yes, so it seems at present the only viable way forward I've had is to:

  • create a new APFS volume on my Mac
  • download Catalina full install to a USB drive
  • boot install Catalina to the new volume
  • reinstall and config all of my applications again :(
  • (Interestingly) I still had to update the swt.jar on version 9.1 Pentaho DI on Catalina to get it working. When I had my previous working Catalina install (pre Big Sur update) I was on Pentaho DI v8. Seems like there are joint effects of Pentaho version increase and java and OS here.

I'm now keeping both volumes (Catalina & Big Sur). At such future points when there are Pentaho or Big Sur / Mac OS or Java updates I will test the Big Sur volume with Pentaho to see if the issue is resolved.

Benjamin Goewey's profile image
Benjamin Goewey posted 03-04-2021 20:41

The simplest way to solve this issue for both 9.0/9.1 is to export your JAVA_HOME to the /Library/Java . . . . directory and not the /LIbrary/Internet Plug-ins/ . . directory. Find out what your directory is by looking in the Java directory. Mine looked this when I set the environment variable in Terminal:

 

export JAVA_HOME="/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/"

export JAVA_HOME="/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/"  

 

This seems to be a wider issue with Eclipse on Big Sur which may now be resolved within Eclipse itself. The issue I guess now is that you'll have to update JAVA_HOME when you get a new version.

Christophe Radja's profile image
Christophe Radja posted 03-05-2021 08:16

It was already my setup.

BTW it start working for me after I go to the look and feel preferences and make some changes there (I checked "Use look for os"). And even when I reverted back it continues to work without crashing

Benjamin Goewey's profile image
Benjamin Goewey posted 03-05-2021 16:42

I wasn't able to get the the GUI to come up with Spoon (Eclipse-based). It sounds like you could at least get to the GUI and make some changes. The splash screen would load and the GUI was up for a split second, and then it would crash with the error described in the original post. I was getting the same error message as you however. Everything works fine now.

Christophe Radja's profile image
Christophe Radja posted 06-09-2021 06:36

The issue is back for me (probably after a Big Sur update...)

I don't know what happen here, but it's problematic.

Also latest version of swt.jar does not include the class TableTreeItem which seems to be used by PDI although it has been deprecated years ago.

Carolina CRUZ's profile image
Carolina CRUZ posted 08-12-2021 09:41

we are many people at the company who can't use pentaho in mac. Is there some progress in this issue?

Safvan TK's profile image
Safvan TK posted 08-16-2021 15:24

I also facing the some issue after upgrading to Big Sur.

I am using Kettle 6.1 with Java - 1.7.0_80. The spoon is crashing when opening database connection wizard.

 

Error from the command line:

Assertion failed: (backing->lock_access > 0), function CGSBackingStoreUnlockReader, file /System/Volumes/Data/SWE/macOS/BuildRoots/d7e177bcf5/Library/Caches/com.apple.xbs/Sources/SkyLight/SkyLight-588.7/SkyLight/Services/Windows/CGSBackingStore.c, line 361.

./spoon.sh: line 219: 10880 Abort trap: 6      "$_PENTAHO_JAVA" $OPT -jar "$STARTUP" -lib $LIBPATH "${1+$@}"

 

Pentaho - 6.1.0.1-196

Java - 1.7.0_80

OS - MacOS Big Sur 11.5.2

Related Content