Pentaho

 View Only
Back to discussions
Expand all | Collapse all

Parquet output issue in pdi-ce-9.3

This thread has been viewed 13 times

  • 1.  Parquet output issue in pdi-ce-9.3

    Posted 06-29-2022 09:49
    Hi EveryOne,

    I am trying to load the data from mysql database table to s3 with parquet format. But I am not able to load the data in pdi-ce-9.3 version because I am getting bellow error. I tried same in pdi-ce-9.1, it is working fine.

    Could you please check the below issue and let me know your suggestions.

    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - ERROR (version 9.3.0.0-428, build 9.3.0.0-428 from 2022-04-12 04.56.25 by buildguy) : Unexpected error
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - ERROR (version 9.3.0.0-428, build 9.3.0.0-428 from 2022-04-12 04.56.25 by buildguy) : java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.apache.hadoop.conf.Configuration.set(Configuration.java:1380)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.apache.hadoop.conf.Configuration.set(Configuration.java:1361)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.hadoop.shim.common.format.parquet.delegate.apache.PentahoApacheOutputFormat.lambda$new$1(PentahoApacheOutputFormat.java:85)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.hadoop.shim.common.format.HadoopFormatBase.inClassloader(HadoopFormatBase.java:50)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.hadoop.shim.common.format.parquet.delegate.apache.PentahoApacheOutputFormat.<init>(PentahoApacheOutputFormat.java:74)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.hadoop.shim.common.format.parquet.delegate.DelegateFormatFactory.getOutputFormatInstance(DelegateFormatFactory.java:51)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.hadoop.shim.common.CommonFormatShim.createOutputFormat(CommonFormatShim.java:58)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.big.data.impl.shim.format.FormatServiceImpl.createOutputFormat(FormatServiceImpl.java:61)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.parquet.output.ParquetOutput.init(ParquetOutput.java:116)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.parquet.output.ParquetOutput.processRow(ParquetOutput.java:61)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
    2022/06/29 13:42:21 - Parquet output : business_entity_stg.0 - at java.lang.Thread.run(Unknown Source)



    Thank you,
    Ram

    ------------------------------
    Ramanjaneyulu Ravuri
    Data Service Manager
    MIZE SOFTWARE SOLUTIONS PVT LTD
    ------------------------------


  • 2.  RE: Parquet output issue in pdi-ce-9.3

    Posted 07-30-2022 16:14
    Ram
    Are you able to share the transformation you are using to get this error? Trying to see if I can replicate the same behavior

    ------------------------------
    Carlos Lopez
    Application Architecture Engineering - Expert
    Hitachi Vantara
    ------------------------------

    Original Message


Related Content