AnsweredAssumed Answered

I have a problem with extract only delta from HBase (using "HBase INPUT").

Question asked by Lukasz Wiak on Oct 9, 2018

Hi,

 

 

I have a problem with extract only delta from HBase (using "HBase INPUT").

In a "Filter result set" I am choosing "Timestamp", Type "Long", Operator ">" and a "Comparison value" 1539014286479.

I was trying with diffrent data types: number, date, flot, double - also in mapping. I always get the same message:

 

org.pentaho.di.core.exception.KettleException:

Unable to execute source table scan

java.lang.NoSuchMethodException: org.apache.hadoop.hbase.filter.TimestampsFilter.<init>(org.apache.hadoop.hbase.filter.CompareFilter$CompareOp, org.apache.hadoop.hbase.filter.ByteArrayComparable)

        at org.pentaho.big.data.kettle.plugins.hbase.input.HBaseInput.processRow(HBaseInput.java:245)

        at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)

        at java.lang.Thread.run(Thread.java:745)

Caused by: java.io.IOException: java.lang.NoSuchMethodException: org.apache.hadoop.hbase.filter.TimestampsFilter.<init>(org.apache.hadoop.hbase.filter.CompareFilter$CompareOp, org.apache.hadoop.hbase.filter.ByteArrayComparable)

atcom.pentaho.big.data.bundles.impl.shim.hbase.table.ResultScannerBuilderImpl$3.perform(ResultScannerBuilderImpl.java:109)

        at com.pentaho.big.data.bundles.impl.shim.hbase.BatchHBaseConnectionOperation.perform(BatchHBaseConnectionOperation.java:45)

        at com.pentaho.big.data.bundles.impl.shim.hbase.table.ResultScannerBuilderImpl.build(ResultScannerBuilderImpl.java:126)

        at org.pentaho.big.data.kettle.plugins.hbase.input.HBaseInput.processRow(HBaseInput.java:243)

        ... 2 more

Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.hbase.filter.TimestampsFilter.<init>(org.apache.hadoop.hbase.filter.CompareFilter$CompareOp, org.apache.hadoop.hbase.filter.ByteArrayComparable)

        at java.lang.Class.getConstructor0(Class.java:3082)

        at java.lang.Class.getConstructor(Class.java:1825)

        at org.pentaho.hbase.shim.common.CommonHBaseConnection.addFilter(CommonHBaseConnection.java:699)

        at org.pentaho.hbase.shim.common.CommonHBaseConnection.addFilterByMapping(CommonHBaseConnection.java:685)

        at org.pentaho.hbase.shim.common.CommonHBaseConnection.addColumnFilterToScan(CommonHBaseConnection.java:547)

        at com.pentaho.big.data.bundles.impl.shim.hbase.HBaseConnectionWrapper.addColumnFilterToScan(HBaseConnectionWrapper.java:142)

        at com.pentaho.big.data.bundles.impl.shim.hbase.table.ResultScannerBuilderImpl$3.perform(ResultScannerBuilderImpl.java:107)

        ... 5 more

2018/10/09 14:56:25 - HBase Input.0 - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : Unexpected error

2018/10/09 14:56:25 - HBase Input.0 - ERROR (version 8.1.0.0-365, build 8.1.0.0-365 from 2018-04-30 09.42.24 by buildguy) : org.pentaho.di.core.exception.KettleException:

2018/10/09 14:56:25 - HBase Input.0 - Unable to execute source table scan

2018/10/09 14:56:25 - HBase Input.0 - java.lang.NoSuchMethodException: org.apache.hadoop.hbase.filter.TimestampsFilter.<init>(org.apache.hadoop.hbase.filter.CompareFilter$CompareOp, org.apache.hadoop.hbase.filter.ByteArrayComparable)

2018/10/09 14:56:25 - HBase Input.0 -

2018/10/09 14:56:25 - HBase Input.0 -   at org.pentaho.big.data.kettle.plugins.hbase.input.HBaseInput.processRow(HBaseInput.java:245)

2018/10/09 14:56:25 - HBase Input.0 -   at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)

2018/10/09 14:56:25 - HBase Input.0 -   at java.lang.Thread.run(Thread.java:745)

2018/10/09 14:56:25 - HBase Input.0 - Caused by: java.io.IOException: java.lang.NoSuchMethodException: org.apache.hadoop.hbase.filter.TimestampsFilter.<init>(org.apache.hadoop.hbase.filter.CompareFilter$CompareOp, org.apache.hadoop.hbase.filter.ByteArrayComparable)

2018/10/09 14:56:25 - HBase Input.0 -   at com.pentaho.big.data.bundles.impl.shim.hbase.table.ResultScannerBuilderImpl$3.perform(ResultScannerBuilderImpl.java:109)

2018/10/09 14:56:25 - HBase Input.0 -   at com.pentaho.big.data.bundles.impl.shim.hbase.BatchHBaseConnectionOperation.perform(BatchHBaseConnectionOperation.java:45)

2018/10/09 14:56:25 - HBase Input.0 -   at com.pentaho.big.data.bundles.impl.shim.hbase.table.ResultScannerBuilderImpl.build(ResultScannerBuilderImpl.java:126)

2018/10/09 14:56:25 - HBase Input.0 -   at org.pentaho.big.data.kettle.plugins.hbase.input.HBaseInput.processRow(HBaseInput.java:243)

2018/10/09 14:56:25 - HBase Input.0 -   ... 2 more

2018/10/09 14:56:25 - HBase Input.0 - Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.hbase.filter.TimestampsFilter.<init>(org.apache.hadoop.hbase.filter.CompareFilter$CompareOp, org.apache.hadoop.hbase.filter.ByteArrayComparable)

2018/10/09 14:56:25 - HBase Input.0 -   at java.lang.Class.getConstructor0(Class.java:3082)

2018/10/09 14:56:25 - HBase Input.0 -   at java.lang.Class.getConstructor(Class.java:1825)

2018/10/09 14:56:25 - HBase Input.0 -   at org.pentaho.hbase.shim.common.CommonHBaseConnection.addFilter(CommonHBaseConnection.java:699)

2018/10/09 14:56:25 - HBase Input.0 -   at org.pentaho.hbase.shim.common.CommonHBaseConnection.addFilterByMapping(CommonHBaseConnection.java:685)

2018/10/09 14:56:25 - HBase Input.0 -   at org.pentaho.hbase.shim.common.CommonHBaseConnection.addColumnFilterToScan(CommonHBaseConnection.java:547)

2018/10/09 14:56:25 - HBase Input.0 -   at com.pentaho.big.data.bundles.impl.shim.hbase.HBaseConnectionWrapper.addColumnFilterToScan(HBaseConnectionWrapper.java:142)

2018/10/09 14:56:25 - HBase Input.0 -   at com.pentaho.big.data.bundles.impl.shim.hbase.table.ResultScannerBuilderImpl$3.perform(ResultScannerBuilderImpl.java:107)

2018/10/09 14:56:25 - HBase Input.0 -   ... 5 more

2018/10/09 14:56:25 - HBase Input.0 - child index = 0, logging object : org.pentaho.di.core.logging.LoggingObject@74fcdac4 parent=5c8a29c5-c11b-4e78-a4d9-fae6e39845fe

2018/10/09 14:56:25 - HBase Input.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)

 

Can you help me?

Outcomes