We are using the "Google Spreadsheet Input/Output" plugin from the marketplace created by Brian Zoetewey which is no longer maintained. <a href="https://github.com/GlobalTechnology/pdi-google-spreadsheet-plugin" alt="https://github.com/GlobalTechnology/pdi-google-spreadsheet-plugin" target="_blank">Github repository link</a>. Recently I have received an email from Google with the subject:[Action Required] Google Sheets v3 API is being shutdown on March 3, 2020 Can someone have a look the source code and check if the plugin is using API v3 or v4. I tried to find out myself, but looking at the code I don't have a clue. <a data-tag-text="Kettle" data-sign="#" class="user-content-hashtag" href="https://hitachi.connectedcommunity.org/search?s=tags%3A%22Kettle%22&executesearch=true" data-tag-key="e58f5353-0c00-4c3e-854c-4b082a5ea7b6">#Kettle</a> <a data-tag-text="Pentaho" data-sign="#" class="user-content-hashtag" href="https://hitachi.connectedcommunity.org/search?s=tags%3A%22Pentaho%22&executesearch=true" data-tag-key="70b4436b-4549-4ce3-aa64-4566c7b665c9">#Pentaho</a> <a data-tag-text="PentahoDataIntegrationPDI" data-sign="#" class="user-content-hashtag" href="https://hitachi.connectedcommunity.org/search?s=tags%3A%22Pentaho Data Integration PDI%22&executesearch=true" data-tag-key="b01e3d75-3411-4f9a-a674-a7e8d0c9c995">#PentahoDataIntegrationPDI</a>

Pentaho

View Only

"Google Spreadsheet Input/Output" plugin compatible with Google Sheets API v4?

Sebastian Lechner posted 01-07-2020 15:41

We are using the "Google Spreadsheet Input/Output" plugin from the marketplace created by Brian Zoetewey which is no longer maintained. Github repository link. Recently I have received an email from Google with the subject:

[Action Required] Google Sheets v3 API is being shutdown on March 3, 2020

Can someone have a look the source code and check if the plugin is using API v3 or v4. I tried to find out myself, but looking at the code I don't have a clue.

#Kettle
#Pentaho
#PentahoDataIntegrationPDI

Sebastian Lechner posted 01-16-2020 15:38

Instead of giving an answer to this question, the plugin has been removed from the marketplace although it is still working and it seems to be the only available Google Spreadsheet solution in the Community Edition. Very helpful.

Dean Flinter posted 01-21-2020 13:07

It is v3 unfortunately

Sergio Ribeiro posted 01-29-2020 17:35

Hello all,

Thought this information may be useful to someone.

As of this date, of the 27 forks of that repository, 19 are even or behind the original one.

I've took a (little) look and four of the other ones seem promising in that have some reference about the v4 API or the code seems to handle that:

https://github.com/huantaoliu/pdi-google-spreadsheet-plugin
https://github.com/LatinumNetwork/pdi-google-spreadsheet-plugin
https://github.com/noviadi/pdi-google-spreadsheet-plugin
https://github.com/valdineygomes/pdi-google-spreadsheet-plugin

Note that I did not test, nor fully reviewed, any of them.

Regards,

Sérgio Ribeiro

Porto - Portugal

Caroline Jacquet posted 01-29-2020 18:43

Appreciate these references!!

Sebastian Lechner posted 02-07-2020 14:54

Hi,

I have checked the forks posted by @Sergio Ribeiro and found that they cannot be built because of outdated dependency structure in the pom.xml. It took me a day to refactor the pom.xml updating all dependency artifacts to their latest available version and add missing dependencies. The plugin can now be built again and I had the gsheet input step running in production for a week now without any problems.

What would you say is the best way to make the new pom.xml available to the public? Create another fork? Create Pull Request for the existing forks, hoping someone cares to merge?

Please advise.

Dean Flinter posted 02-07-2020 15:35

Perhaps make your own fork with the updated pom.xml.

However are you absolutley sure that it is 100% API v4 compatible? If some parts of it still reference v3, it will break on 4th March

Sebastian Lechner posted 02-07-2020 16:21

I have used a fork which claims to have updated to use API v4 -> https://github.com/valdineygomes/pdi-google-spreadsheet-plugin

I just ran the build process again and saw that I get this warning:

[WARNING] .../pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java: Some input files use or override a deprecated API.

not sure what it really means.

Sebastian Lechner posted 02-07-2020 16:32

I could get more detailed output:

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[13,31] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[24,48] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[19,31] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[25,48] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheet.java:[3,52] com.google.api.client.googleapis.auth.oauth2.GoogleCredential in com.google.api.client.googleapis.auth.oauth2 has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[64,19] getDialogClassName() in org.pentaho.di.trans.step.StepMetaInterface has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[40,13] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[54,9] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[54,40] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[58,27] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[69,27] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[104,12] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[108,32] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[134,18] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[137,65] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[144,70] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[169,38] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[174,40] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[181,44] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[202,38] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[205,40] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[212,44] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[228,17] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[231,84] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[238,89] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetInputMeta.java:[251,18] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/trans/steps/googlespreadsheet/GoogleSpreadsheetOutputMeta.java:[49,19] getDialogClassName() in org.pentaho.di.trans.step.StepMetaInterface has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[316,71] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[323,76] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[330,28] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[593,13] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[598,35] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[624,44] org.pentaho.di.trans.steps.textfileinput.TextFileInputField in org.pentaho.di.trans.steps.textfileinput has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[628,46] org.pentaho.di.core.row.ValueMeta in org.pentaho.di.core.row has been deprecated

[WARNING] /Users/sl/pdi-google-spreadsheet-plugin/src/main/java/org/ccci/gto/pdi/ui/trans/steps/googlespreadsheet/GoogleSpreadsheetInputDialog.java:[635,50]

...

Dean Flinter posted 02-07-2020 16:37

All look like Pentaho deprecations

If it is working, then great but it is possible Pentaho will eventually retire these too

Ana Gonzalez posted 02-10-2020 11:08

Hi Sebastien, just so you know, there's someone at Hitachi working on upgrading the plugin, I don't know if it will be in time before Google shut down the old version or if it will be released for the Community. I'll test it when it's available.

Meanwhile, just in case it's not in time, I'm working on a R script (the server with Pentaho installed has R already installed, so I can use it) to download my Google Spreadsheet. I asked other people around what they were using instead of the plugin, and others were using python scripts.

So if you have python or R in your server you can work some script to download what you need if the upgrading of the plugin is giving you a hard time. I'm not a Java developer, so upgrading it myself would be too much work, finding some example to adapt for my use case in R or Python seemed much more affordable in my case 😉

Regards

Sebastian Lechner posted 02-11-2020 12:26

Hi Ana, thanks for your reply. In the meantime I found out that

https://github.com/valdineygomes/pdi-google-spreadsheet-plugin

can be compiled and that it is working. During compilation, it has a few deprecation warnings for some pentaho classes and for googleapis.auth.oauth2. From my point of view this is fine for now, and I believe with this fork, Google Spreadsheet plugin is running with API v4.

However, we are trying to replace the deprecated classes and modules with the recommended ones and would do a PR on the above repository then.

Sebastian Lechner posted 02-11-2020 12:33

https://github.com/valdineygomes/pdi-google-spreadsheet-plugin

can be compiled and it is working. To me it looks, that Valdiney Gomes made the fork compatible with API v4 by upgrading the pom.xml dependencies to newer version numbers. We will try to replace the deprecated classes and methods by newer ones. If we succeed, we'll create a PR or a new fork.

Jean-Francois Monteil posted 02-13-2020 11:14

https://github.com/jfmonteil/Pentaho-Google-Sheet-Plugin new API V4 google sheet plugin, enjoy and please report bugs

Pentaho

"Google Spreadsheet Input/Output" plugin compatible with Google Sheets API v4?

Related Content

Issue while downloading Maven License Helper Plugin: code 503 from server: Service Unavailable

Pentaho Marketplace showing No plugin found that matched your criteria.

RE: Pentaho Marketplace showing No plugin found that matched your criteria.

RE: Pentaho Marketplace showing No plugin found that matched your criteria.

RE: Pentaho Marketplace showing No plugin found that matched your criteria.