Pentaho

 View Only

 Can i get XML/JSON data from URL every 3 hours?

  • Pentaho
  • Kettle
  • Pentaho
  • Pentaho Data Integration PDI
nipitpon songluk's profile image
nipitpon songluk posted 10-17-2018 04:48

I tried to use "REST Client" and "Get data from XML" to get data from

http://data.tmd.go.th/api/WeatherWarningNews/v1/?uid=demo&ukey=demokey

everythings looks be ok, but it's doesn't work.

and when I'm tried to get a data from XML file on local computer, it's work very well.

Any ideas, Please Advise

Very Thanks,

pastedimage_2

pastedimage_4

pastedimage_5

pastedimage_6


#Pentaho
#Kettle
#PentahoDataIntegrationPDI
David Marlow's profile image
David Marlow posted 10-20-2018 22:20

You probably need to add a generate rows step  to trigger the Get XML step ...If it still doesn't not work,  use the HTTP Client step ..that works to get the page ( I just did it ) but that still needs  a row to trigger also.  as far as every 3 hours you can do that a number of ways ...in the tranformation ...just use the delays rows step and generate as many rows as you like and a case to skip the first row ( not wait 3 hours to get the first time) . 

John Craig's profile image
John Craig posted 10-24-2018 18:35

Rather than adding a delay to the PDI transformation, I'd suggest using either the Schedule capability that is built into the PDI Client or running the transformation via pan.bat or pan.sh (as appropriate for your environment) using the host operating system's scheduling capability.

Related Content