Pentaho

 View Only

The aws s3 cp statement works in the terminal but not in the Pentaho Shell Step

This thread has been viewed 10 times
  • 1.  The aws s3 cp statement works in the terminal but not in the Pentaho Shell Step

    Posted 06-30-2022 12:10
    I am using Pentaho 8.3 and running the job through a shell script on an Linux EC2 Dev server.
    When I enter the command in the terminal, it works but when I insert it in the Pentaho Shell Step it fails.

    Due to security measures the Platform Support Team will not grant access to the /tmp Folder
    Why does the Pentaho Step default to /tmp please?
    How do we fix it please?

    aws s3 cp /home/User_ID/POC_s3_test01.txt s3://dat-s3-bucket-name/POC_s3_testvp.txt

    error:

    2022/06/29 12:33:22 - jb_POC_S3_log_copy - Start of job execution

    2022/06/29 12:33:22 - Carte - Installing timer to purge stale objects after 1440 minutes.

    2022/06/29 12:33:22 - jb_POC_S3_log_copy - Starting entry [upload output file to s3]

    2022/06/29 12:33:23 - upload output file to s3 - Running on platform : Linux

    2022/06/29 12:33:23 - upload output file to s3 - Executing command : /tmp/kettle_48837c3d-f79f-11ec-bc2b-1568fcd673ceshell

    2022/06/29 12:33:23 - upload output file to s3 - ERROR (version 8.3.0.0-371, build 8.3.0.0-371 from 2019-06-11 11.09.08 by buildguy) : Error running shell [null] : java.io.IOException: Cannot run program "/tmp/kettle_48837c3d-f79f-11ec-bc2b-1568fcd673ceshell": error=13, Permission denied

    2022/06/29 12:33:23 - upload output file to s3 - ERROR (version 8.3.0.0-371, build 8.3.0.0-371 from 2019-06-11 11.09.08 by buildguy) : java.io.IOException: Cannot run program "/tmp/kettle_48837c3d-f79f-11ec-bc2b-1568fcd673ceshell": error=13, Permission denied



    ------------------------------
    Vince Popplewell
    Systems Engineer
    Capgemini
    ------------------------------