Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19106

Move files step is not working as expected

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Severity: Medium
    • Resolution: Unresolved
    • Affects Version/s: 8.3.0 GA, 9.1.0 GA
    • Fix Version/s: Backlog
    • Component/s: None
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide

      Install Spoon 8.3/9.1
      1. Create the following directores at Workstation side.
      C:\PentahoTest/trans_P06_S40/11_outputdata/src
      C:\PentahoTest/trans_P06_S40/11_outputdata/dest
      C:\PentahoTest/trans_P06_S40/11_outputdata/src/file1
      C:\PentahoTest/trans_P06_S40/11_outputdata/dest/file1
      2. Connect to the repository.
      NOTE: Connect to a repository that fits your environment.
      3. Select "Edit">"Edit the kettle.properties file".
      Set following properties.

      Variable name: ROOT_DIR
      Value: C:\
      

      4) Upload the following attached jobs and transformation to the /home/admin directory.

      Expected Result
      A text file which contains file name information is output by "Get files from result" step, when "Add to files to result files name" is checked and "If destination file exists" is "Delete source file".

      Actual result
      The text file does not get greated.

      Show
      Install Spoon 8.3/9.1 1. Create the following directores at Workstation side. C:\PentahoTest/trans_P06_S40/11_outputdata/src C:\PentahoTest/trans_P06_S40/11_outputdata/dest C:\PentahoTest/trans_P06_S40/11_outputdata/src/file1 C:\PentahoTest/trans_P06_S40/11_outputdata/dest/file1 2. Connect to the repository. NOTE: Connect to a repository that fits your environment. 3. Select "Edit">"Edit the kettle.properties file". Set following properties. Variable name: ROOT_DIR Value: C:\ 4) Upload the following attached jobs and transformation to the /home/admin directory. Expected Result A text file which contains file name information is output by "Get files from result" step, when "Add to files to result files name" is checked and "If destination file exists" is "Delete source file". Actual result The text file does not get greated.

      Description

      Pentaho Product: PDI Spoon
      Version: 8.3
      Operating System:Windows 10
      Memory Available/Used: NA
      Hardware:NA
      Clustered/No: NA
      Virtualized?: NA
      Database for repository: NA
      Database for data: SQL SERVER 2017
      Browser type and version (If Applicable): NA
      Did you attach logs? No
      Did you attach sample demonstrating the problem? Yes*

      When we look at the main job CCL-PDI-S064001-078-L it calls another job called Job1_S064001_078 where the logic is to use a Move files steps. On the steps' advanced tab I checked "Add files to result files name". Based on the documentation on this step I expect path and filenames of the moved files to be passed to the next job entry (doc: add the target file names to the list of result files of this job entry for use in the next job entries).

      We have a transformation entry in the Main job called Trans1_S064001_078 which has a "Get files from result" step and the output from that step is to written to a text file.]

      When we run the main job we see the following stack trace

      2021/03/08 18:27:21 - get files from result.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
      2021/03/08 18:27:21 - テキストファイル出力.0 - Starting to run...
      2021/03/08 18:27:21 - Trans1_S064001_078 - Transformation has allocated 3 threads and 2 rowsets.
      2021/03/08 18:27:21 - Write to log.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
      2021/03/08 18:27:21 - テキストファイル出力.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=0)
      

      This shows that Move files step is not working as expected.

        PractiTest Integration




          Attachments

            Issue Links

              Activity

                People

                Assignee:
                Unassigned Unassigned
                Reporter:
                avaradaraju Abhimanyu Varadaraju
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                  Dates

                  Created:
                  Updated: