Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-1905

Text File Input could be improved by having an option to pass through all fields when accepting filename from previous step.



    • Type: Improvement
    • Status: Closed
    • Severity: Low
    • Resolution: Fixed
    • Affects Version/s: 3.0.0 GA, 3.0.1, 3.0.2, 3.0.3, 3.0.4, 3.1.0 GA
    • Fix Version/s: 3.2.0 GA
    • Component/s: Step, Transformation
    • Labels:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.


      This is a problem for me currently because my transformations build up a file list to operate on and that data might contain other useful fields such as the source of the data.
      Without this feature, I have to either do an expensive merge-join around the TextFileInput, or I have to reconstruct the data on each record generated by the TFI.

      The way I have implemented this is as an option for the TFI to keep the row objects for each record coming into the TFI and use them as the beginning of the output rows.
      If the option is not enabled, the behavior is consistent with previous versions of TFI, preserving compatibility with previously created transformations.




            • Assignee:
              gdavid Golda Thomas
              deinspanjer Daniel Einspanjer (Inactive)
            • Votes:
              0 Vote for this issue
              0 Start watching this issue


              • Created: