Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-1905

Text File Input could be improved by having an option to pass through all fields when accepting filename from previous step.

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Severity: Low
    • Resolution: Fixed
    • Affects Version/s: 3.0.0 GA, 3.0.1, 3.0.2, 3.0.3, 3.0.4, 3.1.0 GA
    • Fix Version/s: 3.2.0 GA
    • Component/s: Step, Transformation
    • Labels:
      None
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      This is a problem for me currently because my transformations build up a file list to operate on and that data might contain other useful fields such as the source of the data.
      Without this feature, I have to either do an expensive merge-join around the TextFileInput, or I have to reconstruct the data on each record generated by the TFI.

      The way I have implemented this is as an option for the TFI to keep the row objects for each record coming into the TFI and use them as the beginning of the output rows.
      If the option is not enabled, the behavior is consistent with previous versions of TFI, preserving compatibility with previously created transformations.

        Attachments

          Activity

            People

            • Assignee:
              gdavid Golda Thomas
              Reporter:
              deinspanjer Daniel Einspanjer (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: