Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-1215

Text fiel output: Read filenames from stream

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Severity: Unknown
    • Resolution: Fixed
    • Affects Version/s: 3.1.0 GA
    • Fix Version/s: 3.1.0 GA
    • Component/s: Step
    • Labels:
      None
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      Hi,

      enclosed you find an enhanced text file output step. You have now the option to tick a "Find file name in field" option and then selct the field in the input stream. The rows are then written into the file, that is defined in that field. If necessary, additional files are opened.

      A new file is only opened when a new row has a different file name than its predecessor. Therefore sorting the data set by file name should lead to an increased performance in case the overhead of openeing and closing files gets to large.

      I tested the step for my use case. I also attach a generic transformation that demonstrates the new feature.

      Hopefully the feature is deemed fit for the 3.1 release.

      Regards,
      Ingo

      P.s.: An additional feature in the code - enclosure and seperator can now be set by variables. I will add a comment to the case with the request for this feature.

        Attachments

          Activity

            People

            Assignee:
            gdavid Golda Thomas
            Reporter:
            iklose Ingo Klose
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: