Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19159

Add Ability To Ignore Counting Headers/Footers to 'Get Files Rows Count' Step

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Open
    • Severity: Unknown
    • Resolution: Unresolved
    • Affects Version/s: 9.1.0.3 GA
    • Fix Version/s: None
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      The 'Text file input' step has the fields:

      'Header' [value]

      'Footer' [value]

      It would be helpful to have these fields added to the 'Get files rows count' step.  Having them available would eliminate the need for additional steps that correct the total returned by 'Get files rows count' to reflect the actual number of data rows read (see later).

      If the step had the ability to nominate fields in which integer values could specify 'number of header rows' and 'number of footer rows', then this would align with the ability to identify a field in which the filename to count from is found and allow for a list of files with varying header/footer conditions to be processed.

      eg:

      [filename]:[number_of_header_rows]:[number_of_footer_rows]

      filenamea, 0, 0   (ignore header/footers ie - disable the correction)

      filenameb, 1, 0  (one header row, no footer rows)

      filenamec, 1, 2 (one header, two footer rows)

      THX!

        Attachments

          Activity

            People

            Assignee:
            project admin Triage
            Reporter:
            mr_thwibble Mr Thwibble
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated: