Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19082

The timestamp format in Text File Output gets passed to the next Text File Output in the stream if that step has no format selected

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Urgent
    • Resolution: Fixed
    • Affects Version/s: 8.1.0.6 GA, 8.3.0 GA, 9.0.0 GA, 9.1.0 GA
    • Fix Version/s: 9.2.0 GA
    • Component/s: Step
    • Labels:
    • Story Points:
      0
    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Sprint Team:
      Tatooine (Maint)
    • Steps to Reproduce:
      Hide
      1. Install PDI 7.1
      2. Download the sample KTR:  TextFileOutput_TimeStampFormat.ktr
      3. Start 7.1 Spoon and open the sample KTR
      4. Edit step "Text file output With Format" and change the file to a valid path.  Also notice the timestamp format is set to yyyyMMddHHmmss in the Fields tab.
      5. Edit step "Text file output Without Format" and change the file to a valid path.  Also notice that the timestamp format is not set.
      6. Edit step "Text file output Without Format (First)" and change the file to a valid path.  Also notice that the timestamp format is not set.
      7. Run the KTR.
      8. Notice that the output from "Text file output With Format" has the correct format.  Notice both "Text file output Without Format" and "Text file output Without Format (First)" have the default format: yyyy/MM/dd HH:mm:ss.SSSSSSSSS
      9. Install PDI 8.3 or higher
      10. Start 8.3 Spoon and open the sample KTR.
      11. Run the KTR.
      12. Notice that the output from "Text file output Without Format" now has the same formatting as "Text file output With Format" instead of the default formatting that "Text file output Without Format (First)" still has

      Actual Results: The second Text File Output without formatting in the stream adopts the format from the Text File Output before it.

      Expected Results:  The second Text File Output without formatting in the stream should output the default formatting if the format is not set.

      Show
      Install PDI 7.1 Download the sample KTR:   TextFileOutput_TimeStampFormat.ktr Start 7.1 Spoon and open the sample KTR Edit step "Text file output With Format" and change the file to a valid path.  Also notice the timestamp format is set to  yyyyMMddHHmmss in the Fields tab. Edit step "Text file output Without Format" and change the file to a valid path.  Also notice that the timestamp format is not set . Edit step "Text file output Without Format (First)" and change the file to a valid path.  Also notice that the timestamp format is not set. Run the KTR. Notice that the output from "Text file output With Format" has the correct format.  Notice both  "Text file output Without Format" and "Text file output Without Format (First)" have the default format: yyyy/MM/dd HH:mm:ss.SSSSSSSSS Install PDI 8.3 or higher Start 8.3 Spoon and open the sample KTR. Run the KTR. Notice that the output from "Text file output Without Format" now has the same formatting as "Text file output With Format" instead of the default formatting that "Text file output Without Format (First)" still has Actual Results: The second Text File Output without formatting in the stream adopts the format from the Text File Output before it. Expected Results:   The second Text File Output without formatting in the stream should output the default formatting if the format is not set.

      Description

      If a date/timestamp format is not set in the Text File Output, the default format of yyyy/MM/dd HH:mm:ss.SSSSSSSSS is applied to it.

      Prior to 8.1.0.6, if a Text File Output step without formatting followed another Text File Output step with formatting, the default yyyy/MM/dd HH:mm:ss.SSSSSSSSS would still be applied to the step without formatting.

      From 8.1.0.6 on, this is no longer the case.  The second Text File Output step adopts the format from the first Text File Output step.

      For example, in this design the first Text File Output step has a format set, while the second Text File Output does not.

      First step's format:

      Second step's format:

      With 7.1, the output of the first Text File Output would be the expected format that was set, in this case yyyyMMddHHmmss.  The second Text File Output would get the default formatting (yyyy/MM/dd HH:mm:ss.SSSSSSSSS) since no format was selected.

      With 8.3, both the output of the first and second Text File Output get the format of the first step.

      Sample KTR output files for both 7.1 and 8.3:

      71Timestamp_Output.zip

      83Timestamp_Output.zip

        Attachments

        1. 71Output.PNG
          71Output.PNG
          7 kB
        2. 71Timestamp_Output.zip
          0.6 kB
        3. 83Output.PNG
          83Output.PNG
          8 kB
        4. 83Timestamp_Output.zip
          0.6 kB
        5. TextFileOutput_TimeStampFormat.ktr
          19 kB
        6. timestamp_formatKTR.PNG
          timestamp_formatKTR.PNG
          16 kB
        7. timestamp_noformatKTR.PNG
          timestamp_noformatKTR.PNG
          15 kB

          Issue Links

            Activity

              People

              Assignee:
              vasco.marques Vasco Marques
              Reporter:
              bowens Brittany Owens
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: