Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19183

Abort step: Transformation does not abort with setting maximum value(2147483647) in field "Abort threshold".

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Severity: High
    • Resolution: Unresolved
    • Affects Version/s: 9.1.0 GA, 8.3.0.0
    • Fix Version/s: Backlog
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide

      Steps to replicate:

      • Use Pentaho Spoon 8.3 or 9.1
      • Open the attached transformation and execute. AbortTest.ktr
      Show
      Steps to replicate: Use Pentaho Spoon 8.3 or 9.1 Open the attached transformation and execute. AbortTest.ktr

      Description

      When setting a maximum value like 2147483647 in the field "Abort threshold" of the Abort step, the transformation does not abort as expected.
      The transformation takes 2 days to run and the last few lines of the pdi.log say

      2021-05-16 22:33:47.888 WARN <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Seen row nr 2147483646 : [null]
      2021-05-16 22:33:47.888 WARN <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Seen row nr 2147483647 : [null]
      2021-05-16 22:33:47.889 WARN <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Seen row nr -2147483648 : [null]
      2021-05-16 22:33:47.892 INFO <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Finished processing (I=0, O=0, R=2147483648, W=2147483648, U=0, E=0)
      

      In the Spoon UI, we don't even see the message of transformation completion. The only way is check for the status is via logs.

       

      If we try to abort the same transformation at the 300th row then we get the message as below in the pdi.log

      2021-05-17 10:56:38.612 WARN <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Seen row nr 300 : [null]
      2021-05-17 10:56:38.613 ERROR <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Row nr 301 causing abort "Abort the running transformation": [null]
      2021-05-17 10:56:38.613 ERROR <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Aborting after having seen 301 rows.
      2021-05-17 10:56:38.614 INFO <AbortTest - Abort> [C:\D-Drive\AbortTest.ktr] Finished processing (I=0, O=0, R=301, W=301, U=0, E=0)
      

        Attachments

        1. Abort_Not_Working.PNG
          Abort_Not_Working.PNG
          48 kB
        2. Abort_Working.PNG
          Abort_Working.PNG
          45 kB
        3. AbortTest.ktr
          13 kB

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            gdev Gurudev
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated: