Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19319

Mapping (sub-transformation): Race condition occurs when there is a data split before the mapping step.

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Severity: High
    • Resolution: Unresolved
    • Affects Version/s: 9.0.0.7 GA, 9.1.0 GA, 9.2.0 GA, 8.3.0.19 GA
    • Fix Version/s: Backlog
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      • Please use the attached job and the transformation to replicate the issue.
      • I have used 8.3,9.0,9.1 and 9.2 with the latest SP's

      Description

      There is an issue, when we rename a field in a "Mapping (sub-transformation)" Step, sometimes the Metadata of the sorting Step gets the wrong field name. It occurs when the step before the mapping step has a data split. This produces some kind of race condition. Sometimes we get an error, sometimes everything is fine.

      Below is the error generated running the attached job,

      2021/09/09 06:52:05 - Sort rows.0 - ERROR (version 9.2.0.0-290, build 9.2.0.0-290 from 2021-06-02 06.36.08 by buildguy) : Unexpected error2021/09/09 06:52:05 - Sort rows.0 - ERROR (version 9.2.0.0-290, build 9.2.0.0-290 from 2021-06-02 06.36.08 by buildguy) : Unexpected error2021/09/09 06:52:05 - Sort rows.0 - ERROR (version 9.2.0.0-290, build 9.2.0.0-290 from 2021-06-02 06.36.08 by buildguy) : org.pentaho.di.core.exception.KettleException: 2021/09/09 06:52:05 - Sort rows.0 - The field Dummy1 specified in the "Sort rows" step is not in the steps input stream.2021/09/09 06:52:05 - Sort rows.0 - 2021/09/09 06:52:05 - Sort rows.0 - at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:426)2021/09/09 06:52:05 - Sort rows.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)2021/09/09 06:52:05 - Sort rows.0 - at java.lang.Thread.run(Thread.java:748)

       

        Attachments

        1. MainTrans.ktr
          18 kB
        2. Runner.kjb
          12 kB
        3. TransMap.ktr
          13 kB

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            jagdeeshss Jagdeeshss
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Dates

              Created:
              Updated: