Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-12318

NullPointerException running job with massive parallel Job/Transformation loads

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: High
    • Resolution: Fixed
    • Affects Version/s: 4.4.3, 5.1.0 GA
    • Fix Version/s: 5.2.0 GA
    • Component/s: Job, Job Entry
    • Labels:
      None
    • Environment:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Sprint Team:
      EPAM General
    • Operating System/s:
      RedHat Enterprise Linux 6

      Description

      From time to time we get a NPE on our CI-Server (and once in production environment) in a job, which starts approx. 50 Jobs in parallel.

      It seems there is a race condition in collecting the result which throws the NPE.

      [master>ant test@xldwht01:8811] INFO  -      [exec] ERROR 03-06 01:08:15,595 - jb_load_link_satellites_main - file:///home/tsuadm/Quickbuild/workspaces/689/workspace/etl/kettle/edwh/link_satellites/jb_load_link_satellites_main.kjb : jb_load_link_satellites_main
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] ERROR 03-06 01:08:15,596 - Load link satellites main - An error occurred executing this job entry : 
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] ERROR 03-06 01:08:15,596 - Load link satellites main - org.pentaho.di.core.exception.KettleException: 
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] Unexpected error occurred while launching entry [Flow Splitter Left.0]
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at java.lang.Thread.run (Thread.java:662)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job$1.run (Job.java:705)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.access$000 (Job.java:103)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.execute (Job.java:792)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.core.Result.add (Result.java:555)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  - 
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job$1.run(Job.java:711)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at java.lang.Thread.run(Thread.java:662)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] Caused by: java.lang.NullPointerException
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.core.Result.add(Result.java:555)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.execute(Job.java:792)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.access$000(Job.java:103)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job$1.run(Job.java:705)
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  -      [exec] 	... 1 more
      01:08:15,655 [master>ant test@xldwht01:8811] INFO  - 
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] org.pentaho.di.core.exception.KettleException: 
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] Unexpected error occurred while launching entry [Flow Splitter Left.0]
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at java.lang.Thread.run (Thread.java:662)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job$1.run (Job.java:705)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.access$000 (Job.java:103)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.execute (Job.java:792)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.core.Result.add (Result.java:555)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  - 
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job$1.run(Job.java:711)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at java.lang.Thread.run(Thread.java:662)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] Caused by: java.lang.NullPointerException
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.core.Result.add(Result.java:555)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.execute(Job.java:792)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job.access$000(Job.java:103)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	at org.pentaho.di.job.Job$1.run(Job.java:705)
      01:08:15,694 [master>ant test@xldwht01:8811] INFO  -      [exec] 	... 1 more
      01:08:15,755 [master>ant test@xldwht01:8811] INFO  -      [exec] INFO  03-06 01:08:15,658 - jb_load_link_satellites - Finished job entry [Load link satellites main] (result=[false])
      

        Attachments

          Activity

            People

            Assignee:
            ihar_chekan Ihar Chekan (Inactive)
            Reporter:
            max Max Hofer
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 0h
                0h
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 9h
                9h