Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-8792

IndexOutOfBoundsException while running jobs in parallel

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: High
    • Resolution: Duplicate
    • Affects Version/s: 4.3.0 GA (4.5.0 GA Suite Release)
    • Fix Version/s: None
    • Component/s: Job, Logging
    • Labels:
      None
    • Environment:
      Win7 X64 and 64-bit java sdk 1.6.0_35-b10
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      I have a job that is set to 'execute for every row' from a previous transformation. This job then calls a sub-job that executes 8 jobs in parallel. Sometimes I get an IndexOutOfBoundsException during my run. It is random as to what loop number I am on that causes this error. I will upload a zip with my jobs so you can run them. They are set up to have 500 rows to loop through. When I get the error, sometimes the job stops, and sometimes it continues running.

      3 errors I have seen:

      java.lang.IndexOutOfBoundsException: Index: 98, Size: 98
      at java.util.ArrayList.RangeCheck(ArrayList.java:547)
      at java.util.ArrayList.get(ArrayList.java:322)
      at org.pentaho.di.core.logging.LoggingRegistry.registerLoggingSource(LoggingRegistry.java:153)
      at org.pentaho.di.core.logging.LogChannel.<init>(LogChannel.java:41)
      at org.pentaho.di.job.entry.JobEntryBase.<init>(JobEntryBase.java:134)
      at org.pentaho.di.job.entries.delay.JobEntryDelay.<init>(JobEntryDelay.java:67)
      at org.pentaho.di.job.entries.delay.JobEntryDelay.<init>(JobEntryDelay.java:73)
      at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown Source)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
      at java.lang.Class.newInstance0(Class.java:355)
      at java.lang.Class.newInstance(Class.java:308)
      at org.pentaho.di.core.plugins.PluginRegistry.loadClass(PluginRegistry.java:370)
      at org.pentaho.di.job.entry.JobEntryCopy.<init>(JobEntryCopy.java:116)
      at org.pentaho.di.job.JobMeta.loadXML(JobMeta.java:1161)
      at org.pentaho.di.job.JobMeta.loadXML(JobMeta.java:969)
      at org.pentaho.di.job.JobMeta.<init>(JobMeta.java:871)
      at org.pentaho.di.job.JobMeta.<init>(JobMeta.java:831)
      at org.pentaho.di.repository.filerep.KettleFileRepository.loadJob(KettleFileRepository.java:757)
      at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1119)
      at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:558)
      at org.pentaho.di.job.Job.execute(Job.java:589)
      at org.pentaho.di.job.Job.execute(Job.java:728)
      at org.pentaho.di.job.Job.access$000(Job.java:103)
      at org.pentaho.di.job.Job$1.run(Job.java:703)
      at java.lang.Thread.run(Thread.java:662)

      ------------------------------------------------------------------
      ------------------------------------------------------------------
      org.pentaho.di.core.exception.KettleException:
      Unexpected error occurred while launching entry [DUMMY 12.0]

      Unexpected error occurred while launching entry [zzz_run_batch (3).0]

      Unexpected error occurred while launching entry [DUMMY 3.0]
      Index: 4, Size: 4

      at org.pentaho.di.job.Job$1.run(Job.java:709)
      at java.lang.Thread.run(Thread.java:662)
      Caused by: org.pentaho.di.core.exception.KettleException:
      Unexpected error occurred while launching entry [zzz_run_batch (3).0]

      Unexpected error occurred while launching entry [DUMMY 3.0]
      Index: 4, Size: 4

      at org.pentaho.di.job.Job.execute(Job.java:733)
      at org.pentaho.di.job.Job.access$000(Job.java:103)
      at org.pentaho.di.job.Job$1.run(Job.java:703)
      ... 1 more
      Caused by: org.pentaho.di.core.exception.KettleException:
      Unexpected error occurred while launching entry [DUMMY 3.0]
      Index: 4, Size: 4

      at org.pentaho.di.job.Job.execute(Job.java:733)
      at org.pentaho.di.job.Job.execute(Job.java:728)
      ... 3 more
      Caused by: java.lang.IndexOutOfBoundsException: Index: 4, Size: 4
      at java.util.ArrayList.RangeCheck(ArrayList.java:547)
      at java.util.ArrayList.get(ArrayList.java:322)
      at org.pentaho.di.core.logging.LoggingRegistry.registerLoggingSource(LoggingRegistry.java:153)
      at org.pentaho.di.core.logging.LogChannel.<init>(LogChannel.java:52)
      at org.pentaho.di.job.entry.JobEntryBase.setParentJob(JobEntryBase.java:869)
      at org.pentaho.di.job.Job.execute(Job.java:574)
      at org.pentaho.di.job.Job.execute(Job.java:728)
      ... 4 more

      ------------------------------------------------------------------
      ------------------------------------------------------------------
      java.lang.IndexOutOfBoundsException: Index: 94, Size: 94
      at java.util.ArrayList.RangeCheck(ArrayList.java:547)
      at java.util.ArrayList.get(ArrayList.java:322)
      at org.pentaho.di.core.logging.LoggingRegistry.registerLoggingSource(LoggingRegistry.java:153)
      at org.pentaho.di.core.logging.LogChannel.<init>(LogChannel.java:41)
      at org.pentaho.di.job.entry.JobEntryBase.<init>(JobEntryBase.java:134)
      at org.pentaho.di.job.entries.createfile.JobEntryCreateFile.<init>(JobEntryCreateFile.java:74)
      at org.pentaho.di.job.entries.createfile.JobEntryCreateFile.<init>(JobEntryCreateFile.java:83)
      at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown Source)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
      at java.lang.Class.newInstance0(Class.java:355)
      at java.lang.Class.newInstance(Class.java:308)
      at org.pentaho.di.core.plugins.PluginRegistry.loadClass(PluginRegistry.java:370)
      at org.pentaho.di.job.entry.JobEntryCopy.<init>(JobEntryCopy.java:116)
      at org.pentaho.di.job.JobMeta.loadXML(JobMeta.java:1161)
      at org.pentaho.di.job.JobMeta.loadXML(JobMeta.java:969)
      at org.pentaho.di.job.JobMeta.<init>(JobMeta.java:871)
      at org.pentaho.di.job.JobMeta.<init>(JobMeta.java:831)
      at org.pentaho.di.repository.filerep.KettleFileRepository.loadJob(KettleFileRepository.java:757)
      at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1119)
      at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:558)
      at org.pentaho.di.job.Job.execute(Job.java:589)
      at org.pentaho.di.job.Job.execute(Job.java:728)
      at org.pentaho.di.job.Job.access$000(Job.java:103)
      at org.pentaho.di.job.Job$1.run(Job.java:703)
      at java.lang.Thread.run(Thread.java:662)

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              dnrickner Dan Rickner
              Votes:
              2 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: