Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-8999

Concurrent Modification Exception

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Unknown
    • Resolution: Duplicate
    • Affects Version/s: 4.3.0 GA (4.5.0 GA Suite Release)
    • Fix Version/s: None
    • Component/s: Job
    • Labels:
      None
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Operating System/s:
      SuSE Enterprise 10

      Description

      I got a nasty ConcurrentModificationException while running a job for about 12 hours. The job is performed repeatedly (using the "start" looping functionality). Here's the stack trace:

      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : java.util.ConcurrentModificationException
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:953)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.next(LinkedList.java:886)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:86)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:152)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:158)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:171)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:167)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:556)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:393)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.run(Job.java:313)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : org.pentaho.di.core.exception.KettleException:
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : Unexpected error occurred while launching entry [ Run PvaProcedureCaller.ktr.0]
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.run (Job.java:313)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:393)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:556)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:167)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:171)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:158)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo (Log4jBufferAppender.java:152)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo (Log4jBufferAppender.java:86)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.next (LinkedList.java:886)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.checkForComodification (LinkedList.java:953)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) :
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:672)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:393)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.run(Job.java:313)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : Caused by: java.util.ConcurrentModificationException
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:953)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.next(LinkedList.java:886)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:86)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo(Log4jBufferAppender.java:152)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:158)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:171)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer(Log4jBufferAppender.java:167)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:556)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute(Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : ... 3 more
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : A serious error occurred during job execution: org.pentaho.di.core.exception.KettleException:
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : Unexpected error occurred while launching entry [Get HWM.0]
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) :
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : Unexpected error occurred while launching entry [ Run PvaProcedureCaller.ktr.0]
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.run (Job.java:313)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:393)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:667)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.job.Job.execute (Job.java:556)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:167)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:171)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getBuffer (Log4jBufferAppender.java:158)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo (Log4jBufferAppender.java:152)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at org.pentaho.di.core.logging.Log4jBufferAppender.getLogBufferFromTo (Log4jBufferAppender.java:86)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.next (LinkedList.java:886)
      2012/12/04 06:57:32 - ERROR (version 4.3.0, build 1 from 2012-10-10 10.32.29 by U0165725) : at java.util.LinkedList$ListItr.checkForComodification (LinkedList.java:953)

      I am not sure how to reproduce it (it's a locking issue!) so I'm not posting any job example, but this is the second time it happened with the same transformation so I'm sure it's an issue. I can send over my job but I don't think it would be of any help.
      Ideas?
      Thanks

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              giovannibotta Giovanni Botta
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: