Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-13456

Metadata Injector and Get File Names throws ConcurrentModificationException

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: High
    • Resolution: Fixed
    • Affects Version/s: 5.2.0.1
    • Fix Version/s: 5.4.0 GA
    • Component/s: Step
    • Labels:
      None
    • Environment:
      Operating System is CentOS 7. PDI version is 5.2.0.0
    • Story Points:
      0
    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Operating System/s:
      CentOS 6.x

      Description

      Using metadata injector on a transformation with both "Get File Names" and "CSV File Input" steps. Transformation is generating a list of multiple files and then reading them with the CSV File Input. The metadata injector transformation throws the error below. If I instead generate a transformation from the metadata injector, it runs correctly. If I remove the "Get File Names" the metadata injector also runs without error although it doesn't read all the files desired.

      2015/02/08 03:38:38 - ETL Metadata Injection.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : Unexpected error
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - ERROR (version 5.2.0.0, build 1 from 2014-09-30_19-48-28 by buildguy) : java.util.ConcurrentModificationException
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at java.util.Hashtable$Enumerator.next(Hashtable.java:1167)
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at java.util.concurrent.ConcurrentHashMap.putAll(ConcurrentHashMap.java:1161)
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at org.pentaho.di.trans.Trans.getResult(Trans.java:2592)
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at org.pentaho.di.trans.steps.metainject.MetaInject.copyResult(MetaInject.java:326)
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at org.pentaho.di.trans.steps.metainject.MetaInject.processRow(MetaInject.java:306)
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
      2015/02/08 03:38:38 - ETL Metadata Injection.0 - at java.lang.Thread.run(Thread.java:745)

        Attachments

        1. gen_files.ktr
          25 kB
        2. metadata_injector.ktr
          19 kB
        3. readfiles.ktr
          20 kB

          Activity

            People

            • Assignee:
              pmikhnevich Pavel Mikhnevich (Inactive)
              Reporter:
              tsykes Todd Sykes
            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: