Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-4816

NullPointerException in Dimension Lookup. Cache related.

    XMLWordPrintable

    Details

    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Operating System/s:
      Fedora Core 4.x

      Description

      This occurs in both 4.0.1 and 4.0.2 (Oct 21 build).

      The error occurs consistently in the middle of a large fact table load after approximately 8700000 rows. It is always the same lookup step.

      When I first encountered the error, the dimension lookup step had caching enabled, with a limit of 5000 rows. I changed it to pre-load the cache, and got the same problem. I have now disabled the cache, and am presently re-running.

      The error appears to be happening in DimensionCache.java:149

      Relevant lines from the log table are:

      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) :
      Because of an error this step can't continue:
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) :
      java.lang.RuntimeException: java.lang.NullPointerException
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) :
      java.lang.NullPointerException
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) :
      org.pentaho.di.core.exception.KettleException:
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) :
      java.lang.RuntimeException: java.lang.NullPointerException
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : java.lang.NullPointerException
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : org.pentaho.di.trans.steps.dimensionlookup.DimensionCache.lookupRow(DimensionCache.java:149)
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : org.pentaho.di.trans.steps.dimensionlookup.DimensionLookup.lookupValues(DimensionLookup.java:378)
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : org.pentaho.di.trans.steps.dimensionlookup.DimensionLookup.processRow(DimensionLookup.java:221)
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : org.pentaho.di.trans.step.RunThread.run(RunThread.java:40)
      2010/10/21 22:11:02 - Lookup client key.0 - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : java.lang.Thread.run(Thread.java:636)
      2010/10/21 22:11:02 - load sid fact table - ERROR (version 4.0.2-SNAPSHOT, build 14216 from 2010-10-21 06.00.38 by anthony) : Errors detected!

        Attachments

          Activity

            People

            • Assignee:
              cboyden Curtis Boyden (Inactive)
              Reporter:
              danda Dan Libby
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: