Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-8843

Instaview - error when row sampling limit is reached

    Details

    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      Instaview throws an error when the maximum number of rows is reached. My understanding from Doug M is that the cube should be built with a truncated set of input rows. This occurs with both the 100K and 1M sample sizes.

      1. error.png
        129 kB
      2. noerror.jpg
        85 kB
      3. version.png
        150 kB

        Activity

        Hide
        jdixon James Dixon added a comment -

        The way that the MonetDB Agile Mart step stops the transformation from running when the row limit has been reached is to raise a "Row limit exceeded" error so that PDI stops the transformation.

        If I remember correctly Instaview used to detect that error so that we stopped nicely. I agree the current error looks ugly.

        Show
        jdixon James Dixon added a comment - The way that the MonetDB Agile Mart step stops the transformation from running when the row limit has been reached is to raise a "Row limit exceeded" error so that PDI stops the transformation. If I remember correctly Instaview used to detect that error so that we stopped nicely. I agree the current error looks ugly.
        Hide
        jdixon James Dixon added a comment -

        I tried a build from two weeks ago and it worked fine with a limit of 1000 rows.

        Show
        jdixon James Dixon added a comment - I tried a build from two weeks ago and it worked fine with a limit of 1000 rows.
        Hide
        jdixon James Dixon added a comment -

        The fix for this is to look for the "Row limit exceeded" error when a transformation errors out when it is run in PdiRunnerBase

        Show
        jdixon James Dixon added a comment - The fix for this is to look for the "Row limit exceeded" error when a transformation errors out when it is run in PdiRunnerBase
        Hide
        gdavid Golda Thomas added a comment -

        Tested this issue using the pdi Build on 10/31/2012.

        When I changed the sample size to 1000 on Salesdata.csv which has 2843 did not get any error.

        This issue is resolved.

        Show
        gdavid Golda Thomas added a comment - Tested this issue using the pdi Build on 10/31/2012. When I changed the sample size to 1000 on Salesdata.csv which has 2843 did not get any error. This issue is resolved.

          People

          • Assignee:
            gdavid Golda Thomas
            Reporter:
            dhenry Dave Henry (Inactive)
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: