Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-17936

Database Lookup step caching issue when "Load all rows from table" is selected

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Urgent
    • Resolution: Cannot Reproduce
    • Affects Version/s: 8.2.0.2 GA, 8.2.0 GA
    • Fix Version/s: Backlog
    • Component/s: None
    • Labels:
    • Environment:
      Data Integration 8.2.0
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide

      1 Run the SQL attached to ESR-6676 in a MySQL DB to create a table and populate it with one row.
      2 Open the transformation attached to ESR-6676 in Spoon and configure the Database Lookup step for your environment
      3 With the "Enable cache?" box checked, run the transformation.
      4 The database lookup will fail and no matching rows are returned.
      5 Uncheck the "Enable cache?" box and save the transformation.
      6 Execute the transformation again
      7 This time, the matching row is found and the values are returned.

      Show
      1 Run the SQL attached to ESR-6676 in a MySQL DB to create a table and populate it with one row. 2 Open the transformation attached to ESR-6676 in Spoon and configure the Database Lookup step for your environment 3 With the "Enable cache?" box checked, run the transformation. 4 The database lookup will fail and no matching rows are returned. 5 Uncheck the "Enable cache?" box and save the transformation. 6 Execute the transformation again 7 This time, the matching row is found and the values are returned.

      Description

      Pentaho Product: PDI
      Version: 8.2.0.0
      Operating System: Windows 10
      Memory Available/Used: 32Gb/4Gb
      Clustered/No: Not clustered
      Virtualized?: Not virtualized
      Database for repository: N/A
      Database for data: MySQL 5.7
      Browser type and version (If Applicable): N/A
      Did you attach logs? Yes
      Did you attach sample demonstrating the problem? Yes

      The DB Lookup step produces different (incorrect) results in 8.2 when compared to 6.1.

      The lookup is failing in 8.2 when "enable cache?" is checked; the step returns values as the default ("0").

      If "enable cache?" is disabled, the lookup works and the rows are returned with the correct values.

      If "Load all rows from table" is unchecked, then "Enable cache?" is selected and "1000" is entered as the number of rows to load, then it also works.

      Please see ESR-6676 for supporting documentation and test case.

        Attachments

          Activity

            People

            Assignee:
            sergio.ribeiro SĂ©rgio Ribeiro
            Reporter:
            nmidson Nick Midson
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: