Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-14599

Verify Transformation performance as step count increases

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Low
    • Resolution: Fixed
    • Affects Version/s: 4.4.0 GA (4.8.0 GA Suite Release) , 5.2.0 GA, 6.0.0 GA
    • Fix Version/s: 6.1.0 GA
    • Component/s: Transformation
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide
      1. Download the attached transformations
      2. Use the "Verify" button in Spoon to verify the transformation
      3. Time how long the Verify process runs

      Expected Results: The execution time is not significantly impacted by the number of "dummy" steps used in the transformation
      Actual Results: The execution time grows significantly as more "dummy" steps were used

      Show
      Download the attached transformations Use the "Verify" button in Spoon to verify the transformation Time how long the Verify process runs Expected Results: The execution time is not significantly impacted by the number of "dummy" steps used in the transformation Actual Results: The execution time grows significantly as more "dummy" steps were used

      Description

      When using the Verify Transformation feature in Spoon, by adding additional "Dummy" steps, the time to complete the verification process grows significantly.

      As no field manipulation is done in these steps, it would be expected to be only a minimal, if any, impact on the verification process.

        PractiTest Integration




          Attachments

          1. pdi-14559_job-screenshot.png
            pdi-14559_job-screenshot.png
            29 kB
          2. slow-test-2dummy.ktr
            1.14 MB
          3. slow-test-392dummy.ktr
            1.42 MB
          4. slow-test-49dummy.ktr
            1.18 MB
          5. slow-test-98dummy.ktr
            1.21 MB

            Issue Links

            is related to

            Improvement - An improvement or enhancement to an existing feature or task. PDI-15991 Spoon very slow to start running transforms with lots of steps

            • Medium - An issue that impacts the ability to use Pentaho in a production environment but business operation is able to continue, although it may, to a certain extent, be hindered. A viable documented workaround exists for the issue and can be used in a production environment.
            • Closed
            relates to

            Bug - A problem which impairs or prevents the functions of the product. PDI-14611 PMR Transformation Verify process slower in PDI 5.x

            • High - An issue that impacts and reduces ability to use Pentaho in a production environment. Business operations are able to continue, however they may be highly impacted and a viable documented workaround is not available.
            • Closed

              Activity

                People

                Assignee:
                Unassigned Unassigned
                Reporter:
                mtucker Matt Tucker
                Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved: