Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-18885

Performance degradation due to opening of XML files.

    XMLWordPrintable

    Details

    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Sprint Team:
      Tatooine (Maint)

      Description

      This commit for PDI-18528 causes PDI to retry loading XML files after a failure. Each retry is given a 1 second pause. Since PDI loads XML files internally for all sorts of stuff, this can cause unexpected delays.

      This can cause unneeded delay in the case where the file does not exist.

      The "Use Simple Concat mapping" transformation in samples can be used to reproduce. Running it results in a prolonged pause during the "dispatching" phase. If you then create this file:
      data-integration/plugins/steps/ScriptValues_mod/plugin.xml

      and add any valid XML to plugin.xml, the transformation will run without a delay.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              mleite Margarida Leite
              Reporter:
              mcampbell Matt Campbell
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: