Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19333

Adding "PRELOAD Tab" for "Greenplum Load" step

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Open
    • Severity: Unknown
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Release Version:
      9.2 GA

      Description

      In the current PDI (v9.x), the Greenplum Step does not support PRELOAD options yet.

       

      In the YAML configuration file format of Greenplum Loader (a.k.a. gpload), the "PRELOAD" block contains some operations before loading data.

       

      Especially the "TRUNCATE" and the "REUSE_TABLES" keys are used frequently.

       

      Although the gpload "TRUNCATE" option can be implemented when designing transformations, "REUSE_TABLES" is essential for "LOG_ERRORS" in newer Greenplum (v5.x & v6.x) to replace "ERROR_TABLE" option (Greenplum 4.x only, which is EOLed.)

      1) In Greenplum 4.x, gpload provides the "ERROR_TABLE" option to record format error rows permanently.

      2) In Greenplum 5.x & 6.x, gpload records format error rows permanently by enabling both "LOG_ERRORS" and "REUSE_TABLES".

       

      Can Pentaho team improve "Greenplum Load step" to include the "Preload Tab" to support these further options?

       

      If possible, please also provides the "LOG_ERRORS" switch in the current "GP Configuration Tab"?

       

      Best Regards.

        Attachments

          Activity

            People

            Assignee:
            project admin Triage
            Reporter:
            Hsu CC
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated: