Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-8717

PDI Operations Mart: Wrong date calculation of the duration and execution_timestamp, execution_date_tk, execution_time_tk

    Details

    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      In the 4 transformations to load the data mart (ETL - Operations Mart ...):
      a) The execution_timestamp is taken from the DEPDATE (see FACT_EXECUTION step). It must be taken from the REPLAYDATE instead.
      b) The duration is calculated by the DEPDATE (see duration + tks step). It must be taken from the REPLAYDATE instead.
      c) The same issue for the execution_date_tk, execution_time_tk (see duration + tks step). It must be based on thee REPLAYDATE.

        Activity

        Hide
        mburgess Matt Burgess added a comment -

        issue b has doc impact

        Show
        mburgess Matt Burgess added a comment - issue b has doc impact
        Hide
        jbleuel Jens Bleuel added a comment -

        I'm working with the doc team on this.

        Show
        jbleuel Jens Bleuel added a comment - I'm working with the doc team on this.
        Hide
        mburgess Matt Burgess added a comment -

        Committed Kettle 4.4.0 revision 40414

        Show
        mburgess Matt Burgess added a comment - Committed Kettle 4.4.0 revision 40414
        Hide
        mburgess Matt Burgess added a comment -

        Only the transformation logging gives you access to REPLAYDATE (or DEPDATE for that matter), the rest of the logging tables (and thus the other 3 ETL transformations) use LOGDATE which is the only available date.

        Show
        mburgess Matt Burgess added a comment - Only the transformation logging gives you access to REPLAYDATE (or DEPDATE for that matter), the rest of the logging tables (and thus the other 3 ETL transformations) use LOGDATE which is the only available date.
        Hide
        mburgess Matt Burgess added a comment -

        Dev tested with pdi-operations-mart and pdi-ee-assembly CI builds, assigned to Jens to verify.

        Show
        mburgess Matt Burgess added a comment - Dev tested with pdi-operations-mart and pdi-ee-assembly CI builds, assigned to Jens to verify.
        Hide
        jbleuel Jens Bleuel added a comment -

        Confirmed.

        Show
        jbleuel Jens Bleuel added a comment - Confirmed.

          People

          • Assignee:
            jbleuel Jens Bleuel
            Reporter:
            jbleuel Jens Bleuel
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: