Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-6389

As an ETL developer, I need a Set-Reset and Toggle Flip-flop to store and add state information to the data stream

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Open
    • Severity: Medium
    • Resolution: Unresolved
    • Affects Version/s: 4.2.0 GA (4.0.0 GA Suite Release)
    • Fix Version/s: Backlog
    • Component/s: Step
    • Labels:
      None
    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      Function: a) Set an output value to a constant or a source value field depending on a condition

      Function: b) Reset an output value to a constant or a source value field depending on a condition

      Function: c) Toggle an output value between two constants or source value fields depending on a condition

      Use Case: The use cases are mainly coming from processing data streams that have flattened hierarchical data structures (e.g. processing a XML data stream, see attachments to PDI-5313).

      An example for invoicing data with header and detail rows: when a header line is coming in, set the invoice number field and keep this field for all invoice details until the next header line.

      Design considerations: The above mentioned output value needs to store it's state between rows until it is Set/Reset or Toggled again.

      Some general basics about Flip-Flops can be found over here: http://en.wikipedia.org/wiki/Flip-flop_%28electronics%29
      The mentioned Delay Flip-flop is already implemented by the Analytic Query step.

      Simplified examples for a Set-Reset Flip-flop and Toggle Flip-flop will be added later on.

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            jbleuel Jens Bleuel
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: