Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19005

JSON Input Field Selector does not work with files with more than 101 rows

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Severity: High
    • Resolution: Unresolved
    • Affects Version/s: 8.3.0 GA, 9.0.0 GA, 9.1.0 GA
    • Fix Version/s: Backlog
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide
      1. Setup Pentaho Data Integration 9.1 and up
      2. Download the attached file: 101_Rows-nyctaxi-trips-2009.json
      3. Create a new transformation
      4. Add JSON Input step to the body of transformation
      5. Browse to the 101Rows-nyctaxi-trips-2009.json file
      6. Click on add
      7. Click on Fields > Select Fields
      8. Notice the empty UI

      Actual Results: No fields can be selected if the file has more than 100 rows like 101 for example
      Expected Results:
      Even if we are only supposed to analyze 100 rows if we have 101 rows on the stream we should display the fields up to 100

      Show
      Setup Pentaho Data Integration 9.1 and up Download the attached file: 101_Rows-nyctaxi-trips-2009.json Create a new transformation Add JSON Input step to the body of transformation Browse to the 101Rows-nyctaxi-trips-2009.json file Click on add Click on Fields > Select Fields Notice the empty UI Actual Results: No fields can be selected if the file has more than 100 rows like 101 for example Expected Results: Even if we are only supposed to analyze 100 rows if we have 101 rows on the stream we should display the fields up to 100

      Description

      Currently if you try to select fields from a json file that contains more than 100 rows; say 101 rows we do not present any fields to select to the user just an empty screen

      There is no indication as to why we do not display anything. While according to PDI-18753 this is done by design to only analyze first 100 rows we should display the metadata of the first 100 rows regardless of row count on the json file

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            clopez Carlos Lopez
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Dates

              Created:
              Updated: