Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19200

JSON Input: Error occurs when trying to read the largest DOUBLE value 1.79769E+308

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Unknown
    • Resolution: Won't Fix
    • Affects Version/s: 9.1.0 GA
    • Fix Version/s: Backlog
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide

      Steps to replicate the error:

      Use the attached transformation 102041SampleTransformation.ktr and the JSON file testBigNum1.json to replicate the issue. Change the paths as per your environment.

      Show
      Steps to replicate the error: Use the attached transformation 102041SampleTransformation.ktr and the JSON file testBigNum1.json to replicate the issue. Change the paths as per your environment.

      Description

      When using the largest DOUBLE value in a JSON file and trying to read the field using the JSON Input step we get the error as below:

      2021/06/03 12:43:57 - JSON input.0 - ERROR (version 9.1.0.0-324, build 9.1.0.0-324 from 2020-09-07 05.09.05 by buildguy) : Error running step! 
      2021/06/03 12:43:57 - JSON input.0 - Unexpected conversion error while converting value [BigNum1 String(10)] to a BigNumber
      2021/06/03 12:43:57 - JSON input.0 - 
      2021/06/03 12:43:57 - JSON input.0 - BigNum1 String(10) : couldn't convert string value 'Infinity' to a big number.
      2021/06/03 12:43:57 - JSON input.0 -  at java.lang.Thread.run (Thread.java:748)
      2021/06/03 12:43:57 - JSON input.0 -  at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
      

      This issue happens with Smallest BIGINT, Largest BIGINT, Smallest DOUBLE, Largest DOUBLE
      https://docs.oracle.com/javadb/10.8.3.0/ref/rrefnumericlimits.html

        Attachments

        1. 102041SampleTransformation.ktr
          15 kB
        2. Capture-23.PNG
          Capture-23.PNG
          141 kB
        3. Capture24.PNG
          Capture24.PNG
          89 kB
        4. spoon.log
          88 kB
        5. test1.png
          test1.png
          9 kB
        6. testBigNum1.json
          0.0 kB

          Issue Links

            Activity

              People

              Assignee:
              project admin Triage
              Reporter:
              gdev Gurudev
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: