Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-6186

When changing the datatype to an incorrect value in a CSV input step no error is given and incorrect data is returned

    XMLWordPrintable

    Details

    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Operating System/s:
      Windows 7

      Description

      1) Create a .csv with two columns

      name - string type ( "aaa", "bbb", "ccc")
      weight - string (with mixed characters "123.45", "123-45", "123/45")

      2) Create a new transform
      3) Add a CSV input
      4) Load the csv
      5) Leave all defaults and preview the data

      – This will display correctly

      6) Change the datatype of "weight" to Number and preview the data

      – This display's the data but the values are incorrect for weight

      Save the .csv as a .xls and use the previous steps with an Excel Input, this will display a data type conversion error

        Attachments

        1. Changed_csv_incorrect.JPG
          Changed_csv_incorrect.JPG
          22 kB
        2. Changed_csv_setting.JPG
          Changed_csv_setting.JPG
          62 kB
        3. Default_csv_correct_data.JPG
          Default_csv_correct_data.JPG
          24 kB
        4. Default_csv_settings.JPG
          Default_csv_settings.JPG
          62 kB
        5. preview data lazy conversion checked.png
          preview data lazy conversion checked.png
          27 kB
        6. preview data lazy conversion unchecked.png
          preview data lazy conversion unchecked.png
          28 kB
        7. Test_CSV.ktr
          8 kB
        8. Test_CSV.txt
          0.1 kB
        9. weight_field.csv
          0.0 kB
        10. weight_field.xls
          22 kB

          Issue Links

            Activity

              People

              Assignee:
              mgutierrez Manuel Gutierrez
              Reporter:
              wfaulkner William Faulkner
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: