Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-19279

Steps -Get subfolder names - text file input - get File names Do not work from a "root" device on Windows D:\\

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Severity: Unknown
    • Resolution: Unresolved
    • Affects Version/s: 9.1.0 GA
    • Fix Version/s: None
    • Environment:
      java version "11.0.12" 2021-07-20 LTS
      Java(TM) SE Runtime Environment 18.9 (build 11.0.12+8-LTS-237)
      Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.12+8-LTS-237, mixed mode)
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Operating System/s:
      Windows 10
    • Steps to Reproduce:
      Hide

      try to read files from a hard disk from the root folder i.e C:
      , D:
      etc... and try to get subfolders/files using any of those 3 steps.

       

      preview rows,  nothing

      run transformation , nothing

       

      Show
      try to read files from a hard disk from the root folder i.e C: , D: etc... and try to get subfolders/files using any of those 3 steps.   preview rows,  nothing run transformation , nothing  

      Description

      Basically there seems to be 2 problems one is hidden system files crash the steps

      which the steps should ignore. the same if they do not have access permission to files or folders.

      FileNotFolderException: Could not list the contents of "file:///F:/System Volume Information" because it is not a folder.

      and ......

      FileSystemException: Could not find files in "file:///F:/"

      which i do not know... getting file info from an OS is pretty basic stuff or at least it used to be having just spent the last 8+ hours trying to get java.filewalker to run in a spoon  User defined java class with out crashing on system files has changed my opinion of that .... seems I have been taking  dir /b /s f:*.iso for granted.... 

      Again these seem to work fine if you supply a folder i.e. D:\Video but i did not do any testing with  subfolders and files because of the disgust factor on something so simple taking hours and hours to do .

      My basic structure on drives i am interested in is

      F:\Media

      F:\Media\Videos

      F:\Media\Videos\Movies

      etc..

      My goal of the transformation was to 1. get a list of drives on the system 2. get a list of files types i was interested in 3. work the magic of sorting them out and data-basing them bearing in mind i wanted to be able to do this with my backup servers also to coordinate copies around the network.

       

       

       

       

       

       

       

       

       

       

        Attachments

        1. PDI-FileRoot.JPG
          PDI-FileRoot.JPG
          84 kB
        2. spoon.log
          2 kB
        3. StepsFail.ktr
          18 kB

          Issue Links

            Activity

              People

              Assignee:
              mxdog David Marlow
              Reporter:
              mxdog David Marlow
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated: