Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-1097

Problem using filename variable in Get File Names step when running through kitchen.

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Medium
    • Resolution: Fixed
    • Affects Version/s: 3.1.0 GA
    • Fix Version/s: 3.1.0 GA
    • Component/s: Kitchen
    • Labels:
      None
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.

      Description

      April 26, shassan2 made revision 7481 that implemented previous step functionality for Get File Names step.
      I believe this had some sort of conflict with my checkin made on April 24, revision 7447 where I added the ability to use variables in the filename field.

      My change was working fine in both Spoon runs and Kitchen runs.
      I just updated tonight and started getting the following stack trace:

      ERROR 28-04 22:33:50,370 (LogWriter.java:println:436) -FileInputList - org.apache.commons.vfs.FileSystemException: Could not find files in "file:///mnt/stats/stats/logs/im-log01/aus2.mozilla.org".
      at org.apache.commons.vfs.provider.AbstractFileObject.findFiles(AbstractFileObject.java:1478)
      at org.apache.commons.vfs.provider.AbstractFileObject.findFiles(AbstractFileObject.java:1030)
      at org.pentaho.di.core.fileinput.FileInputList.createFileList(FileInputList.java:113)
      at org.pentaho.di.core.fileinput.FileInputList.createFileList(FileInputList.java:81)
      at org.pentaho.di.trans.steps.getfilenames.GetFileNamesMeta.getTextFileList(GetFileNamesMeta.java:523)
      at org.pentaho.di.trans.steps.getfilenames.GetFileNames.init(GetFileNames.java:278)
      at org.pentaho.di.trans.step.StepInitThread.run(StepInitThread.java:48)
      at java.lang.Thread.run(Thread.java:613)
      Caused by: java.util.regex.PatternSyntaxException: Illegal repetition near index 0
      ${file_wildcard}
      ^
      at java.util.regex.Pattern.error(Pattern.java:1650)
      at java.util.regex.Pattern.closure(Pattern.java:2706)
      at java.util.regex.Pattern.sequence(Pattern.java:1798)
      at java.util.regex.Pattern.expr(Pattern.java:1687)
      at java.util.regex.Pattern.compile(Pattern.java:1397)
      at java.util.regex.Pattern.<init>(Pattern.java:1124)
      at java.util.regex.Pattern.compile(Pattern.java:817)
      at java.util.regex.Pattern.matches(Pattern.java:919)
      at org.pentaho.di.core.fileinput.FileInputList$1.includeFile(FileInputList.java:128)
      at org.apache.commons.vfs.provider.AbstractFileObject.traverse(AbstractFileObject.java:1515)
      at org.apache.commons.vfs.provider.AbstractFileObject.traverse(AbstractFileObject.java:1507)
      at org.apache.commons.vfs.provider.AbstractFileObject.findFiles(AbstractFileObject.java:1473)
      ... 7 more

      The odd thing is that it runs properly under an interactive Spoon session. I'm not sure exactly why that is, and I'm a little pressed for time right now so I haven't been able to step through it in the debugger.

      I'm hoping either shassan2 or someone else might have a moment to look at this conflict because I'm sure that it translates to a bug that either he or I put into the step.

        Attachments

        1. createVars.ktr
          3 kB
        2. getFilenames.ktr
          7 kB
        3. RungetFilenales.kjb
          3 kB

          Activity

            People

            Assignee:
            gdavid Golda Thomas
            Reporter:
            deinspanjer Daniel Einspanjer (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: