Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-18118

Replicating files when should replace them in Google Drive using VFS

    XMLWordPrintable

    Details

    • Story Points:
      0
    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Operating System/s:
      Ubuntu 18.x
    • Steps to Reproduce:
      Hide
      1. Configure Google Drive credentials as described at here;
      2. Create a file with some content on /tmp/file-to-send.txt;
      3. Create a Job and add: a Start, a Copy File and a Success steps;
      4. At Copy File step, configure in Files tab:
        1. Source Environment as "Local"
        2. File/Folder Source as "file:///tmp/file-to-send.txt";
        3. Destination Environment as "Local";
        4. File/Folder Destination as "googledrive://";
      5. At Copy File step, configure in Settings tab:
        1. Check "replace existing files";
      6. Run the Job;
      7. Access your Google Drive account configured at first step;
      8. You will see one file named as "file-to-send.txt";
      9. Run again the Job;
      10. Access your Google Drive account again;
      11. You will see two files named as "file-to-send.txt";
      Show
      Configure Google Drive credentials as described at here ; Create a file with some content on /tmp/file-to-send.txt; Create a Job and add: a Start, a Copy File and a Success steps; At Copy File step, configure in Files tab: Source Environment as "Local" File/Folder Source as "file:///tmp/file-to-send.txt"; Destination Environment as "Local"; File/Folder Destination as "googledrive://"; At Copy File step, configure in Settings tab: Check "replace existing files"; Run the Job; Access your Google Drive account configured at first step; You will see one file named as "file-to-send.txt"; Run again the Job; Access your Google Drive account again; You will see two files named as "file-to-send.txt";

      Description

      The problem described at "Steps to Reproduce", is caused because the VFS PDI plugin aways call the create method from Google Drive API, generating a new id for each uploading. Instead, we should search the file by name and use the ID from found file to call the update method.

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            wagner.el.lima Wagner Lima
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated: