Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-17412

Jobs do not execute in sequence when run remotely.

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: High
    • Resolution: Not a Bug
    • Affects Version/s: 8.0.0.4 GA, 8.0.0.5 GA, 8.1.0 GA
    • Fix Version/s: Backlog
    • Component/s: Job
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Steps to Reproduce:
      Hide

      Steps to reproduce :

      • Start Spoon client and Pentaho Version 8.0.0.0.
      • Open the attached jobs and transformations. Save them to the repository.
      • Change File paths of each job and transformation.
      • Execute it local and remote. It works as expected.
      • Start Spoon and Pentaho Server version either 8.0.0.5 or 8.1.
      • Open the attached jobs and transformations. Save them to the repository.
      • Chnage file Paths to point to correct locations were jobs/transformations are stored.
      • Execute J_Parent job locally. It works as expected.
      • Configure Run Configuration and execute them on a remote server.
      • You will notice that the transformation finishes first even though the Job is still running.
      Show
      Steps to reproduce : Start Spoon client and Pentaho Version 8.0.0.0. Open the attached jobs and transformations. Save them to the repository. Change File paths of each job and transformation. Execute it local and remote. It works as expected. Start Spoon and Pentaho Server version either 8.0.0.5 or 8.1. Open the attached jobs and transformations. Save them to the repository. Chnage file Paths to point to correct locations were jobs/transformations are stored. Execute J_Parent job locally. It works as expected. Configure Run Configuration and execute them on a remote server. You will notice that the transformation finishes first even though the Job is still running.

      Description

      We have a job which tries to execute the jobs and transformations in a sequential manner. The workflow designed for this is as below,

      Start --> Job --> Transformation --> Success.

      According to our documentation, the jobs gets executed in a sequential fashion. But, on Pentaho 8.1 version, when the job takes more time to finish, the transformation starts and finishes its execution while the job is still running. It works fine when we do a local execution. This is a regression introduced in 8.0.0.5 and 8.1 version, but it's working perfectly fine in 8.0.0.0 version.

      I have attached screencasts, sample jobs and transformations which will help in reproducing the issue.

        Attachments

        1. J_flight.kjb
          13 kB
        2. J_parent.kjb
          13 kB
        3. Recording #111.mp4
          3.64 MB
        4. Slave_defined.PNG
          Slave_defined.PNG
          32 kB
        5. Slave_Server_defined_Issue_Reproducible.png
          Slave_Server_defined_Issue_Reproducible.png
          41 kB
        6. t_parameter.ktr
          13 kB
        7. t_tailing.ktr
          14 kB
        8. test_wait_for_sub_trans_jobs.export
          72 kB
        9. 녹화_2018_06_29_14_49_11_619.7z
          9.64 MB

          Activity

            People

            Assignee:
            vasco.marques Vasco Marques
            Reporter:
            nprakash Nikhil Prakash
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: