Uploaded image for project: 'Pentaho Data Integration - Kettle'
  1. Pentaho Data Integration - Kettle
  2. PDI-17065

Kafka Consumer step doesn't find sub transformation in some cases

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Severity: Urgent
    • Resolution: Cannot Reproduce
    • Affects Version/s: 8.0.0 GA, 8.2.0 GA, 8.3.0 GA
    • Fix Version/s: Backlog
    • Component/s: Step
    • Labels:
      None
    • Story Points:
      0
    • PDI Sub-component:
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • Sprint Team:
      Tatooine (Maint)
    • Steps to Reproduce:
      Hide
      1. Download and open attached transformations.
      2. Create Slave Server that points to your Pentaho Server. It doesn't matter Spoon and Pentaho Server are on the same server or not.
      3. Create Configuration that points to slave server, do not check "Send resources to this server" box.
      4. Run Simple_ProducerSetup transformation on created Configuration -> successfully.
      5. Run Simple_ConsumerSetup transformation on created Configuration -> it fails with 
        Could not read from "file:///home/pentaho/pentaho_8.1/pentaho-server/tomcat/bin/${Internal.Entry.Current.Directory}/Simple_ConsumerSubTrans.ktr" because it is not a file
      Show
      Download and open attached transformations. Create Slave Server that points to your Pentaho Server. It doesn't matter Spoon and Pentaho Server are on the same server or not. Create Configuration that points to slave server, do not check "Send resources to this server" box. Run Simple_ProducerSetup transformation on created Configuration -> successfully. Run Simple_ConsumerSetup transformation on created Configuration -> it fails with Could not read from "file:///home/pentaho/pentaho_8.1/pentaho-server/tomcat/bin/${Internal.Entry.Current.Directory}/Simple_ConsumerSubTrans.ktr" because it is not a file

      Description

      There are two problems here:
      1. Kafka Consumer step doesn't find sub transformation in the following condition:

      • Run configuration with DISABLED "Send resources to this server"
      • Pentaho server and Spoon are on THE SAME server.
        We have this problem in 8.0 GA, 8.0.0.3 patch and master (build 255) 
        Could not read from "file:///home/pentaho/pentaho_8.1/pentaho-server/tomcat/bin/${Internal.Entry.Current.Directory}/Simple_ConsumerSubTrans.ktr" because it is not a file.

        Full log is here pdi_log_case_01.log

      2. Kafka Consumer step doesn't find sub transformation in the following condition:

      • Run configuration with ENABLED "Send resources to this server"
      • Pentaho server and Spoon are on DIFFERENT servers.
        We have this problem in 8.0 GA, 8.0.0.3 patch. No problem in master. 
        Unable to load transformation [null] : can't find directory

        Full log is here pdi_log_case_02.log

        PractiTest Integration




          Attachments

          1. pdi_log_case_01_8.0.0.3.txt
            14 kB
          2. pdi_log_case_01.log
            14 kB
          3. pdi_log_case_02.log
            2 kB
          4. Simple_ConsumerSetup.ktr
            15 kB
          5. Simple_ConsumerSubTrans.ktr
            13 kB
          6. Simple_ProducerSetup.ktr
            17 kB

            Issue Links

            is related to

            Bug - A problem which impairs or prevents the functions of the product. PDI-16066 Transformation Executor Step does not Inherit Parameters

            • High - An issue that impacts and reduces ability to use Pentaho in a production environment. Business operations are able to continue, however they may be highly impacted and a viable documented workaround is not available.
            • Closed

            Bug - A problem which impairs or prevents the functions of the product. PDI-17109 Kafka Consumer step doesn't find sub transformation 8.0

            • High - An issue that impacts and reduces ability to use Pentaho in a production environment. Business operations are able to continue, however they may be highly impacted and a viable documented workaround is not available.
            • Closed

              Activity

                People

                Assignee:
                scosta Sandra Costa (Inactive)
                Reporter:
                pavel_hrakovich Pavel Hrakovich (Inactive)
                Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved: