Details

    • Type: Improvement
    • Status: In Progress
    • Severity: Unknown
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • PM Ranking:
      High

      Description

      I've only tested Spark AEL on my local machine (which is properly spec'd) and it takes at least 2 minutes for a transformation to start running on the cluster (pseudo distributed in my case). I did learn that it takes this long because PDI AEL is initialising the environment. I do not think it is acceptable to use this in production. I've previously tested some native Spark jobs and they did not take that long to start running on the same machine.

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            rsaha Rakesh Saha
            Reporter:
            diddy Diethard Steiner
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated: