Details

    • Type: Improvement
    • Status: In Progress
    • Severity: Unknown
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      0
    • Notice:
      When an issue is open, the "Fix Version/s" field conveys a target, not necessarily a commitment. When an issue is closed, the "Fix Version/s" field conveys the version that the issue was fixed in.
    • PM Ranking:
      High

      Description

      I've only tested Spark AEL on my local machine (which is properly spec'd) and it takes at least 2 minutes for a transformation to start running on the cluster (pseudo distributed in my case). I did learn that it takes this long because PDI AEL is initialising the environment. I do not think it is acceptable to use this in production. I've previously tested some native Spark jobs and they did not take that long to start running on the same machine.

        Attachments

          Activity

            People

            • Assignee:
              rsaha Rakesh Saha
              Reporter:
              diddy Diethard Steiner
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: