Whether a job will take more time if some more jobs are running parallel. If it is yes how can i handle this situation to reduce the time taken is there any settings or options has to be changed?
I'm no DBA, but I would say "yes," a job will take more time if other jobs are running in parallel, in the same environment. Because each running job is consuming some of your Redshift cluster's finite resources.
If they are a bunch of simultaneous jobs but each one consumes very little resources, it might be that your Redshift cluster has the resources to do them all simultaneously without any impact on performance. But if each job consumes enough resources, then they must compete for those resources; and some jobs will be slowed down.
Also, as I understand it, there is a separate limit on how many Matillion jobs you can run simultaneously, because Matillion can only have a certain number of open connections to your Redshift cluster at a given time. And the number depends on the size of your Matillion instance. I think for a "medium" instance it is just one (or maybe two) ... for a "large" instance it is four ... for an "xlarge" instance it is eight.
@KevinH thank you