U  W["@sdZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl mZdd lmZmZdd lmZdd lmZdd lmZmZGd ddeZdS)z This module contains the trial distributed runner, the management class responsible for coordinating all of trial's behavior at the highest level. @since: 12.3 N)FilePath) theSystemPath) DeferredList cooperate)_unusedTestDirectory) _iterateTests) LocalWorkerLocalWorkerAMP) DistReporter)UncleanWarningsReporterWrapper)_WORKER_AMP_STDIN_WORKER_AMP_STDOUTc@s^eZdZdZeZddZdd d Zd d Zd dZ ddZ ddZ de dfddZ ddZdS)DistTrialRunneraY A specialized runner for distributed trial. The runner launches a number of local worker processes which will run tests. @ivar _workerNumber: the number of workers to be spawned. @type _workerNumber: C{int} @ivar _stream: stream which the reporter will use. @ivar _reporterFactory: the reporter class to be used. cCs.|j|j|j|jd}|jr$t|}||S)zL Make reporter factory, and wrap it with a L{DistReporter}. )Zrealtime)_reporterFactory_stream _tbformat _rterrors_uncleanWarningsr _distReporterFactory)selfZreporterr?/usr/lib/python3/dist-packages/twisted/trial/_dist/disttrial.py _makeResult+s  zDistTrialRunner._makeResultNdefaultFtest.log _trial_tempc Cs`||_||_||_|dkr tj}||_||_||_||_d|_ | |_ ||_ d|_ d|_ d|_dS)NF) _workerNumber_workerArgumentsrsysstdoutrrrrZ_result_workingDirectory_logFileZ_logFileObserverZ_logFileObjectZ _logWarnings) rZreporterFactory workerNumberZworkerArgumentsstreamZtracebackFormatZrealTimeErrorsZuncleanWarningsZlogfileworkingDirectoryrrr__init__6szDistTrialRunner.__init__cCs |dS)z Write test run final outcome to result. @param result: A C{TestResult} which will print errors and the summary. N)Zdone)rresultrrr writeResultsNszDistTrialRunner.writeResultscsfddt|DS)aY Create local worker protocol instances and return them. @param protocols: An iterable of L{LocalWorkerAMP} instances. @param workingDirectory: The base path in which we should run the workers. @type workingDirectory: C{str} @return: A list of C{quantity} C{LocalWorker} instances. c s,g|]$\}}t|tjt|jqSr)r ospathjoinstrr").0xZprotocolrr%rr cs z6DistTrialRunner.createLocalWorkers..) enumerate)r protocolsr%rr/rcreateLocalWorkersWs z"DistTrialRunner.createLocalWorkersc Csvtdjj}ddddddtdtdi}tj}tj t j|d<|D],}t j |g}| |||t j |||dqDd S) a Spawn processes from a list of process protocols. @param spawner: A C{IReactorProcess.spawnProcess} implementation. @param protocols: An iterable of C{ProcessProtocol} instances. @param arguments: Extra arguments passed to the processes. ztwisted.trial._dist.workertrialrwrZTRIAL_PYTHONPATH)argschildFDsenvN) rZfilePathr*r rr)environcopypathsepr+r executableextend) rZspawnerr2Z argumentsZworkertrialPathr9r;workerr8rrrlaunchWorkerProcessesis     z%DistTrialRunner.launchWorkerProcessescs6fddfdd|fdd|DS)a Drive a L{LocalWorkerAMP} instance, iterating the tests and calling C{run} for every one of them. @param worker: The L{LocalWorkerAMP} to drive. @param result: The global L{DistReporter} instance. @param testCases: The global list of tests to iterate. @param cooperate: The cooperate function to use, to be customized in tests. @type cooperate: C{function} @return: A C{Deferred} firing when all the tests are finished. csj|||SN)originalZ addFailure)errorcase)r'rr resultErrbacksz3DistTrialRunner._driveWorker..resultErrbackcs|}|||SrB)runZ addErrback)rEd)r'rFr@rrtasks  z*DistTrialRunner._driveWorker..taskc3s|]}|VqdSrBr)r-rE)rIrr sz/DistTrialRunner._driveWorker..)ZwhenDone)rr@r' testCasesrr)r'rFrIr@r _driveWorkers zDistTrialRunner._driveWorkerc s@dkrddlm }jd|f|sT jSt t j \} t |j }ddt|D|j}dd|Dj|j fdd g  fd d  fd d }  fdd} fdd} | | | dd| S)a{ Spawn local worker processes and load tests. After that, run them. @param suite: A tests suite to be run. @param reactor: The reactor to use, to be customized in tests. @type reactor: A provider of L{twisted.internet.interfaces.IReactorProcess} @param cooperate: The cooperate function to use, to be customized in tests. @type cooperate: C{function} @param untilFailure: If C{True}, continue to run the tests until they fail. @type untilFailure: C{bool}. @return: The test result. @rtype: L{DistReporter} Nr)reactorzRunning %d tests. cSsg|] }tqSr)r )r-r.rrrr0sz'DistTrialRunner.run..cSsg|] }|jqSr)Z endDeferred)r-r@rrrr0sc sDttt}g}D]}|j||dqt|dddS)NrT) consumeErrorsZfireOnOneErrback)iterlistrappendrLr)rKZworkerDeferredsr@) ampWorkersrr'rsuiterrrunTestss z%DistTrialRunner.run..runTestscs.sdSsdS}|SrB)r(Z wasSuccessful addCallback)ignrH)nextRunr'rTr untilFailurerrrWs z$DistTrialRunner.run..nextRuncs"sddSrB)ZunlockrQstoprV)rMstopping testDirLockrrrYs z!DistTrialRunner.run..stopcs(s$dtdd}|SdS)NT)rN)rQrrU)rH)continueShutdownprocessEndDeferredsr[rrbeforeShutDowns  z+DistTrialRunner.run..beforeShutDowncs|SrB)r(rZ)r'rrrr]s z-DistTrialRunner.run..continueShutdownZbeforeZshutdown)Ztwisted.internetrMrZcountTestCasesrwriterGrCr(rrr!minrranger3r*rAZ spawnProcessrrUZaddBothZaddSystemEventTrigger) rrSrMrrXcountZtestDirr#ZworkersrYr_rHr) rRr]rrWr^rMr'rTrr[rSr\rXrrGs>         zDistTrialRunner.runcCs|j|ddS)z| Run the tests with local worker processes until they fail. @param suite: A tests suite to be run. T)rX)rG)rrSrrrrunUntilFailureszDistTrialRunner.runUntilFailure)NrFFrr)__name__ __module__ __qualname____doc__r rrr&r(r3rArLrrGrdrrrrrs$     [r)rhr)rZtwisted.python.filepathrZtwisted.python.modulesrZtwisted.internet.deferrZtwisted.internet.taskrZtwisted.trial.utilrZtwisted.trial._asyncrunnerrZtwisted.trial._dist.workerr r Z twisted.trial._dist.distreporterr Ztwisted.trial.reporterr Ztwisted.trial._distr robjectrrrrrs