U  W[=3@s dZddlmZmZddlZddlZddlZz ddlZWnek rPdZYnXddl m Z ddl m Z m Z ddlmZmZmZmZmZmZmZmZmZmZmZddlmZmZddlmZdd lm Z m!Z!dd l"m#Z#m$Z$Gd d d e Z%Gd dde Z&e$j'(e#sdZ)e)e%_*e)e&_*dS)z Whitebox tests for TCP APIs. )divisionabsolute_importN)TestCase)compatlog) _ACCEPT_ERRORS ECONNABORTEDEPERMENOMEMENFILEEAGAINEMFILEENOBUFS EINPROGRESS EWOULDBLOCKPort)Protocol ServerFactory)platform) maybeDeferred gatherResults)reactor interfacesc@sFeZdZdZdZddZddZddZd d Ze d krBd e_ d S)PlatformAssumptionsTestsz4 Test assumptions about platform behaviors. i cCs\g|_tdk rXddlm}t|d}ttj|_ttj||jdf|d|_ dS)Nr) _listOpenFDsd) openSocketsresourceZtwisted.internet.processrlen getrlimit RLIMIT_NOFILEoriginalFileLimit setrlimit socketLimit)selfrZnewLimitr'A/usr/lib/python3/dist-packages/twisted/test/test_tcp_internals.pysetUp$s zPlatformAssumptionsTests.setUpcCsT|jr|jqtdk rPttjd}t|jd|}ttj||fdS)Nrr) rpopcloserr!r"minr#r$)r&ZcurrentHardLimitZ newSoftLimitr'r'r(tearDown4s z!PlatformAssumptionsTests.tearDowncCst}|j||S)z| Create and return a new socket object, also tracking it so it can be closed in the test tear down. )socketrappend)r&sr'r'r(r.As zPlatformAssumptionsTests.socketc Cs|}|d|d}|d|}|dt|jD]V}z |WqDtjk r}z$|jdt t fkrWY qnW5d}~XYqDXqD| d| | d|fdtf|tj|j}| |jdt t fdS) z Test that the platform accept(2) call fails with either L{EMFILE} or L{ENOBUFS} when there are too many file descriptors open. ) 127.0.0.1rrFrNz7Could provoke neither EMFILE nor ENOBUFS from platform.r1)r.ZbindZ getsocknameZlistenZ setblockingranger%errorargsr rfailZassertInZ connect_exr assertRaisesaccept)r&portZserverPortNumberclientieexcr'r'r(test_acceptOutOfFilesKs&       z.PlatformAssumptionsTests.test_acceptOutOfFileswin32zhWindows requires an unacceptably large amount of resources to provoke this behavior in the naive manner.N) __name__ __module__ __qualname____doc__r%r)r-r.r>rgetTypeskipr'r'r'r(rs  % rc@seZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ e dkr^de _ddZe dkrxde_ddZddZe dkrde_ddZdS)SelectReactorTestsz7 Tests for select-specific failure conditions. cCsg|_g|_t|jjdSN)portsmessagesrZ addObserverr/r&r'r'r(r)|szSelectReactorTests.setUpcCs"t|jjtdd|jDS)NcSsg|]}t|jqSr')r stopListening).0pr'r'r( sz/SelectReactorTests.tearDown..)rZremoveObserverrIr/rrHrJr'r'r(r-szSelectReactorTests.tearDowncCs&t|||d}||j||S)z Create, start, and return a new L{Port}, also tracking it so it can be stopped in the test tear down.  interface)rZstartListeningrHr/)r&Z portNumberfactoryrPrMr'r'r(r9s zSelectReactorTests.portcsGfdddt}t}|jd|dd}||d||dtjfdd |jD}|t |dd |jfd S) a Test behavior in the face of an exception from C{accept(2)}. On any exception which indicates the platform is unable or unwilling to allocate further resources to us, the existing port should remain listening, a message should be logged, and the exception should not propagate outward from doRead. @param socketErrorNumber: The errno to simulate from accept. cseZdZdZfddZdS)z9SelectReactorTests._acceptFailureTest..FakeSocketzI Pretend to be a socket in an overloaded system. csttdSrG)r.r4osstrerrorrJsocketErrorNumberr'r(r8sz@SelectReactorTests._acceptFailureTest..FakeSocket.acceptNr@rArBrCr8r'rTr'r( FakeSocketsrWrr1rOr.z/Could not accept new connection ({acceptError})cs(g|] }|dko"|dkqS)Z log_formatZ acceptError)get)rLmsg)expectedErrorCodeexpectedFormatr'r(rNsz9SelectReactorTests._acceptFailureTest..z+Log event for failed accept not found in %rN) objectrr9patchdoReaderrnoZ errorcoderI assertGreaterr )r&rUrWrQr9ZmatchingMessagesr')rZr[rUr(_acceptFailureTests    z%SelectReactorTests._acceptFailureTestcCs |tS)a* C{accept(2)} can fail with C{EMFILE} when there are too many open file descriptors in the process. Test that this doesn't negatively impact any other existing connections. C{EMFILE} mainly occurs on Linux when the open file rlimit is encountered. )rar rJr'r'r(test_tooManyFilesFromAccepts z.SelectReactorTests.test_tooManyFilesFromAcceptcCs |tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOBUFS}. This mainly occurs on Windows and FreeBSD, but may be possible on Linux and other platforms as well. )rarrJr'r'r(test_noBufferSpaceFromAcceptsz/SelectReactorTests.test_noBufferSpaceFromAcceptcCs |tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ECONNABORTED}. It is not clear whether this is actually possible for TCP connections on modern versions of Linux. )rarrJr'r'r( test_connectionAbortedFromAcceptsz3SelectReactorTests.test_connectionAbortedFromAcceptcCs |tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENFILE}. This can occur on Linux when the system has exhausted (!) its supply of inodes. )rar rJr'r'r(test_noFilesFromAcceptsz)SelectReactorTests.test_noFilesFromAcceptr?z(Windows accept(2) cannot generate ENFILEcCs |tS)a Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOMEM}. On Linux at least, this can sensibly occur, even in a Python program (which eats memory like no ones business), when memory has become fragmented or low memory has been filled (d_alloc calls kmem_cache_alloc calls kmalloc - kmalloc only allocates out of low memory). )rar rJr'r'r(test_noMemoryFromAccepts z*SelectReactorTests.test_noMemoryFromAcceptz(Windows accept(2) cannot generate ENOMEMcst}t|_|jd|dd|jgfdd}||fdd}|d_| jd|| jd| jdd S) z L{tcp.Port.doRead} increases the number of consecutive C{accept} calls it performs if all of the previous C{accept} calls succeed; otherwise, it reduces the number to the amount of successful calls. rr1rOcsD] }|qdSrG)r+r:)clientsr'r(closeAllsz7SelectReactorTests.test_acceptScaling..closeAllcs(ttjtj}|djf|S)Nr1)r.ZAF_INETZ SOCK_STREAMconnectZgetHostr9rg)r9r'r(rj sz6SelectReactorTests.test_acceptScaling..connectrN) rrZprotocolr9Z addCleanuprKr/ numberAcceptsr^r` assertEqual)r&rQrirjr')rhr9r(test_acceptScalings"      z%SelectReactorTests.test_acceptScalingcsddgGfdddt}tD]}tj|jq*j|jdgt}jd|dd}d|_  |d||  |j dd S) z C{accept(2)} returning C{EPERM} is treated as a transient failure and the call retried no more than the maximum number of consecutive C{accept(2)} calls. {rcs eZdZdZfddZdS)zLSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit Pretend to be a socket in an overloaded system whose C{accept} method can only be called C{maximumNumberOfAccepts} times. cs<dd7<dkr&dttttdS)Nrrz(Maximum number of accept calls exceeded.)r6r.r4r rRrSZoselfZ acceptCallsZmaximumNumberOfAcceptsr&r'r(r82s  zSSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit.acceptNrVr'rqr'r(FakeSocketWithAcceptLimit,srrr1rOr.rN) r\r3r7r.r4r8ZfailureExceptionrr9rkr]r^Z assertEquals)r&rr_rQr9r'rqr(test_permissionFailure#s" z)SelectReactorTests.test_permissionFailurez'Windows accept(2) cannot generate EPERMcstt}|tttgtdd|DdGfdddt}t}|j d|dd}| |d || | t j}|dt|||djjdd S) z} A C{socket.error} raised by C{accept(2)} whose C{errno} is unknown to the recovery logic is logged. css"|]}t|ttjfr|VqdSrG) isinstanceintrZlong)rLr4r'r'r( \szBSelectReactorTests.test_unknownSocketErrorRaise..rcseZdZdZfddZdS)zYSelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptErrorrocstddS)Nzunknown socket error message)r.r4rpZunknownAcceptErrorr'r(r8gsz`SelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptError.acceptNrVr'rxr'r( FakeSocketWithUnknownAcceptErrorasryrr1rOr.N)listrextendr r rmaxr\rr9r]r^ZflushLoggedErrorsr.r4rlr valuer5)r&Z knownErrorsryrQr9Zfailuresr'rxr(test_unknownSocketErrorRaiseTs  z/SelectReactorTests.test_unknownSocketErrorRaiseN)r@rArBrCr)r-r9rarbrcrdrerrDrErfrmrtr~r'r'r'r(rFws* %     *, rFz?This test only applies to reactors that implement IReactorFDset)+rCZ __future__rrr_r.rRr ImportErrorZtwisted.trial.unittestrZtwisted.pythonrrZtwisted.internet.tcprrr r r r r rrrrZtwisted.internet.protocolrrZtwisted.python.runtimerZtwisted.internet.deferrrZtwisted.internetrrrrFZ IReactorFDSetZ providedByZskipMsgrEr'r'r'r(s*   4 Y