U ¹êW[p&ã@sldZddlmZmZddlZddlmZddlm Z m Z ddl m Z ddl mZeƒZeGdd „d ƒƒZdS) zº twisted.python.threadpool: a pool of threads to which we dispatch tasks. In most cases you can just use C{reactor.callInThread} and friends instead of creating a thread pool directly. é)ÚdivisionÚabsolute_importN)Úpool)ÚlogÚcontext)ÚFailure)Ú _oldStylec@sØeZdZdZdZdZdZdZdZdZ e j Z e e jƒZe eƒZd'dd„Zed d „ƒZed d „ƒZed d„ƒZedd„ƒZeZdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd „Zd!d"„Zd(d#d$„Zd%d&„Z dS))Ú ThreadPoolaè This class (hopefully) generalizes the functionality of a pool of threads to which work can be dispatched. L{callInThread} and L{stop} should only be called from a single thread. @ivar started: Whether or not the thread pool is currently running. @type started: L{bool} @ivar threads: List of workers currently running in this thread pool. @type threads: L{list} @ivar _pool: A hook for testing. @type _pool: callable compatible with L{_pool} ééFrNcsb|dkstdƒ‚||ks tdƒ‚|ˆ_|ˆ_|ˆ_gˆ_‡fdd„}‡fdd„}ˆ ||¡ˆ_dS) ac Create a new threadpool. @param minthreads: minimum number of threads in the pool @type minthreads: L{int} @param maxthreads: maximum number of threads in the pool @type maxthreads: L{int} @param name: The name to give this threadpool; visible in log messages. @type name: native L{str} rúminimum is negativeúminimum is greater than maximumcs(ˆj|dˆ ¡i|—Ž}ˆj |¡|S)NÚname)Ú threadFactoryÚ _generateNameÚthreadsÚappend)ÚaÚkwÚthread©Úself©ú;/usr/lib/python3/dist-packages/twisted/python/threadpool.pyÚtrackingThreadFactoryJs z2ThreadPool.__init__..trackingThreadFactorycsˆjs dSˆjS)Nr)ÚstartedÚmaxrrrrÚ currentLimitOsz)ThreadPool.__init__..currentLimitN)ÚAssertionErrorÚminrrrÚ_poolÚ_team)rÚ minthreadsÚ maxthreadsrrrrrrÚ__init__6s   zThreadPool.__init__cCs|j ¡}|j|jS)a For legacy compatibility purposes, return a total number of workers. @return: the current number of workers, both idle and busy (but not those that have been quit by L{ThreadPool.adjustPoolsize}) @rtype: L{int} )r!Ú statisticsÚidleWorkerCountÚbusyWorkerCount)rZstatsrrrÚworkersWs zThreadPool.workerscCsdg|j ¡jS)zý For legacy compatibility purposes, return the number of busy workers as expressed by a list the length of that number. @return: the number of workers currently processing a work item. @rtype: L{list} of L{None} N)r!r%r'rrrrÚworkingds zThreadPool.workingcCsdg|j ¡jS)a, For legacy compatibility purposes, return the number of idle workers as expressed by a list the length of that number. @return: the number of workers currently alive (with an allocated thread) but waiting for new work. @rtype: L{list} of L{None} N)r!r%r&rrrrÚwaitersps zThreadPool.waiterscsG‡fdd„dtƒ}|ƒS)zÙ For legacy compatibility purposes, return an object with a C{qsize} method that indicates the amount of work not yet allocated to a worker. @return: an object with a C{qsize} method. cseZdZ‡fdd„ZdS)z$ThreadPool._queue..NotAQueuecs ˆj ¡jS)a Pretend to be a Python threading Queue and return the number of as-yet-unconsumed tasks. @return: the amount of backlogged work not yet dispatched to a worker. @rtype: L{int} )r!r%ÚbackloggedWorkCount)ÚqrrrÚqsize†s z*ThreadPool._queue..NotAQueue.qsizeN)Ú__name__Ú __module__Ú __qualname__r-rrrrÚ NotAQueue…sr1)Úobject)rr1rrrÚ_queue}s zThreadPool._queuecCs4d|_d|_| ¡|j ¡j}|r0|j |¡dS)z' Start the threadpool. FTN)ÚjoinedrÚadjustPoolsizer!r%r+Úgrow)rZbacklogrrrÚstart–s  zThreadPool.startcCs|j d¡dS)zŒ Increase the number of available workers for the thread pool by 1, up to the maximum allowed by L{ThreadPool.max}. éN)r!r6rrrrÚ startAWorker£szThreadPool.startAWorkercCsd|jpt|ƒ|jfS)z‹ Generate a name for a new pool thread. @return: A distinctive name for the thread. @rtype: native L{str} zPoolThread-%s-%s)rÚidr(rrrrr«szThreadPool._generateNamecCs|j d¡dS)zn Decrease the number of available workers by 1, by quitting one as soon as it's idle. r8N)r!ÚshrinkrrrrÚ stopAWorkerµszThreadPool.stopAWorkercCs"t|d|ƒt ||j|j¡dS)NÚ__dict__)Úsetattrr r$rr©rÚstaterrrÚ __setstate__½s zThreadPool.__setstate__cCsi}|j|d<|j|d<|S)Nrr)rrr?rrrÚ __getstate__Âs  zThreadPool.__getstate__cOs|jd|f|ž|ŽdS)a Call a callable object in a separate thread. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword args to be passed to C{func} N)ÚcallInThreadWithCallback)rÚfuncÚargsrrrrÚ callInThreadÉs zThreadPool.callInThreadcsP|jr dStj ¡jd‰‡fdd„‰‡‡‡‡fdd„ˆ_|ˆ_|j ˆ¡dS)a$ Call a callable object in a separate thread and call C{onResult} with the return value, or a L{twisted.python.failure.Failure} if the callable raises an exception. The callable is allowed to block, but the C{onResult} function must not block and should perform as little work as possible. A typical action for C{onResult} for a threadpool used with a Twisted reactor would be to schedule a L{twisted.internet.defer.Deferred} to fire in the main reactor thread using C{.callFromThread}. Note that C{onResult} is called inside the separate thread, not inside the reactor thread. @param onResult: a callable with the signature C{(success, result)}. If the callable returns normally, C{onResult} is called with C{(True, result)} where C{result} is the return value of the callable. If the callable throws an exception, C{onResult} is called with C{(False, failure)}. Optionally, C{onResult} may be L{None}, in which case it is not called at all. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword arguments to be passed to C{func} Néÿÿÿÿcs^zˆ ¡}d}Wntƒ}d}YnXdˆ_ˆjdk rLˆ ||¡dˆ_n|sZt |¡dS)NTF)ÚtheWorkrÚonResultrÚerr)ÚresultÚok)Ú inContextrrrMøs   z6ThreadPool.callInThreadWithCallback..inContextcstjˆˆfˆžˆŽS)N)rÚcallr)rEÚctxrDrrrÚ óz5ThreadPool.callInThreadWithCallback..) r4rZtheContextTrackerZcurrentContextZcontextsrHrIr!Zdo)rrIrDrErr)rErOrDrMrrrCÖs z#ThreadPool.callInThreadWithCallbackcCs.d|_d|_|j ¡|jD] }| ¡qdS)z9 Shutdown the threads in the threadpool. TFN)r4rr!ÚquitrÚjoin)rrrrrÚstops   zThreadPool.stopcCs–|dkr|j}|dkr|j}|dks,tdƒ‚||ks  !       : r )rWZ __future__rrrXZtwisted._threadsrr Ztwisted.pythonrrZtwisted.python.failurerZtwisted.python._oldstylerr2Z WorkerStopr rrrrÚs