U  W[U'@sdZddlZddlmZddlmZmZddlmZddl m Z ddl m Z dd l mZdd lmZdd lmZmZdd lmZeZd dZddZddZddedddddfddedeefgZeddeDZddZddZd d!Zd"d#Z d*d%d&Z!d+d(d)Z"dS),zA Tools for saving and loading log events in a structured format. N) NamedConstant)dumpsloads)UUID) flattenEventFileLogObserver)LogLevel)Logger)unicode_PY3)FailurecCs t|t|jj|jjddS)a Convert a failure to a JSON-serializable data structure. @param failure: A failure to serialize. @type failure: L{Failure} @return: a mapping of strings to ... stuff, mostly reminiscent of L{Failure.__getstate__} @rtype: L{dict} ) __module____name__)type)dict __getstate__rrr)Zfailurer6/usr/lib/python3/dist-packages/twisted/logger/_json.py failureAsJSONs rcCsPt|trtt|St|tr4tdd|DSt|trH|dS|SdS)a On Python 2, we really need native strings in a variety of places; attribute names will sort of work in a __dict__, but they're subtly wrong; however, printing tracebacks relies on I/O to containers that only support bytes. This function converts _all_ native strings within a JSON-deserialized object to bytes. @param obj: An object to convert to bytes. @type obj: L{object} @return: A string of UTF-8 bytes. @rtype: L{bytes} css"|]\}}t|t|fVqdSN)asBytes).0kvrrr AszasBytes..utf-8N) isinstancelistmaprritemsr encode)objrrrr0s     rcCsZttdd}|dkr tt}n|t}ts4t|}|d}t|dd||d<||_|S)a# Load a L{Failure} from a dictionary deserialized from JSON. @param failureDict: a JSON-deserialized object like one previously returned by L{failureAsJSON}. @type failureDict: L{dict} mapping L{unicode} to attributes @return: L{Failure} @rtype: L{Failure} __new__Nrrr)getattrrtypesZ InstanceTyper rr__dict__)Z failureDictZ newFailurefZtypeInforrrfailureFromJSONIs  r)cCst|tott|jd|kSr)rrr%r namelevelrrris r-z$02E59486-F24D-46AD-8224-3ACDF2A5732AcCs t|jdS)N)r*)rr*r+rrrr-ncCstt|ddS)Nr*)r%r r+rrrr-or.cCs t|tSr)rr)orrrr-sr.z$E76887E2-20ED-49BF-A8F8-BA25CC586F2DcCsg|]\}}}}||fqSrr)r predicateuuidsaverloaderrrr {s r4cCs d|krtt|d|S|S)aR Dictionary-to-object-translation hook for certain value types used within the logging system. @see: the C{object_hook} parameter to L{json.load} @param aDict: A dictionary loaded from a JSON object. @type aDict: L{dict} @return: C{aDict} itself, or the object represented by C{aDict} @rtype: L{object} __class_uuid__) uuidToLoaderr)ZaDictrrrobjectLoadHooks r7cCs>tD]0\}}}}||r||}t||d<|SqddiS)a Object-to-serializable hook for certain value types used within the logging system. @see: the C{default} parameter to L{json.dump} @param pythonObject: Any object. @type pythonObject: L{object} @return: If the object is one of the special types the logging system supports, a specially-formatted dictionary; otherwise, a marker dictionary indicating that it could not be serialized. r5Z unpersistableT) classInfostr)Z pythonObjectr0r1r2r3resultrrrobjectSaveHooks   r;cCsZttkrttddd}ndd}t|dd}t|t|f|}t|tsVt|ddS|S) a Encode an event as JSON, flattening it if necessary to preserve as much structure as possible. Not all structure from the log event will be preserved when it is serialized. @param event: A log event dictionary. @type event: L{dict} with arbitrary keys and values @return: A string of the serialized JSON; note that this will contain no newline characters, and may thus safely be stored in a line-delimited file. @rtype: L{unicode} charmapT)defaultencodingskipkeyscSst|tr|dSt|S)z Serialize an object not otherwise serializable by L{dumps}. @param unencodable: An unencodable object. @return: C{unencodable}, serialized r<)rbytesdecoder;)Z unencodablerrrr=s  zeventAsJSON..default)r=r?rreplace)r@r9rr;rrrr )eventkwr=r:rrr eventAsJSONs    rEcCst|td}|S)z Decode a log event from JSON. @param eventText: The output of a previous call to L{eventAsJSON} @type eventText: L{unicode} @return: A reconstructed version of the log event. @rtype: L{dict} )Z object_hook)rr7)Z eventTextZloadedrrr eventFromJSONs rFcst|fddS)a; Create a L{FileLogObserver} that emits JSON-serialized events to a specified (writable) file-like object. Events are written in the following form:: RS + JSON + NL C{JSON} is the serialized event, which is JSON text. C{NL} is a newline (C{u"\n"}). C{RS} is a record separator. By default, this is a single RS character (C{u"\x1e"}), which makes the default output conform to the IETF draft document "draft-ietf-json-text-sequence-13". @param outFile: A file-like object. Ideally one should be passed which accepts L{unicode} data. Otherwise, UTF-8 L{bytes} will be used. @type outFile: L{io.IOBase} @param recordSeparator: The record separator to use. @type recordSeparator: L{unicode} @return: A file log observer. @rtype: L{FileLogObserver} csdt|S)Nz{0}{1} )formatrE)rCrecordSeparatorrrr-r.z%jsonFileLogObserver..r)ZoutFilerJrrIrjsonFileLogObservers rKc #sdd}dd|dkr:||d}|dkr4|}qFd}n ||}d}|dkrXd }}n fd d }t|}||}|st|d kr||}|dk r|Vq|||7}||} | dd D]&} t| d kr|| }|dk r|Vq| d }qldS)a Load events from a file previously saved with L{jsonFileLogObserver}. Event records that are truncated or otherwise unreadable are ignored. @param inFile: A (readable) file-like object. Data read from C{inFile} should be L{unicode} or UTF-8 L{bytes}. @type inFile: iterable of lines @param recordSeparator: The expected record separator. If L{None}, attempt to automatically detect the record separator from one of C{u"\x1e"} or C{u""}. @type recordSeparator: L{unicode} @param bufferSize: The size of the read buffer used while reading from C{inFile}. @type bufferSize: integer @return: Log events as read from C{inFile}. @rtype: iterable of L{dict} cSst|tkr|S|dSdS)Nr)rr@r")srrrrs z&eventsFromJSONLogFile..asBytescSstzt|d}Wn(tk r:tjdt|dYdSXz t|WStk rntjdt|dYdSXdS)Nrz2Unable to decode UTF-8 for JSON record: {record!r}recordz&Unable to read JSON record: {record!r})r@rAUnicodeDecodeErrorlogerrorrF ValueError)rOtextrrreventFromBytearrays  z1eventsFromJSONLogFile..eventFromBytearrayNrr. cs.|dtdkr|Stjdt|ddS)N z0Unable to read truncated JSON record: {record!r}rN)ordrQrRr@rNrUrreventFromRecordDsz.eventsFromJSONLogFile..eventFromRecordrrX)read bytearraylensplit) ZinFilerJZ bufferSizerfirstr\bufferZnewDatarCZrecordsrOrr[reventsFromJSONLogFiles:      rc)rG)NrL)#__doc__r&Z constantlyrZjsonrrr1rZ_flattenrZ_filer Z_levelsr Z_loggerr Ztwisted.python.compatr r Ztwisted.python.failurerrQrrr)r8rr6r7r;rErFrKrcrrrrsD         (