o h@sdZddlZddlZddlmZzddlmZmZmZm Z m Z m Z m Z ddl mZWneyGddlmZmZmZmZm Z m Z m Z m Z YnwddlmZmZejded d efd d Zd dZeefddZdddZeefddZdddZdS)z*serialization utilities for apply messagesN)chain) CannedObjectcan can_sequenceistypesequence_typesuncanuncan_sequence)PICKLE_PROTOCOL)r rrrrrrr ) MAX_BYTES MAX_ITEMSzHipykernel.serialize is deprecated. It has moved to ipyparallel.serialize) stacklevelcCsfg}t|tr1|jr1t|jD]!\}}t||kr$d|j|<||qt|tr0||j|<q|S)z/extract buffers larger than a certain thresholdN) isinstancerbuffers enumeratelenappend memoryviewtobytes)obj thresholdribufrIc:\Users\shubh\Videos\agent\nova\Lib\site-packages\ipykernel/serialize.py_extract_buffers0s    rcCsHt|tr|jr t|jD]\}}|dur|d|j|<q dSdSdS)zrestore buffers extracted byNr)rrrrpop)rrrrrrr_restore_buffers@srcCsg}t|trt||krt|}|D] }|t||qn3t|trFt||krFi}t|D]}t||}|t|||||<q0n t|}|t||| dt |t |S)a Serialize an object into a list of sendable buffers. Parameters ---------- obj : object The object to be serialized buffer_threshold : int The threshold (in bytes) for pulling out data buffers to avoid pickling them. item_threshold : int The maximum number of items over which canning will iterate. Containers (lists, dicts) larger than this will be pickled without introspection. Returns ------- [bufs] : list of buffers representing the serialized object. r) rrrrextendrdictsortedrinsertpickledumpsr )rbuffer_thresholditem_thresholdrZcobjckrrrserialize_objectHs"   r)cCst|}|d}t|}t|tr,t|tkr,|D]}t||qt ||}||fSt|t rTt|tkrTi}t |D]}||}t||t ||||<q=||fSt||t ||}||fS)a"reconstruct an object serialized by serialize_object from data buffers. Parameters ---------- buffers : list of buffers/bytes g : globals to be used when uncanning Returns ------- (newobj, bufs) : unpacked object, and the list of remaining unused buffers. r) listrr#loadsrrrr rr r r!r)rgbufsZpobjZcannedr'Znewobjr(rrrdeserialize_objectns$        r.c sttfdd|D}t}ttfdd|D}tt|t||d}tt |t g} | t|t | || || S)apack up a function, args, and kwargs to be sent over the wire Each element of args/kwargs will be canned for special treatment, but inspection will not go any deeper than that. Any object whose data is larger than `threshold` will not have their data copied (only numpy arrays and bytes/buffers support zero-copy) Message will be a list of bytes/buffers of the format: [ cf, pinfo, , ] With length at least two + len(args) + len(kwargs) c3s|] }t|VqdSNr)).0arg)r%r&rr sz%pack_apply_message..c3s |] }t|VqdSr/r0)r1keyr%r&kwargsrrr3s )nargs narg_bufskw_keys) r*r from_iterabler!keysr rr#r$rr rr) fargsr6r%r&arg_bufsr9 kwarg_bufsinfomsgrr5rpack_apply_messages   rBTcCst|}t|dksJd|d}tt||}|d}t|}|d|d||dd}}g} t|dD]} t||\} }| | q>t | } |rWJdi} |dD] }t||\}}|| |<q]|rqJd || | fS) zdunpack f,args,kwargs from buffers packed by pack_apply_message() Returns: original f,args,kwargsr znot enough buffers!rNr8r7z#Shouldn't be any arg bufs left overr9z%Shouldn't be any kwarg bufs left over) r*rrrr#r+ranger.rtuple)r-r,copypfr<Zpinfor@r>r?Z args_list_r2r=r6r4kwargrrrunpack_apply_messages&   "      rIr/)NT)__doc__r#warnings itertoolsrZipyparallel.serialize.canningrrrrrrr Zipyparallel.serialize.serializer ImportErrorZipykernel.pickleutilZjupyter_client.sessionr r warnDeprecationWarningrrr)r.rBrIrrrrs, $ ,   & %