xKg[2dZddlmZmZmZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlmZddlZddlmZddlmZddlmZddlmZdd lmZmZdd lmZd Z Gd d eZ!Gdde!Z"GddeZ#Gdde$Z%Gdde%e#Z&Gdde%e#Z'Gdde%e#Z(Gdde#Z)GddeZ*Gdd e*Z+Gd!d"e*Z,Gd#d$e$Z-Gd%d&e!Z.Gd'd(e.Z/e0d)gZ1d*Z2y)+z+ Caching mechanism for compiled functions. )ABCMetaabstractmethodabstractpropertyN)AppDirs) NumbaWarning) BaseContext) CodeLibrary) CompileResult)configcompilerdumpscFtjr||z}t|yyN)r DEBUG_CACHEprint)msgargss V/home/alanp/www/video.onchill/myenv/lib/python3.12/site-packages/numba/core/caching.py _cache_logrs  Dj c cleZdZedZedZedZedZedZ edZ y)_Cachecy)zW The base filesystem path of this cache (for example its root folder). Nselfs r cache_pathz_Cache.cache_path&rcy)z Load an overload for the given signature using the target context. The saved object must be returned if successful, None if not found in the cache. Nrrsigtarget_contexts r load_overloadz_Cache.load_overload,rrcy)z< Save the overload for the given signature. Nrrr"datas r save_overloadz_Cache.save_overload4rrcy)z# Enable the cache. Nrrs renablez _Cache.enable:rrcy)z$ Disable the cache. Nrrs rdisablez_Cache.disable@rrcy)z" Flush the cache. Nrrs rflushz _Cache.flushFrrN) __name__ __module__ __qualname__rrrr$r(r*r,r.rrrrr$sx            rr) metaclassc:eZdZedZdZdZdZdZdZ y) NullCachecyrrrs rrzNullCache.cache_pathNsrcyrrr!s rr$zNullCache.load_overloadR rcyrr)rr"cress rr(zNullCache.save_overloadUr7rcyrrrs rr*zNullCache.enableXr7rcyrrrs rr,zNullCache.disable[r7rcyrrrs rr.zNullCache.flush^r7rN) r/r0r1propertyrr$r(r*r,r.rrrr4r4Ms-      rr4cfeZdZdZdZedZedZedZe dZ e dZ y) _CacheLocatorz< A filesystem locator for caching a given function. c|j}tj|dtj|j y)NT)exist_ok)dir)get_cache_pathosmakedirstempfile TemporaryFileclose)rpaths rensure_cache_pathz_CacheLocator.ensure_cache_pathgs5""$ D4(4(..0rcy)zA Return the directory the function is cached in. Nrrs rrCz_CacheLocator.get_cache_pathmrrcy)z{ Get a timestamp representing the source code's freshness. Can return any picklable Python object. Nrrs rget_source_stampz_CacheLocator.get_source_stampsrrcy)z Get a string disambiguator for this locator's function. It should allow disambiguating different but similarly-named functions. Nrrs rget_disambiguatorz_CacheLocator.get_disambiguatorzrrct)ze Create a locator instance for the given function located in the given file. )NotImplementedError)clspy_funcpy_files r from_functionz_CacheLocator.from_functions "!rcJtjj|}tjj|}tjj |d}t j |jj}dj||gS)zGiven the Python file path, compute a suitable path inside the cache directory. This will reduce a file path that is too long, which can be a problem on some operating system (i.e. Windows 7). _) rDrIabspathdirnamesplithashlibsha1encode hexdigestjoin)rRrTrIsubpath parentdirhasheds rget_suitable_cache_subpathz(_CacheLocator.get_suitable_cache_subpathsswww'''//$'GGMM'*2. gnn./99;xxF+,,rN) r/r0r1__doc__rJrrCrMrO classmethodrUrdrrrr?r?bsp1       ""--rr?c,eZdZdZdZdZedZy)_SourceFileBackedLocatorMixinzf A cache locator mixin for functions which are backed by a well-known Python source file. cttddr$tjtj}ntj|j }|j |jfSNfrozenF)getattrsysrDstat executable_py_filest_mtimest_size)rsts rrMz._SourceFileBackedLocatorMixin.get_source_stampsG 3% ((B'B{{BJJ&&rc,t|jSr)str_linenors rrOz/_SourceFileBackedLocatorMixin.get_disambiguators4<<  rctjj|sy|||} |j|S#t$rYywxYwr)rDrIexistsrJOSErrorrRrSrTrs rrUz+_SourceFileBackedLocatorMixin.from_functionsMww~~g& 7G$   " " $    s= A A N)r/r0r1rerMrOrfrUrrrrhrhs% '!  rrhc8eZdZdZdZdZefdZxZS)_UserProvidedCacheLocatorzd A locator that always point to the user provided directory in `numba.config.CACHE_DIR` c||_|jj|_|j |}t j jtj||_ yr) rp__code__co_firstlinenorvrdrDrIr`r CACHE_DIR _cache_path)rrSrT cache_subpaths r__init__z"_UserProvidedCacheLocator.__init__sI ''66 77@ 77<<(8(8-Hrc|jSrrrs rrCz(_UserProvidedCacheLocator.get_cache_pathrcjtjsytt|}|j ||Sr)r rsuperr|rU)rRrSrTparent __class__s rrUz'_UserProvidedCacheLocator.from_functions/ 0#6##GW55r) r/r0r1rerrCrfrU __classcell__rs@rr|r|s'I  66rr|ceZdZdZdZdZy)_InTreeCacheLocatorzn A locator for functions backed by a regular Python module with a writable __pycache__ directory. c||_|jj|_tj j tj j|jd|_y)N __pycache__) rpr~rrvrDrIr`rZr)rrSrTs rrz_InTreeCacheLocator.__init__sD ''66 77<< (F Vrc|jSrrrs rrCz"_InTreeCacheLocator.get_cache_pathrrN)r/r0r1rerrCrrrrrs W  rrc,eZdZdZdZdZedZy)_UserWideCacheLocatorz A locator for functions backed by a regular Python module or a frozen executable, cached into a user-wide cache directory. c||_|jj|_t dd}|j }|j |}tjj|||_ y)NnumbaF)appname appauthor) rpr~rrvruser_cache_dirrdrDrIr`r)rrSrTappdirs cache_dirrs rrz_UserWideCacheLocator.__init__sZ ''66 'U;** 77@ 77<< =Arc|jSrrrs rrCz$_UserWideCacheLocator.get_cache_pathrrctjj|sttddsy|||} |j |S#t $rYywxYwrj)rDrIrxrlrmrJryrzs rrUz#_UserWideCacheLocator.from_functionsZw'73%+H 7G$   " " $    sA AAN)r/r0r1rerrCrfrUrrrrrs& B   rrc8eZdZdZdZdZdZdZedZ y)_IPythonCacheLocatorzT A locator for functions entered at the IPython prompt (notebook or other). c||_tj|}t|tr||_y|j d|_y)Nzutf-8)rpinspect getsource isinstancebytes _bytes_sourcer^)rrSrTsources rrz_IPythonCacheLocator.__init__s> ""7+ fe $!'D !'w!7D rc ddlm}tj j |dS#t$r ddlm}Y6wxYw)Nr)get_ipython_cache_dir numba_cache) IPython.pathsr ImportErrorIPython.utils.pathrDrIr`)rrs rrCz#_IPythonCacheLocator.get_cache_paths<  A ;ww||13]CC A @ As -??c\tj|jjSr)r\sha256rr_rs rrMz%_IPythonCacheLocator.get_source_stamps ~~d001;;==rcdj|jjddd}tj|j ddS)NrT )r`r splitlinesr\rr_)r firstliness rrOz&_IPythonCacheLocator.get_disambiguatorsI XXd00;;DA"1EF ~~j)335cr::rc|jdsLtjjtjj |jdsy|||} |j |S#t $rYywxYw)Nz ;  rrcxeZdZdZeeeegZdZ dZ e dZ e dZ edZedZedZy ) CacheImplz Provides the core machinery for caching. - implement how to serialize and deserialize the data in the cache. - control the filename of the cache. - provide the cache locator c8|jj|_ |j}t j|}|jD]}|j||}|ntd|d|||_ t j|}tjjtjj|d}|d|}t!t"dd} |j%|| |_y#t$r|j }YwxYw)Nzcannot cache function z : no locator available for file r.abiflags)r~rrvr1AttributeErrorr/rgetfile_locator_classesrU RuntimeError_locatorrDrIsplitextrrlrmget_filename_base_filename_base) rrSqualname source_pathrRlocatorfilenamemodnamefullnamers rrzCacheImpl.__init__Cs''66  (++Hoog. ((C''=G") 08+ GH H ??7+''""277#3#3H#=>qA%x03 B/"44XxH% (''H (s DDDc|jddjdd}d}|||jjtjdtjd|fzS)Nz%s-%s.py%d%d%sr)replacerrOrm version_info)rrrfixed_fullnamefmts rrzCacheImpl.get_filename_base\sk"))#r2::3Cndll&D&D&F&&q)3+;+;A+>JJ Jrc|jSr)rrs r filename_basezCacheImpl.filename_baseds"""rc|jSr)rrs rrzCacheImpl.locatorhs }}rcy)z$Returns the serialized form the dataNrrr's rreducezCacheImpl.reducel rcy)z4Returns the de-serialized form of the *reduced_data*Nr)rr# reduced_datas rrebuildzCacheImpl.rebuildqrrcy)zEReturns True if the given data is cachable; otherwise, returns False.Nrrs rcheck_cachablezCacheImpl.check_cachablevrrN)r/r0r1rer|rrrrrrr=rrrrrrrrrrr7s 2+-,. I2J##      rrc"eZdZdZdZdZdZy)CompileResultCacheImplz> Implements the logic to cache CompileResult objects. c"|jS)z4 Returns a serialized CompileResult )_reduce)rr9s rrzCompileResultCacheImpl.reduces||~rcBtjj|g|S)z8 Returns the unserialized CompileResult )r r _rebuildrr#payloads rrzCompileResultCacheImpl.rebuilds %%..~HHHrcLd}td|jDrd}n|jjrd}|rid|jj j ddd|}tj|t|jj|jy y ) z@ Check cachability of the given compile result. Nc36K|]}|j ywr) can_cache).0xs r z8CompileResultCacheImpl.check_cachable..s4 11;; szas it uses lifted codezLas it uses dynamic globals (such as ctypes pointers and large global arrays)z Cannot cache compiled function "rrWz" FT) anyliftedlibraryhas_dynamic_globalsfndescrr[warnings warn_explicitrrrprv)rr9 cannot_cachers rrz%CompileResultCacheImpl.check_cachables 4 4 43L \\ - -PL kk**005b9<IC  " "3 #'==#9#94<< IrN)r/r0r1rerrrrrrrr|s I rrc8eZdZdZdZdZdZdZfdZxZ S)CodeLibraryCacheImplz< Implements the logic to cache CodeLibrary objects. Nc"|jS)z2 Returns a serialized CodeLibrary )serialize_using_object_codercodelibs rrzCodeLibraryCacheImpl.reduces2244rc@|jj|S)z6 Returns the unserialized CodeLibrary )codegenunserialize_libraryrs rrzCodeLibraryCacheImpl.rebuilds%%';;GDDrc|j S)z= Check cachability of the given CodeLibrary. )rrs rrz#CodeLibraryCacheImpl.check_cachables....rctt|}|j||}dj|j|gS)N-)rrrr`_filename_prefix)rrrrresrs rrz&CodeLibraryCacheImpl.get_filename_bases<+T2&&x:xx..455r) r/r0r1rerrrrrrrs@rrrs*5 E / 66rrcveZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zej d Zy)IndexDataCacheFilezP Implements the logic for the index file and data file used by a cache. c||_|d|_tjj |j|j|_|d|_||_tj|_ y)Nz.nbiz.{number:d}.nbc) r _index_namerDrIr` _index_path_data_name_pattern _source_stampr __version___version)rrr source_stamps rrzIndexDataCacheFile.__init__sX%'4677<<(8(8$:J:JK9F"H))) rc&|jiyr) _save_indexrs rr.zIndexDataCacheFile.flushs rc2|j} ||}|j||y#t$rct|j}t j dD]}|j |}||vsn||<|j|Y~wxYw)z? Save a new cache entry with *key* and *data*. rN) _load_indexKeyErrorsetvalues itertoolscount _data_namer _save_data)rkeyr' overloads data_nameexistingis rsavezIndexDataCacheFile.saves$$&  (!#I  4( (9++-.H__Q' OOA. H,('IcN   Y ' (s*AB:BBc|j}|j|}|y |j|S#t$rYywxYw)z0 Load a cache entry with *key*. N)rget _load_datary)rrrrs rloadzIndexDataCacheFile.loadsO$$& MM#&    ??9- -   s7 AAcj t|jd5}tj|}|j }ddd|j k7riStj\}}td|j||jk7riS|S#1swY[xYw#t $ricYSwxYw)z| Load the cache index and return it as a dictionary (possibly empty if cache is empty or obsolete). rbNz[cache] index loaded from %r) openrpickler!readFileNotFoundErrorr loadsrr )rfversionr'stamprs rrzIndexDataCacheFile._load_indexs  d&&- ++a.vvx. dmm #I!<<-y143C3CD D&& &I #.-! I s'B$&BB$B!B$$ B21B2c4|j|f}|j|}|j|j5}t j |j |d|j|dddtd|jy#1swY xYw)NrW)protocolz[cache] index saved to %r) r _dump_open_for_writerr%dumpr writer)rrr'r)s rrzIndexDataCacheFile._save_indexsv!!9,zz$  ! !$"2"2 3q KK q2 6 GGDM4 .0@0@A4 3s 4BBc|j|}t|d5}|j}dddtj}t d||S#1swY,xYw)Nr#zache] data loaded from %r) _data_pathr$r&r%r(r)rnamerIr)r'tups rr zIndexDataCacheFile._load_datasSt$ $ 668Dll4 0$7  s AA#c|j|}|j|}|j|5}|j|dddt d|y#1swYxYw)Nz[cache] data saved to %r)r.r3r/r1r)rr4r'rIr)s rrzIndexDataCacheFile._save_datasRzz$t$  ! !$ '1 GGDM(-t4( 's AA$c:|jj|S)N)number)rformat)rr8s rrzIndexDataCacheFile._data_names&&--V-<.pyXY.nbi") which contains a mapping of signatures and architectures to data files. It is prefixed by a versioning key and a timestamp of the Python source file containing the function. There is one data file ("function_name-.pyXY..nbc") per function, function signature, target architecture and Python version. Separate index and data files per Python version avoid pickle compatibility problems. Note: This contains the driver logic only. The core logic is provided by a subclass of ``CacheImpl`` specified as *_impl_class* in the subclass. Nc~t||_||_|j||_|jj j |_|jj j}|jj}t|j|||_ |jy)N)rrr ) repr_name_py_func _impl_class_implrrCrrMrr _cache_filer*)rrSr rs rrzCache.__init__Vs']  %%g. ::--<<>zz))::<  00 -9I9I#9#9#;<$$S)  ::%%nd;D rcr|j5|j||dddy#1swYyxYw)zE Save the data for the given signature in the cache. N)r]_save_overloadr&s rr(zCache.save_overloads, 3 3 5   T *6 5 5s-6cD|jsy|jj|sy|jjj |j ||j }|jj|}|jj||yr) rXrQrrrJr`rrrRr)rr"r'rs rrbzCache._save_overloadsu}} zz((.  ,,.ooc4<<0zz  & c4(rc#Ktjdk(r dydy#t$r(}|jtjk7rYd}~yd}~wwxYww)Nnt)rDr4ryerrnoEACCES)res rr]z'Cache._guard_against_spurious_io_errorssG 77d?    77ell*+ s*A!A AA A AAcJ|jjj}|jjCt |jjDcgc]}|j c}}t |}nd}d}||j||||ffScc}w)a  Compute index key for the given signature and codegen. It includes a description of the OS, target architecture and hashes of the bytecode for the function and, if the function has a __closure__, a hash of the cell_contents. rcHtj|jSr)r\rr_)rs rz"Cache._index_key..s7>>!,668r)rOr~co_code __closure__tuple cell_contentsr magic_tuple)rr"r codebytesrcvars cvarbyteshashers rr`zCache._index_keysMM**22 == $ $ 0DMM4M4MN4Mq1??4MNOEe II8W((*VI->-3I->-AB BOsB )r/r0r1rerPrrTr=rr*r,r.r$r^r(rbrHrIr]r`rrrrKrK=sp,K I  !<+)  BrrKceZdZdZeZy) FunctionCachezF Implements Cache that saves and loads CompileResult objects. N)r/r0r1rerrPrrrrvrvs)KrrvrctvsJtjGfddtGfddt}|S)z Create a Cache class for additional compilation features to cache their result for reuse. The cache is saved in filename pattern like in ``FunctionCache`` but with additional *prefix* as specified. ceZdZWZy)6make_library_cache..CustomCodeLibraryCacheImplN)r/r0r1r)prefixsrCustomCodeLibraryCacheImplrys !rr{ceZdZdZWZy)(make_library_cache..LibraryCachez Implements Cache that saves and loads CodeLibrary objects for additional feature for the specified python function. N)r/r0r1rerP)r{sr LibraryCacher}s 1 rr~)_lib_cache_prefixesaddrrK)rzr~r{s` @rmake_library_cachersC , ,, ,F#"%9"1u1 r)3reabcrrrrHrfr\rrrDr%rmrFr@rnumba.misc.appdirsrrnumba.core.errorsrnumba.core.basernumba.core.codegenr numba.core.compilerr numba.corer r numba.core.serializerrrr4r?objectrhr|rrrrrrrrKrvrrrrrrrs% :9   & *'*-'& & w& R  *6-g6-rF@6 =}6,  7  9=@4=4nB 'B J!Y!H696>{{|{BF{B|)E)2$ir