*i]<ddlZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z ddlZddlmZddlmZddlmZGdd ej*ZGd d eZd e ej0j2efd e ej0j2effdZy)N)Callable) FunctionType)AnycastOptionalUnion)normalize_source_lines)Tracer)GraphcZeZdZdZej j defdZdZ dZ y) AST_Rewriterax Take a FunctionType object representing a `forward` method, then perform an AST rewrite to swap out nodes that are not symbolically traceable with a callsite to the FX alternative. To support swapping out an AST node, define a new `visit` method on that node. For more details, see: https://docs.python.org/3/library/ast.html#ast.NodeTransformer fncztj|\}}t|}dj|}t j |}t j|}t j|j|}t|dd}tj|j} t| j} t|| t!t| j| z } t#| dk7rt%dt#| | | d} d} | | |jS)NexeczExpected 1 new key, got rct|j||j|j|j}t j ||}tj|j|_|S)z?Based on https://stackoverflow.com/a/13503277/2988730 (@unutbu))nameargdefsclosure) r__code____name__ __defaults__ __closure__ functoolsupdate_wrappercopy__kwdefaults__)fglobalsgs `/var/www/pod-logistic/pod-ai/venv/lib/python3.12/site-packages/torch/fx/experimental/rewriter.pychange_func_globalsz1AST_Rewriter.rewrite..change_func_globals8s] ZZ A((A.A#yy)9)9:A H)r )inspectgetsourcelinesr jointextwrapdedentastparsefix_missing_locationsvisitcompiler __globals__setkeysrlistlenAssertionError)selfr sourcelines_sourcenormalized_str source_astdest_astcode globals_dict keys_beforenew_keys fn_compiledr#s r"rewritezAST_Rewriter.rewrite!s !//3 Q,[9 %!0YY~. ,,TZZ -CDxV,yy0 ,++-.  T< L--/0;>? x=A  #;CM?!KL L"8A;/   #;GGr$ctjdd}t|tjst dt ||j }t|tjst dt ||jr |jntjdd}|j|g|_ tj| }tj||S) z Swap out the Assert node (Python's `assert`) with a callsite to the symbolically-traceable torch._assert function ztorch._assert()eval)modezExpected ast.Expression, got zExpected ast.Call, got rN)valuekind)rE)r*r+ isinstance Expressionr4typebodyCallmsgConstanttestargsExpr copy_location)r5noden call_noderL expr_wrappers r" visit_AssertzAST_Rewriter.visit_AssertJs II'f 5!S^^, #@a !JK KFF )SXX. #:4 ?:K!LM M((dhh 2D(I))S) xxi0   t44r$c tj|jgtjtjdtj |j |jggS)a Swap out Python's AnnAssign with an Assign node where the annotation function is called. Example: Original: y: Tensor_Type(1,2,3, Dyn) = f2(x) Output: y = annotate(f2(x),Tensor_Type((1,2,3,Dyn))) annotate)idctx)funcrOkeywords)targetsrE)r*AssigntargetrKNameLoadrE annotation)r5rRs r"visit_AnnAssignzAST_Rewriter.visit_AnnAssign`sQzz[[M((XX<jj$//2  r$N) r __module__ __qualname____doc__torch_dynamodisablerrArVrcr$r"r r s: ]]&H,&H&HP5, r$r creZdZ ddeej j efdee e e fde ffd Z xZS)RewritingTracerroot concrete_argsreturnc6t|t||SN)supertrace_rewrite)r5rmrn __class__s r"rszRewritingTracer.tracets w}Xd^];;r$rq)rrdrerrgnnModulerrdictstrrr rs __classcell__)rus@r"rlrlssM37<EHHOOX-.< S#X/<  <.rewrite_module..RewrittenModulecDt||jjD]t\}}t |t j jr)tj||j|<Stj||j|<vyrq) rr__init____dict__itemsrGrgrvrwr)r5origkvrurewrite_modules r"rzB_rewrite..rewrite_module..RewrittenModule.__init__srG$& $ 3 3 5<1%a9/3yy9J/KDMM!,/3yy|DMM!, .rewrite_modulesI <%((// <'3n&<&<\199-'O ##1% %r$)rGrgrvrwr rArr)rrs @r"rtrt|sR"ehhoo& &ehhoo &b!!~%%d<&<==r$)r*rrr%r(collections.abcrtypesrtypingrrrrrgtorch._sourcesr torch.fx._symbolic_tracer torch.fx.graphr NodeTransformerr rlrvrwrtrjr$r"rs $-- 1+ ^ 3&&^ Buxx01>eEHHOOXr$