Gi4B dZddlZddlZddlZddlmZddlmZddlm Z eje Z GddejZGd d Zd ZGd d Z ddedzdedzdedzdedzfdZdZy)zACollection of utils to be used by backbones and their components.N) repo_exists)logging)maybe_install_capturing_hooksceZdZdZdZy) BackboneTypetimm transformersN)__name__ __module__ __qualname__TIMM TRANSFORMERS]/var/www/pod-logistic/pod-ai/venv/lib/python3.12/site-packages/transformers/backbone_utils.pyrrs D!LrrceZdZdZdedzdedzfdZdZedZejdee fdZed Z e jde e d fee zfd Z fd ZxZS) BackboneConfigMixinzv A Mixin to support handling the `out_features` and `out_indices` attributes for the backbone configurations. out_featuresN out_indicesc||_t|tr t|n||_|j |j|j}}|,|*t |jdz g}|jdg}nM|+|)|Dcgc]}|jj|}}n |||Dcgc]}|j|}}||c|_|_|j ycc}wcc}w)ap Sets output indices and features to new values and aligns them with the given `stage_names`. If one of the inputs is not given, find the corresponding `out_features` or `out_indices` for the given `stage_names`. Args: out_features (`list[str]`, *optional*): The names of the features for the backbone to output. Defaults to `config._out_features` if not provided. out_indices (`list[int]` or `tuple[int]`, *optional*): The indices of the features for the backbone to output. Defaults to `config._out_indices` if not provided. Nr) _out_features isinstancetuplelist _out_indicesverify_out_features_out_indiceslen stage_namesindex)selfrrlayeridxs r"set_output_features_output_indicesz6BackboneConfigMixin.set_output_features_output_indices(s *1;K1OD-U` ,,.%)$6$68I8Ik  <#7t//0145K ,,R01L  \%=FRSU4++11%8SKS  !k&==HIcD,,S1ILI1=k-D- ,,. TIs "C-5C2czj tdjtjtfs!tdt jt fdjDr%tdjdjtjttjk7rtdjjjDcgc]}|jvs|c}x}k7rtd|djjLtjts!td t jtfd jD}t fd |Dr%td jd jt|tt|k7r4dj}||jk7rd|dndz }t||tt|k7rOtt|jdDcgc]\}}| }}}td|djjjvtjtjk7r tdjjDcgc]}j|c}k7r tdyyycc}wcc}}wcc}w)z_ Verify that out_indices and out_features are valid for the given stage_names. Nz2Stage_names must be set for transformers backbonesz out_features must be a list got c3:K|]}|jvywN)r ).0featr"s r zFBackboneConfigMixin.verify_out_features_out_indices..VsOD4t///Osz.out_features must be a subset of stage_names: z got z2out_features must not contain any duplicates, got z@out_features must be in the same order as stage_names, expected z out_indices must be a list, got c3\K|]#}|dkr|tjzn|%yw)rN)rr r)r$r"s rr+zFBackboneConfigMixin.verify_out_features_out_indices..gs.$rY\C!GS3t/?/?+@%@QT%T$rs),c3dK|]'}|ttjvs$|)ywr()rangerr r-s rr+zFBackboneConfigMixin.verify_out_features_out_indices..hs(^3cs4K[K[G\A]6]3^s%00z2out_indices must be valid indices for stage_names z, got z1out_indices must not contain any duplicates, got z(equivalent to z))c |dS)Nrr)xs rzEBackboneConfigMixin.verify_out_features_out_indices..rs efgheir)keyz?out_indices must be in the same order as stage_names, expected zHout_features and out_indices should have the same length if both are setzQout_features and out_indices should correspond to the same stages if both are set) r ValueErrorrrrtypeanyrsetrrsortedzip)r"r* sorted_featspositive_indicesmsg_r$sorted_negatives` rrz3BackboneConfigMixin.verify_out_features_out_indicesLs3    #QR R    )d004': #CDI[I[D\C]!^__OD4 @} r)r r r __doc__rr%rpropertyrsetterstrrrintrL __classcell__rOs@rrr#s"/Tk"/D["/H0vd""]c]] !!\uS#Xc'B\\rrcBtjfd}|S)ak Wrapper to filer out `hidden_states` as backbones tend to always use them to get their feature maps, i.e. they also always output `hidden_states`. This controls for user-defined behavior again. NOTE: We assume a `can_return_tuple` decorator to be applied before so that we always expect a dict like object to remove the hidden states. c|jdt|jdd}|g|i|}|s9|jDcic] \}}|dvs ||}}}t |di|}|Scc}}w)Noutput_hidden_statesF hidden_statesr)getgetattrconfigitemsr6) r"argskwargsrYrNkvfiltered_output_dataforward_functions rwrapperz,filter_output_hidden_states..wrappers%zz*@'$++WmotBuv!$888#5;\\^#bTQqQ`GaAqD#b #b!T&\9$89F $cs A2A2) functoolswraps)rdres` rfilter_output_hidden_statesrhs(__%&' Nrc>eZdZUdZedzed<dZeed<dfd ZfdZ ddZ ddZ e d Z e jd eefd Z e d Zejd eeeezfdZe dZe dZdZ ddedzdedzdedzfdZxZS) BackboneMixinN backbone_typeThas_attentionsct||i||jdd}|tj|_ntj |_|j tjk(r|j|y|j tj k(r|jytd|j d)z Method to initialize the backbone. This method is called by the constructor of the base class after the pretrained model weights have been loaded. timm_backboneN)backbonezbackbone_type z not supported.) rK__init__rMrrrkr_init_timm_backbone_init_transformers_backboner5)r"r_r`rnrOs rrpzBackboneMixin.__init__s $)&) ?D9  $!-!2!2D !-!:!:D    !2!2 2  $ $m $ <   <#<#< <  , , .~d.@.@-AQR Rrc8t|t|y)a Override `post_init` to always install capturing hooks, as backbone will ALWAYS capture outputs. We need to do it in `post_init`, as modules need to be already instantiated. It avoids some mixups with `torch.compile`, as the first hook installation will need/create a graph break, which can clash with external user call such as `model = torch.compile(model...)`. N)rK post_initr)r"rOs rrtzBackboneMixin.post_inits %d+rcpt|jdd}t|jdd}|jjDcgc]}|d c}|_|jjDcgc]}|d c}|_t |jj}|jj}|||k7rtd|d|||jk7rtd|d |j|j_|jj||ycc}wcc}w) zj Initialize the backbone model from timm. The backbone must already be loaded to backbone rNr modulenum_chsz!Config has `out_features` set to z which doesn't match `out_features` from backbone's feature_info. Please check if your checkpoint has correct out features/indices saved.z Config has `stage_names` set to z which doesn't match `stage_names` from backbone's feature_info. Please check if your checkpoint has correct `stage_names` saved.) r\r] feature_infoinfor num_featuresrr module_namer5r%)r"roout_features_from_configstage_names_from_configstagerrs rrqz!BackboneMixin._init_timm_backbones: $+4;;#M ")$++}d"K :B9N9N9S9STE(OT;C;P;P;U;UV%U9-V800<<= ,,88: # /4LP\4\34L3MNxx  # .3JdN^N^3^23J2KLqq  #'"2"2  66|[Q)UVs  D.3 D3c||jj|_|jjd|_yr()r]r rrzrAs rrrz)BackboneMixin._init_transformers_backbones,;;22 335 rc.|jjSr()r]rrAs rrzBackboneMixin.out_featuress{{(((rrc&||j_y)rCN)r]rrEs rrzBackboneMixin.out_featuress $0  rc.|jjSr()r]rrAs rrzBackboneMixin.out_indices s{{'''rrc&||j_y)rHN)r]rrIs rrzBackboneMixin.out_indicess #. rczt|jDcic]\}}||j|c}}Scc}}wr() enumerater rz)r"ir~s rout_feature_channelsz"BackboneMixin.out_feature_channelss8=FdFVFV config_classbackbone_model_types r%consolidate_backbone_kwargs_to_configr4s6+ #6=jj!2B7O)/J)?)Kvzz*%QaH JJ($/ '    #9.9c8cObc( F ""'  /"9 x -==hGNK)+l*CDL    /*9[9O F "">n_=cxcSbcO F ""  %8%D UViUjjz { !6 ;=.)<=V@UV F "" OT *-11,?%&9: &00A F ""rc|ddlm}t|dd}||j|}|S|j|}|S)a> Loads the backbone model from a config object. If the config is from the backbone model itself, then we return a backbone model with randomly initialized weights. If the config is from the parent model of the backbone model itself, then we load the pretrained backbone weights if specified. r) AutoBackbonerN)r])r rr\ from_config)r]rrros r load_backbonerfsP*f&7>O++6+: O ++?+C Or)NNNN)rPenumrfrhuggingface_hubrutilsrutils.output_capturingr get_loggerr rEnumrrrhrjrSrrrrrrrsH 'A   H %"499" zzz*|]|]B$(&*)-'+ /#Dj/#t/# $; /#  /#dr