Di" d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZ d dl m
Z
m Z m Z d dl
Z
ddlmZ ddlmZmZmZ d d
d d Zd
Z G d de Zdde eef de e deeeef ee f fdZde eef dededdfdZ dde eef de e ddfdZ d de eef de e deddfdZ d de eef de e de ee deddf
dZ y) N)Iterator)contextmanager)Path)AnyOptionalUnion ) ImageFolder)check_integrityextract_archiveverify_str_arg)zILSVRC2012_img_train.tar 1d675b47d978889d74fa0da5fadfb00e)zILSVRC2012_img_val.tar 29b22e2961454d5413ddabcf34fc5622)z ILSVRC2012_devkit_t12.tar.gz fa75699e90414af021442c21a62c3abf)trainvaldevkitzmeta.binc j e Zd ZdZd deeef dededdf fd
Zd dZ e
defd Z defd
Z xZ
S )
ImageNeta< `ImageNet `_ 2012 Classification Dataset.
.. note::
Before using this class, it is required to download ImageNet 2012 dataset from
`here `_ and
place the files ``ILSVRC2012_devkit_t12.tar.gz`` and ``ILSVRC2012_img_train.tar``
or ``ILSVRC2012_img_val.tar`` based on ``split`` in the root directory.
Args:
root (str or ``pathlib.Path``): Root directory of the ImageNet Dataset.
split (string, optional): The dataset split, supports ``train``, or ``val``.
transform (callable, optional): A function/transform that takes in a PIL image or torch.Tensor, depends on the given loader,
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
loader (callable, optional): A function to load an image given its path.
By default, it uses PIL as its image loader, but users could also pass in
``torchvision.io.decode_image`` for decoding image data into tensors directly.
Attributes:
classes (list): List of the class name tuples.
class_to_idx (dict): Dict with items (class_name, class_index).
wnids (list): List of the WordNet IDs.
wnid_to_idx (dict): Dict with items (wordnet_id, class_index).
imgs (list): List of (image path, class_index) tuples
targets (list): The class_index value for each image in the dataset
rootsplitkwargsreturnNc t j j | x}| _ t |dd | _ | j
t | j d }t | $ | j fi | || _ | j | _ | j | _ | j D cg c] }|| c}| _ t | j D ci c] \ }}|D ] }|| c}}}| _
y c c}w c c}}}w )Nr )r r r )ospath
expanduserr r
r parse_archivesload_meta_filesuper__init__ split_folderclasseswnids class_to_idx wnid_to_idx enumerate)
selfr r r wnid_to_classeswnididxclsscls __class__s
_/var/www/pod-logistic/pod-ai/venv/lib/python3.12/site-packages/torchvision/datasets/imagenet.pyr! zImageNet.__init__4 s 77--d33ty#E74DE
(3A6
**5f5 \\
,,:>**E$-E 7@ 7N _ _)#tZ^ _SVS#X _S _ F _s 3 C? Dc t t j j | j t
st
| j t j j | j sK| j dk( rt | j y | j dk( rt | j y y y )Nr r ) r r r joinr META_FILEparse_devkit_archiveisdirr" r parse_train_archiveparse_val_archiver( s r/ r zImageNet.parse_archivesC sy rww||DIIy AB +ww}}T . ./zzW$#DII.u$!$)), % 0 c j t j j | j | j S N)r r r1 r r r7 s r/ r" zImageNet.split_folderM s ww||DIItzz22r8 c : dj di | j S )NzSplit: {split} )format__dict__r7 s r/
extra_reprzImageNet.extra_reprQ s & &&7 77r8 )r )r N)__name__
__module__ __qualname____doc__r strr r r! r propertyr" r?
__classcell__)r. s @r/ r r sd 8
`U39 -
`c
`s
`W[
` - 3c 3 38C 8r8 r r filer c |t }t j j | | }t | rt j |d S d}t |j || )NT) weights_onlyzThe meta file {} is not present in the root directory or is corrupted. This file is automatically created by the ImageNet dataset.) r2 r r r1 r torchload RuntimeErrorr= )r rG msgs r/ r r U s\ |
77<<d #Dt zz$T22
J 3::dD122r8 md5c t t j j | | | s d}t |j || y )Nz{The archive {} is not present in the root directory or is corrupted. You need to download it externally and place it in {}.)r r r r1 rL r= )r rG rN rM s r/ _verify_archiverP d sC 277<<d3S 9
E 3::dD122 :r8 c
ddl m dt dt t t
t f t t t t df f f ffd }dt dt t
fd}t dt t fd }t d }||d }|d
}t | || | 5 }t t j j | | | t j j |d } || \ } }
|| } | D cg c] } | | }
} t j |
|
ft j j | t" ddd yc c} w # 1 sw Y yxY w) aI Parse the devkit archive of the ImageNet2012 classification dataset and save
the meta information in a binary file.
Args:
root (str or ``pathlib.Path``): Root directory containing the devkit archive
file (str, optional): Name of devkit archive. Defaults to
'ILSVRC2012_devkit_t12.tar.gz'
r N devkit_rootr .c t j j | dd }
j |d d }t t | d }t
| D cg c] \ }}|dk( s || }}}t t | d d \ }}}|D cg c] } t | j d }} t || D
ci c] \ }}
||
} }}
t || D
ci c] \ }
} |
|
} }
} | | fS c c}}w c c} w c c}
}w c c} }
w )
Ndatazmeta.matT)
squeeze_mesynsets r z, ) r r r1 loadmatlistzipr' tupler )rR metafilemeta
nums_childrenr+ num_childrenidcsr$ r# r, r* idx_to_wnidr) sios r/ parse_meta_matz,parse_devkit_archive..parse_meta_matx s 77<< VZ@{{8{5i@ S$Z(+
3<]3Ka /c<|_`O`S aa #CJ / 3 eW7>?t5D)*??25dE2BCYS$sDyC C8;E78KL*$4:LLO++ b?CLs
C4)C4!C:
C?
Dc t j j | dd }t | 5 }|j }d d d D cg c]
}t | c}S # 1 sw Y "xY wc c}w )NrT z&ILSVRC2012_validation_ground_truth.txt)r r r1 open readlinesint)rR rG txtfhval_idcsval_idxs r/ parse_val_groundtruth_txtz7parse_devkit_archive..parse_val_groundtruth_txt sZ ww||K1YZ
$Z )5 (H ),45G 55 ) )5s A
A+ A(c 3 K t j } | t j | y # t j | w xY wwr: )tempfilemkdtempshutilrmtree)tmp_dirs r/ get_tmp_dirz)parse_devkit_archive..get_tmp_dir s6 ""$ #M MM' "FMM' "s A 2 A A A r r ILSVRC2012_devkit_t12)scipy.ioiorD r\ dictrh rZ r r ARCHIVE_METArP r r r r1 rJ saver2 )r rG rd rl rs archive_metarN rr rR rb r) rj r+ val_wnidsrc s @r/ r3 r3 m sS ,C ,E$sCx.$sERUWZRZOG[B\2\,] ,6s 6tCy 6 ## # # )L |A
q/CD$$ P' T40':ggll7,CD '5k'B$ _,[919:#[%: :
OY/ dI1NOP P ;
P Ps $A"E Ez$parse_val_archive.. s TeBGGLL51Ts *-)rx r rP r r r1 r sortedr setmkdirr[ rp movebasename)
r rG r$ r| rz rN imagesr* img_filer s
@r/ r6 r6 s &L |A
q/C } t$Q'D$$ww||D&)HBGGLLt,h7
Trzz(?ST
TFE
/
h-./ eV, Xh Hbggll8T277;K;KH;U VWXr8 r: )Nr )NNr ) r rp rn collections.abcr
contextlibr pathlibr typingr r r rJ r| r
utilsr r r
rx r2 r rD r\ rw rZ r rP r3 r5 r6 r< r8 r/ r sq
$ % ' ' C C N IR
;8{ ;8| 3sDy) 3# 3%PTUXZ]U]P^`deh`iPiJj 3 3%T * 3# 3C 3D 33PuS$Y / 3Px} 3PPT 3PlUeCI . Uhsm UTW Ufj U6 jo!X
T
!X"*3-!X?GS ?R!Xcf!X !Xr8