ZF/vit-pytorch
1
0
Fork 0
mirror of https://github.com/lucidrains/vit-pytorch.git synced 2025-12-30 08:02:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
1616288e30a0fd0d0fd5c2615ff38021df6c74d2
vit-pytorch/vit_pytorch
History
Phil Wang 1616288e30 add xcit (#284) 
* add xcit

* use Rearrange layers

* give cross correlation transformer a final norm at end

* document
2023-10-13 09:15:13 -07:00
..
__init__.py
enforce latest einops
2023-05-08 09:34:14 -07:00
ats_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
cait.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
cct_3d.py
add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1
2022-10-29 11:35:06 -07:00
cct.py
add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1
2022-10-29 11:35:06 -07:00
cross_vit.py
address https://github.com/lucidrains/vit-pytorch/issues/279
2023-09-10 09:32:57 -07:00
crossformer.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
cvt.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
deepvit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
dino.py
implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino
2021-05-02 14:00:36 -07:00
distill.py
fix hard distillation, thanks to @CiaoHe
2021-08-12 08:40:57 -07:00
efficient.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
es_vit.py
add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss
2022-05-03 10:29:29 -07:00
extractor.py
offer way for extractor to return latents without detaching them
2022-07-16 16:22:40 -07:00
learnable_memory_vit.py
seeing a signal with dual patchnorm in another repository, fully incorporate
2023-02-06 09:45:12 -08:00
levit.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
local_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
mae.py
Support SimpleViT as encoder in MAE (#272)
2023-07-24 06:43:01 -07:00
max_vit_with_registers.py
give a learned bias to and from registers for maxvit + register token variant
2023-10-06 10:40:26 -07:00
max_vit.py
improvise a max vit with register tokens
2023-10-06 10:27:36 -07:00
mobile_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
mp3.py
separate a simple vit from mp3, so that simple vit can be used after being pretrained
2023-03-07 19:31:10 -08:00
mpp.py
fix mpp
2023-06-28 08:02:43 -07:00
na_vit.py
wrap up NaViT
2023-07-25 10:38:55 -07:00
nest.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
parallel_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
pit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
recorder.py
return None from extractor if no attention layers
2022-01-28 17:49:58 -08:00
regionvit.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
rvt.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
scalable_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
sep_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
simmim.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
simple_flash_attn_vit.py
add a version of simple vit using flash attention
2023-03-18 09:41:39 -07:00
simple_vit_1d.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_3d.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_with_patch_dropout.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_with_qk_norm.py
add a simple vit with qknorm, since authors seem to be promoting the technique on twitter
2023-08-14 07:58:45 -07:00
simple_vit_with_register_tokens.py
document in readme later
2023-10-03 09:26:02 -07:00
simple_vit.py
fix linear head in simple vit, thanks to @atkos
2023-08-10 14:36:21 -07:00
t2t.py
Make model process any scale image
2021-08-21 22:35:26 +09:00
twins_svt.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_1d.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_3d.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_for_small_dataset.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_with_patch_dropout.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_with_patch_merger.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
vit.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
vivit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
xcit.py
add xcit (#284)
2023-10-13 09:15:13 -07:00