ZF/vit-pytorch
1
0
Fork 0
mirror of https://github.com/lucidrains/vit-pytorch.git synced 2025-12-30 08:02:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b194359301459ea0ef379f5c701f037cdcc68412
vit-pytorch/vit_pytorch
History
Phil Wang b194359301 add a simple vit with qknorm, since authors seem to be promoting the technique on twitter
2023-08-14 07:58:45 -07:00
..
__init__.py
enforce latest einops
2023-05-08 09:34:14 -07:00
ats_vit.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
cait.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
cct_3d.py
add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1
2022-10-29 11:35:06 -07:00
cct.py
add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1
2022-10-29 11:35:06 -07:00
cross_vit.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
crossformer.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
cvt.py
add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss
2022-05-03 10:29:29 -07:00
deepvit.py
adopt dual patchnorm paper for as many vit as applicable, release 1.0.0
2023-02-03 08:11:29 -08:00
dino.py
implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino
2021-05-02 14:00:36 -07:00
distill.py
fix hard distillation, thanks to @CiaoHe
2021-08-12 08:40:57 -07:00
efficient.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
es_vit.py
add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss
2022-05-03 10:29:29 -07:00
extractor.py
offer way for extractor to return latents without detaching them
2022-07-16 16:22:40 -07:00
learnable_memory_vit.py
seeing a signal with dual patchnorm in another repository, fully incorporate
2023-02-06 09:45:12 -08:00
levit.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
local_vit.py
adopt dual patchnorm paper for as many vit as applicable, release 1.0.0
2023-02-03 08:11:29 -08:00
mae.py
Support SimpleViT as encoder in MAE (#272)
2023-07-24 06:43:01 -07:00
max_vit.py
follow @arquolo feedback and advice for MaxViT
2022-06-29 08:53:09 -07:00
mobile_vit.py
Improving Readability (#220)
2022-10-17 10:42:45 -07:00
mp3.py
separate a simple vit from mp3, so that simple vit can be used after being pretrained
2023-03-07 19:31:10 -08:00
mpp.py
fix mpp
2023-06-28 08:02:43 -07:00
na_vit.py
wrap up NaViT
2023-07-25 10:38:55 -07:00
nest.py
adopt dual patchnorm paper for as many vit as applicable, release 1.0.0
2023-02-03 08:11:29 -08:00
parallel_vit.py
correct need for post-attention dropout
2022-03-30 10:50:57 -07:00
pit.py
correct need for post-attention dropout
2022-03-30 10:50:57 -07:00
recorder.py
return None from extractor if no attention layers
2022-01-28 17:49:58 -08:00
regionvit.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
rvt.py
correct need for post-attention dropout
2022-03-30 10:50:57 -07:00
scalable_vit.py
do not layernorm on last transformer block for scalable vit, as there is already one in mlp head
2022-03-31 13:25:21 -07:00
sep_vit.py
let windowed tokens exchange information across heads a la talking heads prior to pointwise attention in sep-vit
2022-03-31 15:22:24 -07:00
simmim.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
simple_flash_attn_vit.py
add a version of simple vit using flash attention
2023-03-18 09:41:39 -07:00
simple_vit_1d.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_3d.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_with_patch_dropout.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_with_qk_norm.py
add a simple vit with qknorm, since authors seem to be promoting the technique on twitter
2023-08-14 07:58:45 -07:00
simple_vit.py
fix linear head in simple vit, thanks to @atkos
2023-08-10 14:36:21 -07:00
t2t.py
Make model process any scale image
2021-08-21 22:35:26 +09:00
twins_svt.py
seeing a signal with dual patchnorm in another repository, fully incorporate
2023-02-06 09:45:12 -08:00
vit_1d.py
adopt dual patchnorm paper for as many vit as applicable, release 1.0.0
2023-02-03 08:11:29 -08:00
vit_3d.py
adopt dual patchnorm paper for as many vit as applicable, release 1.0.0
2023-02-03 08:11:29 -08:00
vit_for_small_dataset.py
correct need for post-attention dropout
2022-03-30 10:50:57 -07:00
vit_with_patch_dropout.py
add vit with patch dropout, fully embrace structured dropout as multiple papers are now corroborating each other
2022-12-02 11:28:11 -08:00
vit_with_patch_merger.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
vit.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
vivit.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00