ZF/vit-pytorch
1
0
Fork 0
mirror of https://github.com/lucidrains/vit-pytorch.git synced 2025-12-30 08:02:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c4651a35a3ca7eb8a8e10ce7c37fa9bcaf9365ac
vit-pytorch/vit_pytorch
History
roydenwa 9d43e4d0bb Add ViViT variant with factorized self-attention (#327) 
* Add FactorizedTransformer

* Add variant param and check in fwd method

* Check if variant is implemented

* Describe new ViViT variant
2024-08-21 19:23:38 -07:00
..
__init__.py
no longer needed with einops 0.7
2023-10-19 18:16:46 -07:00
ats_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
cait.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
cct_3d.py
add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1
2022-10-29 11:35:06 -07:00
cct.py
add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1
2022-10-29 11:35:06 -07:00
cross_vit.py
address https://github.com/lucidrains/vit-pytorch/issues/304
2024-04-17 09:40:03 -07:00
crossformer.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
cvt.py
allow channels to be customizable for cvt
2023-10-25 14:47:58 -07:00
deepvit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
dino.py
implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino
2021-05-02 14:00:36 -07:00
distill.py
fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit
2024-06-11 15:12:53 -07:00
efficient.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
es_vit.py
add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss
2022-05-03 10:29:29 -07:00
extractor.py
offer way for extractor to return latents without detaching them
2022-07-16 16:22:40 -07:00
learnable_memory_vit.py
seeing a signal with dual patchnorm in another repository, fully incorporate
2023-02-06 09:45:12 -08:00
levit.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
local_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
look_vit.py
attention re-use in lookup vit should use pre-softmax attention matrix
2024-07-19 19:23:38 -07:00
mae.py
Support SimpleViT as encoder in MAE (#272)
2023-07-24 06:43:01 -07:00
max_vit_with_registers.py
give a learned bias to and from registers for maxvit + register token variant
2023-10-06 10:40:26 -07:00
max_vit.py
improvise a max vit with register tokens
2023-10-06 10:27:36 -07:00
mobile_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
mp3.py
separate a simple vit from mp3, so that simple vit can be used after being pretrained
2023-03-07 19:31:10 -08:00
mpp.py
fix mpp
2023-06-28 08:02:43 -07:00
na_vit_nested_tensor_3d.py
3d version of navit nested tensor
2024-08-21 07:23:21 -07:00
na_vit_nested_tensor.py
Nested navit (#325)
2024-08-20 15:12:29 -07:00
na_vit.py
Nested navit (#325)
2024-08-20 15:12:29 -07:00
nest.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
parallel_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
pit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
recorder.py
return None from extractor if no attention layers
2022-01-28 17:49:58 -08:00
regionvit.py
maxvit intent to build (#211)
2022-04-06 16:12:17 -07:00
rvt.py
rotary needs to be done with full precision to be safe
2024-05-11 08:04:32 -07:00
scalable_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
sep_vit.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
simmim.py
double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm
2023-02-10 10:39:50 -08:00
simple_flash_attn_vit_3d.py
address https://github.com/lucidrains/vit-pytorch/issues/300
2024-05-02 08:46:39 -07:00
simple_flash_attn_vit.py
add a version of simple vit using flash attention
2023-03-18 09:41:39 -07:00
simple_uvit.py
add the u-vit implementation with simple vit + register tokens
2024-08-07 08:45:57 -07:00
simple_vit_1d.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_3d.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_with_fft.py
address https://github.com/lucidrains/vit-pytorch/issues/292
2023-12-23 08:11:39 -08:00
simple_vit_with_patch_dropout.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
simple_vit_with_qk_norm.py
add a simple vit with qknorm, since authors seem to be promoting the technique on twitter
2023-08-14 07:58:45 -07:00
simple_vit_with_register_tokens.py
document in readme later
2023-10-03 09:26:02 -07:00
simple_vit.py
fix linear head in simple vit, thanks to @atkos
2023-08-10 14:36:21 -07:00
t2t.py
fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit
2024-06-11 15:12:53 -07:00
twins_svt.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_1d.py
Fix typo in LayerNorm (#285)
2023-10-24 12:47:21 -07:00
vit_3d.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_for_small_dataset.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_with_patch_dropout.py
just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
2023-08-14 09:48:55 -07:00
vit_with_patch_merger.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
vit.py
address https://github.com/lucidrains/vit-pytorch/pull/274
2023-08-09 07:53:38 -07:00
vivit.py
Add ViViT variant with factorized self-attention (#327)
2024-08-21 19:23:38 -07:00
xcit.py
add xcit (#284)
2023-10-13 09:15:13 -07:00