vit-pytorch

__init__.py

no longer needed with einops 0.7

2023-10-19 18:16:46 -07:00

ats_vit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

cait.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

cct_3d.py

add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

cct.py

add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

cross_vit.py

address https://github.com/lucidrains/vit-pytorch/issues/304

2024-04-17 09:40:03 -07:00

crossformer.py

maxvit intent to build (#211 )

2022-04-06 16:12:17 -07:00

cvt.py

allow channels to be customizable for cvt

2023-10-25 14:47:58 -07:00

deepvit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

dino.py

implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino

2021-05-02 14:00:36 -07:00

distill.py

fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit

2024-06-11 15:12:53 -07:00

efficient.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

es_vit.py

add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

2022-05-03 10:29:29 -07:00

extractor.py

offer way for extractor to return latents without detaching them

2022-07-16 16:22:40 -07:00

learnable_memory_vit.py

seeing a signal with dual patchnorm in another repository, fully incorporate

2023-02-06 09:45:12 -08:00

levit.py

maxvit intent to build (#211 )

2022-04-06 16:12:17 -07:00

local_vit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

look_vit.py

attention re-use in lookup vit should use pre-softmax attention matrix

2024-07-19 19:23:38 -07:00

mae.py

Support SimpleViT as encoder in MAE (#272 )

2023-07-24 06:43:01 -07:00

max_vit_with_registers.py

give a learned bias to and from registers for maxvit + register token variant

2023-10-06 10:40:26 -07:00

max_vit.py

improvise a max vit with register tokens

2023-10-06 10:27:36 -07:00

mobile_vit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

mp3.py

separate a simple vit from mp3, so that simple vit can be used after being pretrained

2023-03-07 19:31:10 -08:00

mpp.py

fix mpp

2023-06-28 08:02:43 -07:00

na_vit_nested_tensor_3d.py

fix tests

2024-11-10 09:43:54 -08:00

na_vit_nested_tensor.py

fix tests

2024-11-10 09:43:54 -08:00

na_vit.py

Nested navit (#325 )

2024-08-20 15:12:29 -07:00

nest.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

normalized_vit.py

fix multiheaded qk rmsnorm in nViT

2024-10-10 19:15:17 -07:00

parallel_vit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

pit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

recorder.py

return None from extractor if no attention layers

2022-01-28 17:49:58 -08:00

regionvit.py

address https://github.com/lucidrains/vit-pytorch/issues/330

2024-10-04 07:01:48 -07:00

rvt.py

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

2024-10-09 07:32:25 -07:00

scalable_vit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

sep_vit.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

simmim.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

simple_flash_attn_vit_3d.py

address https://github.com/lucidrains/vit-pytorch/issues/300

2024-05-02 08:46:39 -07:00

simple_flash_attn_vit.py

add a version of simple vit using flash attention

2023-03-18 09:41:39 -07:00

simple_uvit.py

add the u-vit implementation with simple vit + register tokens

2024-08-07 08:45:57 -07:00

simple_vit_1d.py

address https://github.com/lucidrains/vit-pytorch/pull/274

2023-08-09 07:53:38 -07:00

simple_vit_3d.py

address https://github.com/lucidrains/vit-pytorch/pull/274

2023-08-09 07:53:38 -07:00

simple_vit_with_fft.py

address https://github.com/lucidrains/vit-pytorch/issues/292

2023-12-23 08:11:39 -08:00

simple_vit_with_patch_dropout.py

address https://github.com/lucidrains/vit-pytorch/pull/274

2023-08-09 07:53:38 -07:00

simple_vit_with_qk_norm.py

add a simple vit with qknorm, since authors seem to be promoting the technique on twitter

2023-08-14 07:58:45 -07:00

simple_vit_with_register_tokens.py

document in readme later

2023-10-03 09:26:02 -07:00

simple_vit_with_value_residual.py

fix value residual

2024-10-31 06:48:24 -07:00

simple_vit.py

fix linear head in simple vit, thanks to @atkos

2023-08-10 14:36:21 -07:00

t2t.py

fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit

2024-06-11 15:12:53 -07:00

twins_svt.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

vit_1d.py

Fix typo in LayerNorm (#285 )

2023-10-24 12:47:21 -07:00

vit_3d.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

vit_for_small_dataset.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

vit_with_patch_dropout.py

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point

2023-08-14 09:48:55 -07:00

vit_with_patch_merger.py

address https://github.com/lucidrains/vit-pytorch/pull/274

2023-08-09 07:53:38 -07:00

vit.py

address https://github.com/lucidrains/vit-pytorch/pull/274

2023-08-09 07:53:38 -07:00

vivit.py

Add ViViT variant with factorized self-attention (#327 )

2024-08-21 19:23:38 -07:00

xcit.py

add xcit (#284 )

2023-10-13 09:15:13 -07:00