vit-pytorch

__init__.py

enforce latest einops

2023-05-08 09:34:14 -07:00

ats_vit.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

cait.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

cct_3d.py

add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

cct.py

add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

cross_vit.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

crossformer.py

maxvit intent to build (#211 )

2022-04-06 16:12:17 -07:00

cvt.py

add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

2022-05-03 10:29:29 -07:00

deepvit.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

dino.py

implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino

2021-05-02 14:00:36 -07:00

distill.py

fix hard distillation, thanks to @CiaoHe

2021-08-12 08:40:57 -07:00

efficient.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

es_vit.py

add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

2022-05-03 10:29:29 -07:00

extractor.py

offer way for extractor to return latents without detaching them

2022-07-16 16:22:40 -07:00

learnable_memory_vit.py

seeing a signal with dual patchnorm in another repository, fully incorporate

2023-02-06 09:45:12 -08:00

levit.py

maxvit intent to build (#211 )

2022-04-06 16:12:17 -07:00

local_vit.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

mae.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

max_vit.py

follow @arquolo feedback and advice for MaxViT

2022-06-29 08:53:09 -07:00

mobile_vit.py

Improving Readability (#220 )

2022-10-17 10:42:45 -07:00

mp3.py

separate a simple vit from mp3, so that simple vit can be used after being pretrained

2023-03-07 19:31:10 -08:00

mpp.py

fix mpp

2021-06-16 16:46:32 -07:00

nest.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

parallel_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

pit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

recorder.py

return None from extractor if no attention layers

2022-01-28 17:49:58 -08:00

regionvit.py

maxvit intent to build (#211 )

2022-04-06 16:12:17 -07:00

rvt.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

scalable_vit.py

do not layernorm on last transformer block for scalable vit, as there is already one in mlp head

2022-03-31 13:25:21 -07:00

sep_vit.py

let windowed tokens exchange information across heads a la talking heads prior to pointwise attention in sep-vit

2022-03-31 15:22:24 -07:00

simmim.py

double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm

2023-02-10 10:39:50 -08:00

simple_flash_attn_vit.py

add a version of simple vit using flash attention

2023-03-18 09:41:39 -07:00

simple_vit_1d.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

simple_vit_3d.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

simple_vit_with_patch_dropout.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

simple_vit.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

t2t.py

Make model process any scale image

2021-08-21 22:35:26 +09:00

twins_svt.py

seeing a signal with dual patchnorm in another repository, fully incorporate

2023-02-06 09:45:12 -08:00

vit_1d.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

vit_3d.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

vit_for_small_dataset.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit_with_patch_dropout.py

add vit with patch dropout, fully embrace structured dropout as multiple papers are now corroborating each other

2022-12-02 11:28:11 -08:00

vit_with_patch_merger.py

seeing a signal with dual patchnorm in another repository, fully incorporate

2023-02-06 09:45:12 -08:00

vit.py

adopt dual patchnorm paper for as many vit as applicable, release 1.0.0

2023-02-03 08:11:29 -08:00

vivit.py

address https://github.com/lucidrains/vit-pytorch/issues/266

2023-05-20 08:24:49 -07:00