Phil Wang cb6d749821 add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

..

__init__.py

add simple vit, from https://arxiv.org/abs/2205.01580

2022-05-03 20:24:14 -07:00

ats_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

cait.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

cct_3d.py

add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

cct.py

add a 3d version of cct, addressing https://github.com/lucidrains/vit-pytorch/issues/238 0.38.1

2022-10-29 11:35:06 -07:00

cross_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

crossformer.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

cvt.py

add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

2022-05-03 10:29:29 -07:00

deepvit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

dino.py

implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino

2021-05-02 14:00:36 -07:00

distill.py

fix hard distillation, thanks to @CiaoHe

2021-08-12 08:40:57 -07:00

efficient.py

allow for rectangular images for efficient adapter

2022-01-31 08:55:31 -08:00

es_vit.py

add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss

2022-05-03 10:29:29 -07:00

extractor.py

offer way for extractor to return latents without detaching them

2022-07-16 16:22:40 -07:00

learnable_memory_vit.py

complete learnable memory ViT, for efficient fine-tuning and potentially plays into continual learning

2022-03-31 09:51:12 -07:00

levit.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

local_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

mae.py

Update mae.py (#242)

2022-10-17 10:41:10 -07:00

max_vit.py

follow @arquolo feedback and advice for MaxViT

2022-06-29 08:53:09 -07:00

mobile_vit.py

Improving Readability (#220)

2022-10-17 10:42:45 -07:00

mpp.py

fix mpp

2021-06-16 16:46:32 -07:00

nest.py

Improving Readability (#220)

2022-10-17 10:42:45 -07:00

parallel_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

pit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

recorder.py

return None from extractor if no attention layers

2022-01-28 17:49:58 -08:00

regionvit.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

rvt.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

scalable_vit.py

do not layernorm on last transformer block for scalable vit, as there is already one in mlp head

2022-03-31 13:25:21 -07:00

sep_vit.py

let windowed tokens exchange information across heads a la talking heads prior to pointwise attention in sep-vit

2022-03-31 15:22:24 -07:00

simmim.py

add SimMIM

2021-11-21 15:50:19 -08:00

simple_vit_3d.py

make sure global average pool can be used for vivit in place of cls token

2022-10-24 19:59:48 -07:00

simple_vit.py

add simple vit, from https://arxiv.org/abs/2205.01580

2022-05-03 20:24:14 -07:00

t2t.py

Make model process any scale image

2021-08-21 22:35:26 +09:00

twins_svt.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit_3d.py

make sure global average pool can be used for vivit in place of cls token

2022-10-24 19:59:48 -07:00

vit_for_small_dataset.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit_with_patch_merger.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit.py

slightly more clear of einops rearrange for cls token, for https://github.com/lucidrains/vit-pytorch/issues/224

2022-06-30 08:11:17 -07:00

vivit.py

make sure global average pool can be used for vivit in place of cls token

2022-10-24 19:59:48 -07:00