Phil Wang c7bb5fc43f maxvit intent to build (#211) ...

complete hybrid mbconv + block / grid efficient self attention MaxViT

2022-04-06 16:12:17 -07:00

..

__init__.py

release masked autoencoder

2021-11-12 20:08:48 -08:00

ats_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

cait.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

cct.py

CCT allow for rectangular images

2022-03-26 14:02:49 -07:00

cross_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

crossformer.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

cvt.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

deepvit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

dino.py

implement SOTA new self-supervised learning technique from facebook for vision transformers, Dino

2021-05-02 14:00:36 -07:00

distill.py

fix hard distillation, thanks to @CiaoHe

2021-08-12 08:40:57 -07:00

efficient.py

allow for rectangular images for efficient adapter

2022-01-31 08:55:31 -08:00

extractor.py

add ViT for small datasets https://arxiv.org/abs/2112.13492

2021-12-28 10:58:21 -08:00

learnable_memory_vit.py

complete learnable memory ViT, for efficient fine-tuning and potentially plays into continual learning

2022-03-31 09:51:12 -07:00

levit.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

local_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

mae.py

decoder positional embedding needs to be reapplied https://twitter.com/giffmana/status/1479195631587631104

2022-01-06 13:14:41 -08:00

max_vit.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

mobile_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

mpp.py

fix mpp

2021-06-16 16:46:32 -07:00

nest.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

parallel_vit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

pit.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

recorder.py

return None from extractor if no attention layers

2022-01-28 17:49:58 -08:00

regionvit.py

maxvit intent to build (#211)

2022-04-06 16:12:17 -07:00

rvt.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

scalable_vit.py

do not layernorm on last transformer block for scalable vit, as there is already one in mlp head

2022-03-31 13:25:21 -07:00

sep_vit.py

let windowed tokens exchange information across heads a la talking heads prior to pointwise attention in sep-vit

2022-03-31 15:22:24 -07:00

simmim.py

add SimMIM

2021-11-21 15:50:19 -08:00

t2t.py

Make model process any scale image

2021-08-21 22:35:26 +09:00

twins_svt.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit_for_small_dataset.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit_with_patch_merger.py

correct need for post-attention dropout

2022-03-30 10:50:57 -07:00

vit.py

complete learnable memory ViT, for efficient fine-tuning and potentially plays into continual learning

2022-03-31 09:51:12 -07:00