26 Commits

Author	SHA1	Message	Date
lucidrains	51310d1d07	add xcit diagram	2023-10-13 09:18:12 -07:00
Phil Wang	23820bc54a	begin work on NaViT (#273) ... finish core idea of NaViT	2023-07-24 13:54:02 -07:00
Srikumar Sastry	4218556acd	Add Masked Position Prediction (#260) ... * Create mp3.py * Implementation: Position Prediction as an Effective Pretraining Strategy * Added description for Masked Position Prediction * MP3 image added	2023-03-07 14:28:40 -08:00
Phil Wang	13fabf901e	add vivit	2022-10-24 09:34:04 -07:00
Phil Wang	4ef72fc4dc	add EsViT, by popular request, an alternative to Dino that is compatible with efficient ViTs with accounting for regional self-supervised loss	2022-05-03 10:29:29 -07:00
Phil Wang	c7bb5fc43f	maxvit intent to build (#211) ... complete hybrid mbconv + block / grid efficient self attention MaxViT	2022-04-06 16:12:17 -07:00
Phil Wang	d65a742efe	intent to build (#210) ... complete SepViT, from bytedance AI labs	2022-03-31 14:30:23 -07:00
Phil Wang	df656fe7c7	complete learnable memory ViT, for efficient fine-tuning and potentially plays into continual learning	2022-03-31 09:51:12 -07:00
Phil Wang	2aae406ce8	add proposed parallel vit from facebook ai for exploration purposes	2022-03-23 10:42:35 -07:00
Phil Wang	d27721a85a	add scalable vit, from bytedance AI	2022-03-22 17:02:47 -07:00
Phil Wang	6db20debb4	add patch merger	2022-03-01 16:50:17 -08:00
Phil Wang	70ba532599	add ViT for small datasets https://arxiv.org/abs/2112.13492	2021-12-28 10:58:21 -08:00
murufeng	5ea1559e4c	Add files via upload	2021-12-21 20:41:01 +08:00
Phil Wang	365b4d931e	add adaptive token sampling paper	2021-12-03 19:52:40 -08:00
Phil Wang	de0b8ba189	additional diagram	2021-11-22 14:05:39 -08:00
Phil Wang	5b2382f9f0	intent to add	2021-11-22 12:00:03 -08:00
Phil Wang	5ae555750f	add SimMIM	2021-11-21 15:50:19 -08:00
Phil Wang	e8f6d72033	release masked autoencoder	2021-11-12 20:08:48 -08:00
Phil Wang	06d375351e	add RegionViT paper	2021-11-07 09:47:28 -08:00
Phil Wang	daf3abbeb5	add NesT	2021-05-27 22:02:17 -07:00
Phil Wang	74b402377b	add image	2021-05-02 15:40:53 -07:00
Phil Wang	ab781f7ddb	add Twins SVT (small)	2021-04-29 14:54:06 -07:00
Phil Wang	db04c0f319	fix images	2021-04-06 13:37:23 -07:00
Phil Wang	9ef8da4759	add CaiT, new vision transformer out of facebook AI, complete with layerscale, talking heads, and cls -> patch cross attention	2021-03-31 22:42:16 -07:00
Phil Wang	506fcf83a6	add documentation for three recent vision transformer follow-up papers	2021-03-31 09:22:15 -07:00
Phil Wang	ab7315cca1	cleanup	2021-03-27 22:14:16 -07:00