9 Commits

Author	SHA1	Message	Date
Phil Wang	5699ed7d13	double down on dual patch norm, fix MAE and Simmim to be compatible with dual patchnorm	2023-02-10 10:39:50 -08:00
Phil Wang	1bae5d3cc5	allow for rectangular images for efficient adapter	2022-01-31 08:55:31 -08:00
Phil Wang	6af7bbcd11	make sure distillation still works	2021-02-21 19:08:18 -08:00
Phil Wang	59787a6b7e	allow for mean pool with efficient version too	2020-12-23 18:15:40 -08:00
Phil Wang	9624181940	simplify mlp head	2020-12-07 14:31:50 -08:00
Phil Wang	dc5b89c942	use einops repeat	2020-10-28 18:13:57 -07:00
Phil Wang	7a214d7109	allow for training on different image sizes, provided images are smaller than what was passed as image_size keyword on init	2020-10-25 13:17:42 -07:00
Phil Wang	a0fa41070f	norm cls token before sending to mlp head	2020-10-10 12:08:42 -07:00
Phil Wang	b298031c17	write up example for using efficient transformers	2020-10-07 19:15:21 -07:00