Commit Graph

Select branches

Hide Pull Requests

levit

main

xcit

#101

#102

#105

#118

#128

#144

#145

#146

#147

#150

#151

#153

#155

#157

#162

#170

#173

#173

#181

#186

#210

#211

#212

#216

#216

#220

#231

#242

#260

#264

#265

#272

#273

#274

#283

#284

#285

#290

#290

#301

#301

#303

#31

#313

#313

#317

#317

#318

#318

#323

#323

#324

#324

#325

#326

#327

#333

#334

#334

#338

#338

#339

#341

#343

#343

#346

#350

#353

#354

#355

#4

#51

#66

#7

#87

#88

#91

0.0.1

0.0.2

0.0.3

0.0.4

0.0.5

0.1.0

0.10.1

0.10.2

0.10.3

0.11.0

0.11.1

0.12.0

0.14.0

0.14.1

0.14.2

0.14.3

0.14.4

0.14.5

0.15.0

0.15.1

0.15.2

0.16.0

0.16.1

0.16.10

0.16.11

0.16.12

0.16.13

0.16.2

0.16.3

0.16.4

0.16.5

0.16.6

0.16.7

0.16.8

0.16.9

0.17.0

0.17.1

0.17.2

0.17.3

0.18.0

0.18.1

0.18.2

0.18.3

0.18.4

0.19.0

0.19.1

0.19.2

0.19.3

0.19.4

0.19.5

0.19.6

0.2.0

0.2.1

0.2.2

0.2.3

0.2.4

0.2.5

0.2.6

0.2.7

0.20.0

0.20.1

0.20.2

0.20.3

0.20.4

0.20.5

0.20.6

0.20.7

0.20.8

0.21.0

0.21.1

0.22.0

0.23.0

0.23.1

0.23.2

0.24.0

0.24.1

0.24.2

0.24.3

0.25.0

0.25.1

0.25.2

0.25.3

0.25.5

0.25.6

0.26.0

0.26.1

0.26.2

0.26.3

0.26.4

0.26.5

0.26.6

0.26.7

0.27.0

0.27.1

0.28.0

0.28.1

0.28.2

0.29.0

0.29.1

0.3.0

0.30.0

0.30.1

0.31.1

0.32.0

0.32.1

0.32.2

0.33.0

0.33.1

0.33.2

0.34.0

0.34.1

0.35.0

0.35.1

0.35.2

0.36.0

0.36.1

0.36.2

0.37.0

0.37.1

0.38.0

0.38.1

0.39.0

0.39.1

0.4.0

0.40.0

0.40.1

0.40.2

0.5.0

0.5.1

0.6.0

0.6.1

0.6.2

0.6.3

0.6.4

0.6.5

0.6.7

0.6.8

0.7.0

0.7.1

0.7.2

0.7.3

0.7.4

0.7.5

0.7.6

0.8.0

0.9.0

0.9.1

0.9.2

0.9.3

1.0.0

1.0.1

1.0.2

1.1.0

1.1.1

1.10.0

1.10.1

1.11.0

1.11.1

1.11.2

1.11.3

1.11.4

1.11.5

1.11.6

1.11.7

1.12.0

1.12.1

1.12.2

1.12.3

1.12.4

1.12.5

1.14.0

1.14.1

1.14.2

1.14.4

1.14.5

1.15.0

1.15.1

1.15.2

1.15.3

1.15.4

1.15.5

1.15.6

1.15.7

1.16.0

1.16.1

1.16.2

1.16.3

1.16.4

1.16.5

1.17.0

1.17.1

1.2.0

1.2.1

1.2.2

1.2.4

1.2.5

1.2.6

1.2.7

1.2.8

1.2.9

1.4.0

1.4.1

1.4.2

1.4.3

1.4.4

1.4.5

1.5.0

1.5.0a

1.5.1

1.5.2

1.5.3

1.6.0

1.6.1

1.6.2

1.6.3a

1.6.4

1.6.5

1.6.6

1.6.7

1.6.8

1.6.9

1.7.0

1.7.1

1.7.10

1.7.11

1.7.12

1.7.14

1.7.2

1.7.3

1.7.4

1.7.5

1.7.6

1.7.7

1.7.8

1.7.9

1.8.0

1.8.1

1.8.2

1.8.3

1.8.4

1.8.5

1.8.6

1.8.7

1.8.8

1.8.9

1.9.0

1.9.1

1.9.2

v0.35.3

v0.35.4

v0.35.5

v0.35.6

v0.35.7

v0.35.8

Mono Color

• 34e6284f95 Update README.md Phil Wang 2020-12-24 10:58:41 -08:00
• aa9ed249a3 add knowledge distillation with distillation tokens, in light of new finding from facebook ai 0.6.0 Phil Wang 2020-12-24 10:39:15 -08:00
• ea0924ec96 update readme Phil Wang 2020-12-23 19:06:48 -08:00
• 59787a6b7e allow for mean pool with efficient version too 0.5.1 Phil Wang 2020-12-23 18:15:40 -08:00
• 24339644ca offer a way to use mean pooling of last layer 0.5.0 Phil Wang 2020-12-23 17:23:58 -08:00
• b786029e18 fix the dimension per head to be independent of dim and heads, to make sure users do not have it be too small to learn anything 0.4.0 Phil Wang 2020-12-17 07:43:52 -08:00
• 9624181940 simplify mlp head 0.3.0 Phil Wang 2020-12-07 14:31:50 -08:00
• a656a213e6 update diagram Phil Wang 2020-12-04 12:26:28 -08:00
• f1deb5fb7e Merge pull request #31 from minhlong94/main Phil Wang 2020-11-21 08:05:38 -08:00
• 3f50dd72cf Update README.md Long M. Lưu 2020-11-21 18:37:03 +07:00
• ee5e4e9929 Update vit_pytorch.py Long M. Lưu 2020-11-21 18:23:04 +07:00
• 6c8dfc185e remove float(-inf) as masking value 0.2.7 Phil Wang 2020-11-13 12:25:21 -08:00
• 4f84ad7a64 authors are now known Phil Wang 2020-11-03 14:28:20 -08:00
• c74bc781f0 cite Phil Wang 2020-11-03 11:59:05 -08:00
• dc5b89c942 use einops repeat Phil Wang 2020-10-28 18:13:57 -07:00
• c1043ab00c update readme Phil Wang 2020-10-26 19:01:03 -07:00
• 7a214d7109 allow for training on different image sizes, provided images are smaller than what was passed as image_size keyword on init 0.2.6 Phil Wang 2020-10-25 13:17:42 -07:00
• 6d1df1a970 more efficient 0.2.5 Phil Wang 2020-10-22 22:37:06 -07:00
• d65a8c17a5 remove dropout from last linear to logits 0.2.4 Phil Wang 2020-10-16 13:58:23 -07:00
• f7c164d910 assert minimum number of patches 0.2.3 Phil Wang 2020-10-16 12:19:50 -07:00
• c7b74e0bc3 rename ipy notebook Phil Wang 2020-10-14 10:35:46 -07:00
• 5b5d98a3a7 dropouts are more specific and aggressive in the paper, thanks for letting me know @hila-chefer Phil Wang 2020-10-14 05:48:27 -07:00
• 35796104b0 dropouts are more specific and aggressive in the paper, thanks for letting me know @hilach70 0.2.2 Phil Wang 2020-10-14 05:48:27 -07:00
• b0e4790c24 bump package 0.2.1 Phil Wang 2020-10-13 13:12:19 -07:00
• 0b2b3fc20c add dropouts Phil Wang 2020-10-13 13:11:32 -07:00
• ced464dcb4 Update setup.py Phil Wang 2020-10-11 00:06:26 -07:00
• 5bf45a2d4d Merge pull request #4 from adimyth/main Phil Wang 2020-10-10 19:12:31 -07:00
• fa32e22855 adds a classification example using 'cats & dogs' data adimyth 2020-10-11 03:15:19 +05:30
• a0fa41070f norm cls token before sending to mlp head 0.2.0 Phil Wang 2020-10-10 12:08:42 -07:00
• b298031c17 write up example for using efficient transformers Phil Wang 2020-10-07 19:15:21 -07:00
• ee1cbbadec write up example for using efficient transformers 0.1.0 Phil Wang 2020-10-07 19:13:25 -07:00
• d66b29e4cf cleanup stray print 0.0.5 Phil Wang 2020-10-07 11:22:45 -07:00
• f7123720c3 add masking 0.0.4 Phil Wang 2020-10-07 11:21:03 -07:00
• f5fffd9e2e remove extraneous line Phil Wang 2020-10-04 15:22:26 -07:00
• 8fb261ca66 fix a bug and add suggestion for BYOL pre-training 0.0.3 Phil Wang 2020-10-04 14:55:29 -07:00
• 112ba5c476 update with link to Yannics video Phil Wang 2020-10-04 13:53:47 -07:00
• f899226d4f add diagram Phil Wang 2020-10-04 12:47:08 -07:00
• 825a9484d1 small bug fix 0.0.2 Phil Wang 2020-10-04 12:39:51 -07:00
• ee8088b3ea first commit 0.0.1 Phil Wang 2020-10-04 12:34:44 -07:00
• 070469d0ac Create python-publish.yml Phil Wang 2020-10-04 12:34:30 -07:00
• ea03db32f0 Update README.md Phil Wang 2020-10-03 15:49:27 -07:00
• 30362d50dc Update README.md Phil Wang 2020-10-03 15:49:02 -07:00
• efb40e0b01 Initial commit Phil Wang 2020-10-03 15:47:26 -07:00