ZF/vit-pytorch
1
0
Fork 0
mirror of https://github.com/lucidrains/vit-pytorch.git synced 2025-12-30 08:02:29 +00:00
Code Issues Packages Projects Releases Wiki Activity

Tested and changed README format

Browse Source
This commit is contained in:
Steven Walton
2021-07-01 16:26:41 -07:00
parent 88451068e8
commit 780f91a220
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -119,7 +119,8 @@ type(v) # <class 'vit_pytorch.vit_pytorch.ViT'>
```
## CCT
<img src="https://raw.githubusercontent.com/SHI-Labs/Compact-Transformers/main/images/model_sym.png" width="400px"></img>
<a hred="https://arxiv.org/abs/2104.05704">CCT</a> proposes compact transformers
<a href="https://arxiv.org/abs/2104.05704">CCT</a> proposes compact transformers
by using convolutions instead of patching and performing sequence pooling. This
allows for CCT to have high accuracy and a low number of parameters.