Huawei’s TinyBERT Is 7X Smaller and 9X Faster Than BERT | Synced

Researchers from the Huazhong University of Science and Technology and Huawei Noah’s Ark Lab have introduced TinyBERT, a smaller and faster version of Google’s popular large-scale pre-trained langu...

By · · 1 min read

Source: Synced | AI Technology & Industry Review

Researchers from the Huazhong University of Science and Technology and Huawei Noah’s Ark Lab have introduced TinyBERT, a smaller and faster version of Google’s popular large-scale pre-trained language processing model BERT.