Skip to contents

Base Models

Model PyTorch Tensorflow Weight Sharing
BERT Yes Yes Yes
RoBERTa Yes Yes Yes
DeBERTa Yes Yes Yes
Funnel Transformer Yes Yes Yes
Longformer Yes Yes Yes
MPNet Yes Yes No

Feature Extractors

Model PyTorch Tensorflow Weight Sharing
Dense Yes No No
LSTM Yes No No
Convolutional Yes No No

Classifiers

Model PyTorch Tensorflow Weight Sharing
Regular Yes partly No
ProtoNet Yes No No