Structural Self-Supervised Objectives for Transformers
Paper
•
2309.08272
•
Published
Luca Di Liello
lucadiliello
AI & ML interests
Applied Scientist II in Amazon AGI
Recent Activity
liked
a model
17 days ago
baidu/ERNIE-4.5-VL-28B-A3B-Thinking
liked
a dataset
17 days ago
nvidia/embed-nemotron-dataset-v1
liked
a model
24 days ago
MiniMaxAI/MiniMax-M2.1
Organizations
None yet
authored
6
papers
almost 2 years ago
Efficient Generation of Structured Objects with Constrained Adversarial Networks
Paper
•
2007.13197
•
Published
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
Paper
•
2205.10455
•
Published
Paragraph-based Transformer Pre-training for Multi-Sentence Inference
Paper
•
2205.01228
•
Published
Context-Aware Transformer Pre-Training for Answer Sentence Selection
Paper
•
2305.15358
•
Published
Efficient pre-training objectives for Transformers
Paper
•
2104.09694
•
Published