Transformers documentation
Run training on Amazon SageMaker
Get started
Tutorials
Pipelines for inferenceLoad pretrained instances with an AutoClassPreprocessFine-tune a pretrained modelDistributed training with 🤗 AccelerateShare a model
How-to guides
Use tokenizers from 🤗 TokenizersCreate a custom architectureSharing custom models
Fine-tune for downstream tasks
Text classificationToken classificationQuestion answeringLanguage modelingTranslationSummarizationMultiple choiceAudio classificationAutomatic speech recognitionImage classification
Train with a scriptRun training on Amazon SageMakerInference for multilingual modelsConverting TensorFlow CheckpointsExport 🤗 Transformers modelsPerformance and scalabilityInstantiating a big modelBenchmarksMigrating from previous packagesTroubleshootDebugging🤗 Transformers NotebooksCommunityHow to contribute to transformers?How to add a model to 🤗 Transformers?How to add a pipeline to 🤗 Transformers?Training on one GPUTraining on many GPUsTraining on CPUInference on CPUCustom hardware for trainingTestingChecks on a Pull RequestConceptual guides
PhilosophyGlossarySummary of the tasksSummary of the modelsSummary of the tokenizersPadding and truncationBERTologyPerplexity of fixed-length models
API
Main Classes
CallbacksConfigurationData CollatorKeras callbacksLoggingModelsText GenerationONNXOptimizationModel outputsPipelinesProcessorsTokenizerTrainerDeepSpeed IntegrationFeature Extractor
Models
ALBERTAuto ClassesBARTBARThezBARTphoBEiTBERTBertweetBertGenerationBertJapaneseBigBirdBigBirdPegasusBlenderbotBlenderbot SmallBLOOMBORTByT5CamemBERTCANINEConvNeXTCLIPConvBERTCPMCTRLCvTData2VecDeBERTaDeBERTa-v2Decision TransformerDeiTDETRDialoGPTDistilBERTDiTDPRDPTELECTRAEncoder Decoder ModelsFlauBERTFLAVAFNetFSMTFunnel TransformerGPT-JGLPNGPT NeoGPT NeoXHerBERTHubertI-BERTImageGPTLayoutLMLayoutLMV2LayoutLMV3LayoutXLMLEDLeViTLongformerLongT5LUKELXMERTMarianMTMaskFormerM2M100MBart and MBart-50MCTCTMegatronBERTMegatronGPT2mLUKEMobileBERTMPNetMT5NyströmformerOpenAI GPTOpenAI GPT2OPTPegasusPerceiverPhoBERTPLBartPoolFormerProphetNetQDQBertRAGREALMReformerRemBERTRegNetResNetRetriBERTRoBERTaRoFormerSegFormerSEWSEW-DSpeech Encoder Decoder ModelsSpeech2TextSpeech2Text2SplinterSqueezeBERTSwin TransformerT5T5v1.1TAPASTAPEXTrajectory TransformerTransformer XLTrOCRUniSpeechUniSpeech-SATVANViLTVision Encoder Decoder ModelsVision Text Dual EncoderVision Transformer (ViT)ViTMAEVisualBERTWav2Vec2Wav2Vec2-ConformerWav2Vec2PhonemeWavLMXGLMXLMXLM-ProphetNetXLM-RoBERTaXLM-RoBERTa-XLXLNetXLSR-Wav2Vec2XLS-RYOLOSYOSO
Internal Helpers
You are viewing v4.20.1 version. A newer version v5.8.1 is available.
Run training on Amazon SageMaker
The documentation has been moved to hf.co/docs/sagemaker. This page will be removed in transformers 5.0.