LoRA training
#3
by
faheemraza1
- opened
Can we LoRA train this model on a RTX 3090?
In theory you could use this as frozen weights and train a LoRA. It could work and you could look into ARA to recover the loss.