PlagueKind - LTX2.3 Workflow - I2V - NVFP4 | INT8 Convrrot | Ease of use - Eros | Sulphur Compatible

V6 Notes

Updated Eros to 1.4 much better.
You can disable all optional lora apart from distill and eros if you want. The others do enhance the output though.
Added Volume Boost option.
Using DMD for audio and video.
Use 0.715, 0.2412, 0.0 2x FPS sigma if you see jitter

V5 Notes

Using decoupled distillation for video and audio, and smaller loras. - REQUIRED.
Updated to Eros 1.3
FPS bumped to 30fps default.
60fps native with 120fps via 2x now compatible.
Added an actually useable NVFP4 model, even though int8 convrot is more or less the same size and speed.
You can regain speed by disabling one of the optional loras, start with sulphur.

New reference node injects reference directly into the model, mostly eliminating any drift.
New DMD distill lora, fixes issues of original distill which broke decompression method and prompt adherence, no need to write a paragraph anymore. Preprocess returns for enhanced movement.
Use 6-13 steps, default 8-9.
INT8 Triton VAE for fast decode.
INT8 Convrot added for increased speed on all cards.
JoyAI lora another lora similar to omninft, this helps adherence, dialog, interaction and more.
If using the nvfp4 transformer make sure to describe anatomy that isn't already visible in the image. I don't recommend using the nvfp4 text encoder for realism.

TURN DOWN NEW EROS LORA TO 0.7 I SET IT AT 0.9 and it doesn't look correct like that.

Added Prompt Relay Node for advanced timeline prompting while keeping simplicity.
Added VHS save video. AV1/WEBM CRF0 produces virtually lossless video with extremely small file size.
Updated Eros Lora.
Moved RTX VSR into sampler graph.

Upscale and 2x fps have added tiled sampler to improve speed. if you don't like the output, experiment with cfg pp sampler, or add 0.715 to sigma. Current sigma are done on purpose to retain identity and quality of first pass.

Focused Mainly on Speed and ease of usability while retaining single pass quality and likeness.
First pass is more or less optimized.
Identity Retention is pretty good.
First pass balanced for speed and quality.
Upscale and 2x fps work but will be optimized later.
I would avoid using RTX VSR with the whole chain active unless you have like 96gb ram.
Nvfp4 models are only for Blackwell, using them will not save you speed if you don't have Blackwell, but they should still work.
Default settings of the first pass should produce good quality and sharp. I personally like to use this for a single pass and just render straight at 1280.
Bumped FPS to 30 because it looks way bettwen imo, quality seems clearer overall and it gets rid of that ltx base fps look.

This saves vram and speeds up it/s especially on longer videos
With 16gb of VRAM 3 chunks seems optimal for me
If you get triton errors, enter the model loader subgraph and disable use triton kernels

If you find this project useful and want to support development:

Monero (XMR): 865BrcfWLdwELwuq5faV1uVTbh93zVK6AUYLY2c3mX6sFfAGRfS6axe1kBTYYKuM7ccN7zBZDAZvnT7E4NKmUazySdbpc7p

Thank you for your support.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Base model

Finetuned

Finetuned

(1)

this model