Nice one!
#1
by valentijnvenus - opened
Nice one Phil! Running well here too.
Earlier builds of ours collapsed into repetition loops at 75K-100K tokens of context on these tasks; this build, served with the attention fix below, did not in our runs (one run per task, so treat this as early evidence).
Can confirm the same, still present but manageable.
yeah I'm still working through the long context quirks, there will very likely be more updates to this coming(unless we get a newer version before then) that fixes that and eventually work with 1M context windows (probably by adding better support offloading).