DeepSeek V4 Flash 0731: 82.7% on Terminal-Bench 2.1 with a public harness antigma.ai 37 points by ubermon 3 weeks ago
kimjune01 3 weeks ago an audit for the bench for the curious:https://www.june.kim/terminal-bench-frame ubermon 3 weeks ago yeah, that bench has a lot of room to improve, but it is the best we can find now
ubermon 3 weeks ago yeah, that bench has a lot of room to improve, but it is the best we can find now
freakynit 3 weeks ago Keeps throwing forbidden after logging-in to the dashboard and goes back to login screen. Tried 4 times. swrrt 3 weeks ago Oh, it seems fine for me. I can login actually. Maybe network/server instability? freakynit 3 weeks ago No idea..
swrrt 3 weeks ago Oh, it seems fine for me. I can login actually. Maybe network/server instability? freakynit 3 weeks ago No idea..
polymer8563 3 weeks ago From README for Ante:"The core harness itself is developed in a private repository during the alpha"lost all interest after that sentence, sad thing
an audit for the bench for the curious:
https://www.june.kim/terminal-bench-frame
yeah, that bench has a lot of room to improve, but it is the best we can find now
Keeps throwing forbidden after logging-in to the dashboard and goes back to login screen. Tried 4 times.
Oh, it seems fine for me. I can login actually. Maybe network/server instability?
No idea..
From README for Ante:
"The core harness itself is developed in a private repository during the alpha"
lost all interest after that sentence, sad thing