JetBrains Mellum 2.1 12B A2.5B MoE is a very good model.

Reddit/원문 접근이 제한되어 큐레이터 포스트 본문을 기준으로 옮겼어요. blocked로 표시해요.

포스트 요지

JetBrains Mellum 2.1 — 12B total / 활성 약 2.5B MoE — 를 "very good model"로 추천하는 짧은 후기예요.

It runs at around m4 16 at 60 tps at full 130k context, you can easily run a Q8 if you have a 16 GB GPU, I was able to get 140TPS on 9070xt, It’s an MoE so I think we can run it well on smaller cards too, 8GB, 12GB should be possible to get upwards of 30-40 tps. I have used it a bit, it can code, but I think having a bigger model plan tasks in detail would make it quite good for quick task execution. submitted by /u/Shadow_s_Bane

공식 카드·벤치 전표를 여기서 재검증하지는 않았어요.