Qwen3-Coder is a 480B parameters non-thinking mode tuning model. Are there any comparison between Qwen3 vs Kimi2-Instruct on coding abilities, such as SWE-Bench etc?

Strong performance with Qwen code command line support. The only drawback using the Qwen3 coder model is the high token consumption rate. Hopefully the price will drop to a reasonable level soon.

Qwen3 32B model series are the most widely adopted and deployed model in industrial applications, which compromise of inference speed and performance. This updated version of Qwen3 32B model have the thinking mode and non-thinking mode, which supports both the common task of chat/text generation and more complex task of math, code generation, etc. On the AIME and many other math benchmarks, Qwen3 surpass many of the opensource counterpart.

Qwen3 235B A22B model is more like an upgraded version of DeepSeek-R1. And it is also compared with Deepseek R1 model on multiple benchmarks of code and math. Personally, I don't Qwen3 is a huge upgrade compared to Gemini/OpenAI and Deepseek model, but more like a compromised version of complex thinking and realistic usage.

Overall, Gemini did a good job though not optimal in the pytorch model coding test. I asked the same question on ChatGPT vs Gemini vs Claude. Among all these three platforms, Gemini‘s python code is correct but less concise. It also uses some unusual functions of pytorch package, such as """ context.permutate(0, 2, 1, 3).view(...) """. This is just a weighted average tensor operation, so this implementation is very uncommon and not necessary. And ChatGPT and Claude use the correct function for this operation, which is """ torch.einsum().reshape() """. Even though it's not a big deal, but generating common python code in Gemini is not optimal.

Gemini's results of data analysis and the feature of drawing plot really surprise me. It gives exactly the bar chart comparing the market capitalization of several companies. And I even double checked the July 2024 financial data, which is correct. It also gives me the results of the python code which draws the chart so that I can save it and modify the chart for later use. Really amazing!!!

I asked Gemini to give an introduction to Maxwell equations and explain each terms in the equation. Overall it gives reasonable answers to explain Maxwell equations are a set of four equations. But It will be nice if the equation itself is provided before explaining the term. So Maybe it lacks of generation of the latex code of maxwell equation?