ti.sil/pr-agent
1
0
Fork 0
mirror of https://github.com/qodo-ai/pr-agent.git synced 2025-12-12 02:45:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

docs: add Gemini-2.5-flash-preview benchmark comparisons to PR benchmark table

Browse source
This commit is contained in:
mrT23 2025-05-14 07:35:09 +03:00
parent 3ddd53d4fe
commit 72bcb0ec4c
No known key found for this signature in database
GPG key ID: D350490E39D5F5AD
1 changed files with 13 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
docs/docs/pr_benchmark/index.md
View file

@ -47,6 +47,18 @@ Here's a summary of the win rates based on the benchmark:
<td style="text-align:left;">Gemini-2.5-pro-preview-05-06</td> <td style="text-align:left;">Gemini-2.5-pro-preview-05-06</td>
<td style="text-align:left;">Sonnet 3.7</td> <td style="text-align:left;">Sonnet 3.7</td>
<td style="text-align:center; color: #1E8449;"><b>78.1%</b></td> <td style="text-align:center; color: #D8000C;"><b>21.9%</b></td> </tr> <td style="text-align:center; color: #1E8449;"><b>78.1%</b></td> <td style="text-align:center; color: #D8000C;"><b>21.9%</b></td> </tr>
<tr>
<td style="text-align:left;">Gemini-2.5-pro-preview-05-06</td>
<td style="text-align:left;">Gemini-2.5-flash-preview-04-17</td>
<td style="text-align:center; color: #1E8449;"><b>73.0%</b></td> <td style="text-align:center; color: #D8000C;"><b>27.0%</b></td> </tr>
<tr>
<td style="text-align:left;">Gemini-2.5-flash-preview-04-17</td>
<td style="text-align:left;">GPT-4.1</td>
<td style="text-align:center; color: #1E8449;"><b>54.6%</b></td> <td style="text-align:center; color: #D8000C;"><b>45.4%</b></td> </tr>
<tr>
<td style="text-align:left;">Gemini-2.5-flash-preview-04-17</td>
<td style="text-align:left;">Sonnet 3.7</td>
<td style="text-align:center; color: #1E8449;"><b>60.6%</b></td> <td style="text-align:center; color: #D8000C;"><b>39.4%</b></td> </tr>
<tr> <tr>
<td style="text-align:left;">GPT-4.1</td> <td style="text-align:left;">GPT-4.1</td>
<td style="text-align:left;">Sonnet 3.7</td> <td style="text-align:left;">Sonnet 3.7</td>
@ -54,6 +66,7 @@ Here's a summary of the win rates based on the benchmark:
</tbody> </tbody>
</table> </table>
## Gemini-2.5-pro-preview-05-06 - Model Card ## Gemini-2.5-pro-preview-05-06 - Model Card
### Comparison against GPT-4.1 ### Comparison against GPT-4.1