Skip to content

Commit

Permalink
update results
Browse files Browse the repository at this point in the history
  • Loading branch information
@xiaoman-zhang
xiaoman-zhang committed Aug 15, 2024
1 parent 1abeaaa commit 54f5fcc
Show file tree
Hide file tree
Showing 9 changed files with 224 additions and 21 deletions.
2 changes: 2 additions & 0 deletions results/result_chexpert_plus-valid.csv
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,5 @@ Rank,Date,Model Name,Institution,Model URL,BLEU,BertScore,SembScore,RadGraph,Rad
12,2023,VLCI_iuxray,SYSU,https://github.com/WissingChen/VLCI,0.065,-0.098,0.165,0.032,5.496,2.407
13,2024,LLM-CXR,KAIST,https://github.com/hyn2028/llm-cxr,0.032,-0.082,0.201,0.013,5.388,2.369
14,2024,GPT4V,OpenAI,https://cdn.openai.com/papers/GPTV_System_Card.pdf,0.055,-0.065,0.208,0.028,5.318,2.316
15,2024,BiomedGPT_iu_xray,Lehigh University,https://github.com/taokz/BiomedGPT,0.02,-0.079,0.193,0.018,5.378,2.366
16,2024,BiomedGPT_peir_gross,Lehigh University,https://github.com/taokz/BiomedGPT,0.005,-0.152,0.227,0.007,5.542,2.467
2 changes: 2 additions & 0 deletions results/result_gradienthealth.csv
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,5 @@ Rank,Date,Model Name,Institution,Model URL,BLEU,BertScore,SembScore,RadGraph,Rad
12,2023,VLCI_iuxray,SYSU,https://github.com/WissingChen/VLCI,0.174,0.297,0.433,0.197,3.622,1.283
13,2024,LLM-CXR,KAIST,https://github.com/hyn2028/llm-cxr,0.032,-0.082,0.201,0.013,5.388,2.369
14,2024,GPT4V,OpenAI,https://cdn.openai.com/papers/GPTV_System_Card.pdf,0.055,-0.065,0.208,0.028,5.318,2.316
15,2024,BiomedGPT_iu_xray,Lehigh University,https://github.com/taokz/BiomedGPT,0.079,0.287,0.411,0.166,3.675,1.361
16,2024,BiomedGPT_peir_gross,Lehigh University,https://github.com/taokz/BiomedGPT,0.015,0.127,0.269,0.049,4.562,1.911
2 changes: 2 additions & 0 deletions results/result_iu_xray.csv
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,5 @@ Rank,Date,Model Name,Institution,Model URL,BLEU,BertScore,SembScore,RadGraph,Rad
12,2023,VLCI_iuxray*,SYSU,https://github.com/WissingChen/VLCI,0.242,0.404,0.609,0.283,2.882,0.825
13,2024,LLM-CXR,KAIST,https://github.com/hyn2028/llm-cxr,0.035,0.175,0.061,0.023,4.863,2.072
14,2024,GPT4V,OpenAI,https://cdn.openai.com/papers/GPTV_System_Card.pdf,0.079,0.235,0.403,0.16,3.856,1.462
15,2024,BiomedGPT_iu_xray*,Lehigh University,https://github.com/taokz/BiomedGPT,0.123,0.361,0.512,0.242,3.175,1.044
16,2024,BiomedGPT_peir_gross,Lehigh University,https://github.com/taokz/BiomedGPT,0.016,0.151,0.276,0.052,4.471,1.86
2 changes: 2 additions & 0 deletions results/result_mimic-cxr.csv
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,5 @@ Rank,Date,Model Name,Institution,Model URL,BLEU,BertScore,SembScore,RadGraph,Rad
12,2023,VLCI_iuxray,SYSU,https://github.com/WissingChen/VLCI,0.061,0.211,0.19,0.107,4.398,1.78
13,2024,LLM-CXR*,KAIST,https://github.com/hyn2028/llm-cxr,0.036,0.158,0.15,0.047,4.712,1.983
14,2024,GPT4V,OpenAI,https://cdn.openai.com/papers/GPTV_System_Card.pdf,0.065,0.204,0.19,0.085,4.457,1.819
15,2024,BiomedGPT_iu_xray,Lehigh University,https://github.com/taokz/BiomedGPT,0.015,0.163,0.205,0.062,4.554,1.9
16,2024,BiomedGPT_peir_gross,Lehigh University,https://github.com/taokz/BiomedGPT,0.003,0.069,0.18,0.029,4.929,2.122
34 changes: 34 additions & 0 deletions results/table_chexpertplus.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -261,6 +261,40 @@ <h2>Leaderboard on CheXpert Plus Dataset</h2>
<td><b>0.028</b></td>
</tr>

<tr>
<td>
<p>15</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>2.366</b></td>
<td><b>5.378</b></td>
<td><b>0.02</b></td>
<td><b>-0.079</b></td>
<td><b>0.193</b></td>
<td><b>0.018</b></td>
</tr>

<tr>
<td>
<p>16</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>2.467</b></td>
<td><b>5.542</b></td>
<td><b>0.005</b></td>
<td><b>-0.152</b></td>
<td><b>0.227</b></td>
<td><b>0.007</b></td>
</tr>

</tbody>
</table>
</div>
Expand Down
63 changes: 57 additions & 6 deletions results/table_gradienthealth.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -227,6 +227,23 @@ <h2>Leaderboard on Private Dataset</h2>
<td><b>0.197</b></td>
</tr>

<tr>
<td>
<p>13</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/hyn2028/llm-cxr">LLM-CXR</a>
<p class="institution">KAIST</p>
</td>
<td><b>2.369</b></td>
<td><b>5.388</b></td>
<td><b>0.032</b></td>
<td><b>-0.082</b></td>
<td><b>0.201</b></td>
<td><b>0.013</b></td>
</tr>

<tr>
<td>
<p>14</p>
Expand All @@ -236,12 +253,46 @@ <h2>Leaderboard on Private Dataset</h2>
<a class="link" href="https://cdn.openai.com/papers/GPTV_System_Card.pdf">GPT4V</a>
<p class="institution">OpenAI</p>
</td>
<td><b>1.516</b></td>
<td><b>3.963</b></td>
<td><b>0.072</b></td>
<td><b>0.214</b></td>
<td><b>0.364</b></td>
<td><b>0.175</b></td>
<td><b>2.316</b></td>
<td><b>5.318</b></td>
<td><b>0.055</b></td>
<td><b>-0.065</b></td>
<td><b>0.208</b></td>
<td><b>0.028</b></td>
</tr>

<tr>
<td>
<p>15</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>1.361</b></td>
<td><b>3.675</b></td>
<td><b>0.079</b></td>
<td><b>0.287</b></td>
<td><b>0.411</b></td>
<td><b>0.166</b></td>
</tr>

<tr>
<td>
<p>16</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>1.911</b></td>
<td><b>4.562</b></td>
<td><b>0.015</b></td>
<td><b>0.127</b></td>
<td><b>0.269</b></td>
<td><b>0.049</b></td>
</tr>

</tbody>
Expand Down
34 changes: 34 additions & 0 deletions results/table_iuxray.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -261,6 +261,40 @@ <h2>Leaderboard on IU Xray Dataset</h2>
<td><b>0.16</b></td>
</tr>

<tr>
<td>
<p>15</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray*</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>1.044</b></td>
<td><b>3.175</b></td>
<td><b>0.123</b></td>
<td><b>0.361</b></td>
<td><b>0.512</b></td>
<td><b>0.242</b></td>
</tr>

<tr>
<td>
<p>16</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>1.86</b></td>
<td><b>4.471</b></td>
<td><b>0.016</b></td>
<td><b>0.151</b></td>
<td><b>0.276</b></td>
<td><b>0.052</b></td>
</tr>

</tbody>
</table>
</div>
Expand Down
34 changes: 34 additions & 0 deletions results/table_mimiccxr.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -260,6 +260,40 @@ <h2>Leaderboard on MIMIC-CXR Dataset</h2>
<td><b>0.085</b></td>
</tr>

<tr>
<td>
<p>15</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>1.9</b></td>
<td><b>4.554</b></td>
<td><b>0.015</b></td>
<td><b>0.163</b></td>
<td><b>0.205</b></td>
<td><b>0.062</b></td>
</tr>

<tr>
<td>
<p>16</p>
<span class="date label label-default">2024</span>
</td>
<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>
<td><b>2.122</b></td>
<td><b>4.929</b></td>
<td><b>0.003</b></td>
<td><b>0.069</b></td>
<td><b>0.18</b></td>
<td><b>0.029</b></td>
</tr>

</tbody>
</table>
</div>
Expand Down
72 changes: 57 additions & 15 deletions results/table_rank.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -231,8 +231,8 @@ <h2>Leaderboard Overview</h2>
</tr><tr><td><p>11</p></td>
<td style="word-break:break-word;">
<a class="link" href
"https://github.com/WissingChen/VLCI">VLCI_mimiccxr</a>
<p class="institution">SYSU</p>
"https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray</a>
<p class="institution">Lehigh University</p>
</td>

<td style="word-break:break-word;">
Expand All @@ -241,8 +241,8 @@ <h2>Leaderboard Overview</h2>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/Stanford-AIMI/CheXagent">CheXagent</a>
<p class="institution">Stanford</p>
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray*</a>
<p class="institution">Lehigh University</p>
</td>

<td style="word-break:break-word;">
Expand All @@ -252,8 +252,8 @@ <h2>Leaderboard Overview</h2>
</tr><tr><td><p>12</p></td>
<td style="word-break:break-word;">
<a class="link" href
"https://github.com/Stanford-AIMI/CheXagent">CheXagent</a>
<p class="institution">Stanford</p>
"https://github.com/WissingChen/VLCI">VLCI_mimiccxr</a>
<p class="institution">SYSU</p>
</td>

<td style="word-break:break-word;">
Expand All @@ -262,8 +262,8 @@ <h2>Leaderboard Overview</h2>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/WissingChen/VLCI">VLCI_mimiccxr</a>
<p class="institution">SYSU</p>
<a class="link" href="https://github.com/Stanford-AIMI/CheXagent">CheXagent</a>
<p class="institution">Stanford</p>
</td>

<td style="word-break:break-word;">
Expand All @@ -273,15 +273,36 @@ <h2>Leaderboard Overview</h2>
</tr><tr><td><p>13</p></td>
<td style="word-break:break-word;">
<a class="link" href
"https://cdn.openai.com/papers/GPTV_System_Card.pdf">GPT4V</a>
<p class="institution">OpenAI</p>
"https://github.com/Stanford-AIMI/CheXagent">CheXagent</a>
<p class="institution">Stanford</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://cdn.openai.com/papers/GPTV_System_Card.pdf">GPT4V</a>
<p class="institution">OpenAI</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/WissingChen/VLCI">VLCI_mimiccxr</a>
<p class="institution">SYSU</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray</a>
<p class="institution">Lehigh University</p>
</td>
</tr><tr><td><p>14</p></td>
<td style="word-break:break-word;">
<a class="link" href
"https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_iu_xray</a>
<p class="institution">Lehigh University</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://cdn.openai.com/papers/GPTV_System_Card.pdf">GPT4V</a>
<p class="institution">OpenAI</p>
Expand All @@ -291,11 +312,11 @@ <h2>Leaderboard Overview</h2>
<a class="link" href="https://github.com/hyn2028/llm-cxr">LLM-CXR</a>
<p class="institution">KAIST</p>
</td>
</tr><tr><td><p>14</p></td>
</tr><tr><td><p>15</p></td>
<td style="word-break:break-word;">
<a class="link" href
"https://github.com/hyn2028/llm-cxr">LLM-CXR</a>
<p class="institution">KAIST</p>
"https://cdn.openai.com/papers/GPTV_System_Card.pdf">GPT4V</a>
<p class="institution">OpenAI</p>
</td>

<td style="word-break:break-word;">
Expand All @@ -304,14 +325,35 @@ <h2>Leaderboard Overview</h2>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/hyn2028/llm-cxr">LLM-CXR</a>
<p class="institution">KAIST</p>
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/WissingChen/VLCI">VLCI_iuxray</a>
<p class="institution">SYSU</p>
</td>
</tr><tr><td><p>16</p></td>
<td style="word-break:break-word;">
<a class="link" href
"https://github.com/hyn2028/llm-cxr">LLM-CXR</a>
<p class="institution">KAIST</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/hyn2028/llm-cxr">LLM-CXR</a>
<p class="institution">KAIST</p>
</td>

<td style="word-break:break-word;">
<a class="link" href="https://github.com/taokz/BiomedGPT">BiomedGPT_peir_gross</a>
<p class="institution">Lehigh University</p>
</td>
</tr>
</tbody>
</table>
Expand Down

0 comments on commit 54f5fcc

Please sign in to comment.