Person:
YETEMEN, MELİH

Profile Picture

Email Address

Birth Date

Research Projects

Organizational Units

OrgUnit Logo
Organizational Unit

Job Title

Last Name

YETEMEN

First Name

MELİH

Name

Filters

20232
Reset filters

Settings

Search Results

Now showing 1 - 2 of 2
  • No Thumbnail Available
    Publication
    Can chatgpt, an artificial intelligence language model, provide accurate and high-quality patient information on prostate cancer? reply
    (Elsevier Science Inc, 2023-10-10) Coşkun, Burhan; COŞKUN, BURHAN; Ocakoğlu, Gokhan; OCAKOĞLU, GÖKHAN; Yetemen, Melih; YETEMEN, MELİH; Kaygısız, Onur; KAYGISIZ, ONUR; Bursa Uludağ Üniversitesi/Tıp Fakültesi/Üroloji Anabilim Dalı.; Bursa Uludağ Üniversitesi/Tıp Fakültesi/Biyoistatistik Anabilim Dalı.; 0000-0002-1114-6051; 0000-0002-9790-7295; L-9439-2019; AAH-5180-2021
  • No Thumbnail Available
    Publication
    Can ChatGPT, an artificial intelligence language model, provide accurate and high-quality patient information on prostate cancer?
    (Elsevier Science Inc, 2023-10-10) Coşkun, Burhan; Ocakoğlu, Gökhan; Yetemen, Melih; Kaygısız, Onur; COŞKUN, BURHAN; OCAKOĞLU, GÖKHAN; YETEMEN, MELİH; KAYGISIZ, ONUR; Bursa Uludağ Üniversitesi/Tıp Fakültesi/Üroloji Anabilim Dalı.; Bursa Uludağ Üniversitesi/Tıp Fakültesi/Biyoistatistik Anabilim Dalı.; 0000-0002-8242-9921; 0000-0002-1114-6051; 0000-0002-9790-7295; AAH-9704-2021; L-9439-2019; AAH-5180-2021; JVM-2711-2024
    OBJECTIVE To evaluate the performance of ChatGPT, an artificial intelligence (AI) language model, in providing patient information on prostate cancer, and to compare the accuracy, similarity, and quality of the information to a reference source. METHODS Patient information material on prostate cancer was used as a reference source from the website of the European Association of Urology Patient Information. This was used to generate 59 queries. The accuracy of the model's content was determined with F1, precision, and recall scores. The similarity was assessed with cosine similarity, and the quality was evaluated using a 5RESULTS ChatGPT was able to respond to all prostate cancer-related queries. The average F1 score was 0.426 (range: 0-1), precision score was 0.349 (range: 0-1), recall score was 0.549 (range: 0-1), and cosine similarity was 0.609 (range: 0-1). The average GQS was 3.62 +/- 0.49 (range: 1-5), with no answers achieving the maximum GQS of 5. While ChatGPT produced a larger amount of information compared to the reference, the accuracy and quality of the content were not optimal, with all scores indicating need for improvement in the model's performance. CONCLUSION Caution should be exercised when using ChatGPT as a patient information source for prostate cancer due to limitations in its performance, which may lead to inaccuracies and potential misunderstandings. Further studies, using different topics and language models, are needed to fully understand the capabilities and limitations of AI-generated patient information. UROLOGY 180: 35-58, 2023. (c) 2023 Elsevier Inc. All rights reserved.