ChatClimate: Grounding conversational AI in climate science

Vaghefi SA, Stammbach D, Muccione V, Bingler J, Ni J, Kraus M, Allen S, Colesanti-Senni C, Wekhof T, Schimanski T, Gostlow G, Yu T, Wang Q, Webersinke N, Huggel C, Leippold M (2023)

Publication Type: Journal article

Publication year: 2023

Journal

Communications Earth & Environment Springer Nature Limited

Book Volume: 4

Article Number: 480

Journal Issue: 1

DOI: 10.1038/s43247-023-01084-x

Abstract

Large Language Models have made remarkable progress in question-answering tasks, but challenges like hallucination and outdated information persist. These issues are especially critical in domains like climate change, where timely access to reliable information is vital. One solution is granting these models access to external, scientifically accurate sources to enhance their knowledge and reliability. Here, we enhance GPT-4 by providing access to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC AR6), the most comprehensive, up-to-date, and reliable source in this domain (refer to the ’Data Availability’ section). We present our conversational AI prototype, available at www.chatclimate.ai , and demonstrate its ability to answer challenging questions in three different setups: (1) GPT-4, (2) ChatClimate, which relies exclusively on IPCC AR6 reports, and (3) Hybrid ChatClimate, which utilizes IPCC AR6 reports with in-house GPT-4 knowledge. The evaluation of answers by experts show that the hybrid ChatClimate AI assistant provide more accurate responses, highlighting the effectiveness of our solution.

Authors with CRIS profile

Mathias Kraus Juniorprofessur für Data Analytics Nicolas Webersinke Lehrstuhl für Betriebswirtschaftslehre, insbesondere Finanzierung und Banken

Involved external institutions

Eidgenössische Technische Hochschule Zürich (ETHZ) / Swiss Federal Institute of Technology in Zurich CH Switzerland (CH) University of Zurich / Universität Zürich (UZH) CH Switzerland (CH) University of Oxford GB United Kingdom (GB)

How to cite

APA:

Vaghefi, S.A., Stammbach, D., Muccione, V., Bingler, J., Ni, J., Kraus, M.,... Leippold, M. (2023). ChatClimate: Grounding conversational AI in climate science. Communications Earth & Environment, 4(1). https://dx.doi.org/10.1038/s43247-023-01084-x

MLA:

Vaghefi, Saeid Ashraf, et al. "ChatClimate: Grounding conversational AI in climate science." Communications Earth & Environment 4.1 (2023).

BibTeX: Download