Model Details
ClimateGPT-7B
ClimateGPT-13B
ClimateGPT-70B
ClimateGPT-7B-FSC
Parameters
7B
13B
70B
7B
Additional Climate Tokens
4.2B
4.2B
4.2B
4.2B (Upsampled 5 times)
IFT Dataset
271,552 prompt/completion pairs
271,552 prompt/completion pairs
271,552 prompt/completion pairs
271,552 prompt/completion pairs
Base Model
Llama2-Chat-7B (2T tokens)
Llama2-Chat-13B (2T tokens)
Llama2-Chat-70B (2T tokens)
From scratch (319.5B tokens)