Scientific Language Models
Domain pretraining and foundation models for chemistry and scientific knowledge.
This work explores how domain-specific pretraining and scientific corpora shape generative language models for chemistry and broader scientific knowledge tasks.
Related publications: (Acharya et al., 2024), (Horawalavithana et al., 2022)