Scientific Language Models

Domain pretraining and foundation models for chemistry and scientific knowledge.

References

2024

  1. Exploring the benefits of domain-pretraining of generative large language models for chemistry
    A. Acharya, Shivam Sharma, R. Cosbey, and 3 more authors
    arXiv, 2024

2022

  1. bigscience_workshop.png
    Foundation models of scientific knowledge for chemistry: Opportunities, challenges and lessons learned
    S. Horawalavithana, E. Ayton, Shivam Sharma, and 6 more authors
    In BigScience Workshop, 2022