Molecule generation using transformers and policy gradient reinforcement learning
Abstract Generating novel valid molecules is often a difficult task, because the vast chemical space relies on the intuition of experienced chemists. In recent years, deep learning models have helped accelerate this process. These advanced models can also help identify suitable molecules for disease...
Published in: | Scientific Reports |
---|---|
Main Authors: | , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
Nature Portfolio
2023
|
Subjects: | |
Online Access: | https://doi.org/10.1038/s41598-023-35648-w https://doaj.org/article/43421964cb2b49f9889efbc7f325dfb3 |
id |
ftdoajarticles:oai:doaj.org/article:43421964cb2b49f9889efbc7f325dfb3 |
---|---|
record_format |
openpolar |
spelling |
ftdoajarticles:oai:doaj.org/article:43421964cb2b49f9889efbc7f325dfb3 2023-07-02T03:33:50+02:00 Molecule generation using transformers and policy gradient reinforcement learning Eyal Mazuz Guy Shtar Bracha Shapira Lior Rokach 2023-05-01T00:00:00Z https://doi.org/10.1038/s41598-023-35648-w https://doaj.org/article/43421964cb2b49f9889efbc7f325dfb3 EN eng Nature Portfolio https://doi.org/10.1038/s41598-023-35648-w https://doaj.org/toc/2045-2322 doi:10.1038/s41598-023-35648-w 2045-2322 https://doaj.org/article/43421964cb2b49f9889efbc7f325dfb3 Scientific Reports, Vol 13, Iss 1, Pp 1-11 (2023) Medicine R Science Q article 2023 ftdoajarticles https://doi.org/10.1038/s41598-023-35648-w 2023-06-11T00:37:33Z Abstract Generating novel valid molecules is often a difficult task, because the vast chemical space relies on the intuition of experienced chemists. In recent years, deep learning models have helped accelerate this process. These advanced models can also help identify suitable molecules for disease treatment. In this paper, we propose Taiga, a transformer-based architecture for the generation of molecules with desired properties. Using a two-stage approach, we first treat the problem as a language modeling task of predicting the next token, using SMILES strings. Then, we use reinforcement learning to optimize molecular properties such as QED. This approach allows our model to learn the underlying rules of chemistry and more easily optimize for molecules with desired properties. Our evaluation of Taiga, which was performed with multiple datasets and tasks, shows that Taiga is comparable to, or even outperforms, state-of-the-art baselines for molecule optimization, with improvements in the QED ranging from 2 to over 20 percent. The improvement was demonstrated both on datasets containing lead molecules and random molecules. We also show that with its two stages, Taiga is capable of generating molecules with higher biological property scores than the same model without reinforcement learning. Article in Journal/Newspaper taiga Directory of Open Access Journals: DOAJ Articles Scientific Reports 13 1 |
institution |
Open Polar |
collection |
Directory of Open Access Journals: DOAJ Articles |
op_collection_id |
ftdoajarticles |
language |
English |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Eyal Mazuz Guy Shtar Bracha Shapira Lior Rokach Molecule generation using transformers and policy gradient reinforcement learning |
topic_facet |
Medicine R Science Q |
description |
Abstract Generating novel valid molecules is often a difficult task, because the vast chemical space relies on the intuition of experienced chemists. In recent years, deep learning models have helped accelerate this process. These advanced models can also help identify suitable molecules for disease treatment. In this paper, we propose Taiga, a transformer-based architecture for the generation of molecules with desired properties. Using a two-stage approach, we first treat the problem as a language modeling task of predicting the next token, using SMILES strings. Then, we use reinforcement learning to optimize molecular properties such as QED. This approach allows our model to learn the underlying rules of chemistry and more easily optimize for molecules with desired properties. Our evaluation of Taiga, which was performed with multiple datasets and tasks, shows that Taiga is comparable to, or even outperforms, state-of-the-art baselines for molecule optimization, with improvements in the QED ranging from 2 to over 20 percent. The improvement was demonstrated both on datasets containing lead molecules and random molecules. We also show that with its two stages, Taiga is capable of generating molecules with higher biological property scores than the same model without reinforcement learning. |
format |
Article in Journal/Newspaper |
author |
Eyal Mazuz Guy Shtar Bracha Shapira Lior Rokach |
author_facet |
Eyal Mazuz Guy Shtar Bracha Shapira Lior Rokach |
author_sort |
Eyal Mazuz |
title |
Molecule generation using transformers and policy gradient reinforcement learning |
title_short |
Molecule generation using transformers and policy gradient reinforcement learning |
title_full |
Molecule generation using transformers and policy gradient reinforcement learning |
title_fullStr |
Molecule generation using transformers and policy gradient reinforcement learning |
title_full_unstemmed |
Molecule generation using transformers and policy gradient reinforcement learning |
title_sort |
molecule generation using transformers and policy gradient reinforcement learning |
publisher |
Nature Portfolio |
publishDate |
2023 |
url |
https://doi.org/10.1038/s41598-023-35648-w https://doaj.org/article/43421964cb2b49f9889efbc7f325dfb3 |
genre |
taiga |
genre_facet |
taiga |
op_source |
Scientific Reports, Vol 13, Iss 1, Pp 1-11 (2023) |
op_relation |
https://doi.org/10.1038/s41598-023-35648-w https://doaj.org/toc/2045-2322 doi:10.1038/s41598-023-35648-w 2045-2322 https://doaj.org/article/43421964cb2b49f9889efbc7f325dfb3 |
op_doi |
https://doi.org/10.1038/s41598-023-35648-w |
container_title |
Scientific Reports |
container_volume |
13 |
container_issue |
1 |
_version_ |
1770273936430333952 |