↓ Skip to main content

Robust optimization of SVM hyperparameters in the classification of bioactive compounds

Overview of attention for article published in Journal of Cheminformatics, August 2015
Altmetric Badge

Citations

dimensions_citation
51 Dimensions

Readers on

mendeley
79 Mendeley
You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output. Click here to find out more.
Title
Robust optimization of SVM hyperparameters in the classification of bioactive compounds
Published in
Journal of Cheminformatics, August 2015
DOI 10.1186/s13321-015-0088-0
Pubmed ID
Authors

Wojciech M Czarnecki, Sabina Podlewska, Andrzej J Bojarski

Abstract

Support Vector Machine has become one of the most popular machine learning tools used in virtual screening campaigns aimed at finding new drug candidates. Although it can be extremely effective in finding new potentially active compounds, its application requires the optimization of the hyperparameters with which the assessment is being run, particularly the C and [Formula: see text] values. The optimization requirement in turn, establishes the need to develop fast and effective approaches to the optimization procedure, providing the best predictive power of the constructed model. In this study, we investigated the Bayesian and random search optimization of Support Vector Machine hyperparameters for classifying bioactive compounds. The effectiveness of these strategies was compared with the most popular optimization procedures-grid search and heuristic choice. We demonstrated that Bayesian optimization not only provides better, more efficient classification but is also much faster-the number of iterations it required for reaching optimal predictive performance was the lowest out of the all tested optimization methods. Moreover, for the Bayesian approach, the choice of parameters in subsequent iterations is directed and justified; therefore, the results obtained by using it are constantly improved and the range of hyperparameters tested provides the best overall performance of Support Vector Machine. Additionally, we showed that a random search optimization of hyperparameters leads to significantly better performance than grid search and heuristic-based approaches. The Bayesian approach to the optimization of Support Vector Machine parameters was demonstrated to outperform other optimization methods for tasks concerned with the bioactivity assessment of chemical compounds. This strategy not only provides a higher accuracy of classification, but is also much faster and more directed than other approaches for optimization. It appears that, despite its simplicity, random search optimization strategy should be used as a second choice if Bayesian approach application is not feasible.Graphical abstractThe improvement of classification accuracy obtained after the application of Bayesian approach to the optimization of Support Vector Machines parameters.

Mendeley readers

Mendeley readers

The data shown below were compiled from readership statistics for 79 Mendeley readers of this research output. Click here to see the associated Mendeley record.

Geographical breakdown

Country Count As %
Germany 1 1%
Brazil 1 1%
Sweden 1 1%
Costa Rica 1 1%
Poland 1 1%
Unknown 74 94%

Demographic breakdown

Readers by professional status Count As %
Student > Ph. D. Student 15 19%
Researcher 10 13%
Student > Bachelor 9 11%
Student > Master 7 9%
Student > Doctoral Student 4 5%
Other 10 13%
Unknown 24 30%
Readers by discipline Count As %
Computer Science 16 20%
Engineering 12 15%
Chemistry 9 11%
Medicine and Dentistry 3 4%
Agricultural and Biological Sciences 3 4%
Other 8 10%
Unknown 28 35%