This talk describes an approach to quantitatively evaluate the quality and maturity of open source software. and hence its suitability for use in business-critical settings. We have defined seven different evaluation categories, along with an evaluation process that allows a user to allocate weights to the various categories and to easily select the most appropriate software projects for further evaluation. The evaluation process relies heavily on data that can be extracted from open source forges and from other online resources. The goal of this work is to assist people in selecting open source software for use in business-critical settings.