There are many articles and books and talks and so on all making claims about machine learning algorithms. Out of those, how many actually QUANTIFY THE EFFICACY OF THE ALGORITHM?.
Below are some references which will hopefully save people some leg work and help others quantify the performance of their algorithms.
- Articles
- Advanced non-parametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining by S García
- Building and deploying large-scale machine learning pipelines by Ben Lorica
- Characterization and evaluation of similarity measures for pairs of clusterings by Pfitzner, Leibbrandt, Powers
- Cost Curves: An Improved Method for Visualizing Classifier Performance by Chris Drummond, Robert C. Holte
- Evaluating Machine Learning Methods: Scored Receiver Operating Characteristics (sROC) Curves by William Klement
- Evaluation of Classifiers by Jin Tian
- Multiple Criteria for Evaluating Machine Learning Algorithms for Land Cover Classification from Satellite Data by DeFries, Chan
- On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation by Cawley, Talbot
- Performance Evaluation of Machine Learning Algorithms by Mohak Shah, Nathalie Japkowicz
- Projection - Based Framework for Classifier Performance Evaluation by Nathalie Japkowicz, Pritika Sanghi, Peter Tischer
- Publications by Chris Drummond
- Visualization of Tradeoff in Evaluation: from Precision - Recall & PN to LIFT, ROC & BIRD by Powers
- Visualizing Classifier Performance on Different Domains by Alaiz-Rodrıguez, Japkowicz, Tischer
- What are commonly used performance measures for machine learning algorithms? at Research Gate
- Wikipedia: confusion matrix
- Advanced non-parametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining by S García
- Books
- Assessing and Improving Prediction and Classification by Timothy Masters
- Evaluating and Comparing the Performance of Machine Learning Algorithms by Melanie Mitchell
- Evaluating Learning Algorithms: A Classification Perspective by Japkowicz, Shah
- Amazon
- Customer Reviews
- Howard B. Bandy on July 7, 2014
- ... examples presented are all of stationary data ...
- ... examples presented are all of stationary data ...
- Howard B. Bandy on July 7, 2014
- Customer Reviews
- Cambridge.Org
- Looking for an examination copy?
- If you are interested in the title for your course we can consider offering an examination copy. To register your interest please contact collegesales@cambridge.org providing details of the course you are teaching.
- If you are interested in the title for your course we can consider offering an examination copy. To register your interest please contact collegesales@cambridge.org providing details of the course you are teaching.
- Looking for an examination copy?
- Google
- Has table of contents and you can look at some randomly selected pages
- Has table of contents and you can look at some randomly selected pages
- MohakShah.Com
- Email Address: eval@mohakshah.com
- For electronic editions, ...
- Computing Resources
- Email Address: eval@mohakshah.com
- Amazon
- Evaluation and Analysis of Supervised Learning Algorithms and Classifiers by Niklas Lavesson
- Machine Learning and Data Mining: 14 Evaluation and Credibility by Pier Luca Lanzi
- Assessing and Improving Prediction and Classification by Timothy Masters