IR/IE Evaluation (cont.)

17 outubro 2019, 15:30 • Bruno Emanuel Da Graça Martins

• Ranking Comparison
  
• Spearman Coefficient
• Kendall’s Tau
• Obtaining the Ground Truth and Methodological Aspects
• Reference Collections
• Human Experimentation in the Lab and A/B Testing
• Crowdsourcing
• Evaluation using Clickthrough Data and Click Models
• Evaluation of Classifiers
• Confusion Matrices and Accuracy
• Macro- and Micro-Averaged Precision and Recall
• Precision and Recall in Multi-Label Scenarios
• Cross-Validation Methodologies
• Evaluation of Clustering
• Purity
• Normalized Mutual Information
• Rand Index
• The B³ Family of Metrics