Validity Concerns for Evaluating Algorithms

Jan Mendling

Validity Concerns for Evaluating Algorithms

Information Systems and Operations Management

Publication: Contribution to conference › Conference demo

Abstract

The evaluation of algorithms has been debated in computer science for decades. Recent years have seen an increasing use of different kinds of evaluations based on empirical research methods and sample data. Various applied areas of computing struggle with different concerns of validity, presumably because an overarching theoretical framework has been missing. In this keynote, we introduce a framework for researching algorithms that highlights several validity concerns. We discuss, in turn, research strategies to address these concerns. Our framework can be useful for any type of applied research in computer science that builds on the evaluation of algorithms.

Original language	English
Publication status	Published - 27 Oct 2021
Event	IC3K: 13th International Joint Conference on Knowledge Discovery - Online Streaming Duration: 27 Oct 2021 → … https://IC3K.scitevents.org

Conference

Conference	IC3K
Abbreviated title	Knowledge Engineering and Knowledge Management.
Period	27/10/21 → …
Internet address	https://IC3K.scitevents.org

Check availability

University Library Catalogue

Cite this

@conference{e60a35034757468fadac86c5b1de5ed2,

title = "Validity Concerns for Evaluating Algorithms",

abstract = "The evaluation of algorithms has been debated in computer science for decades. Recent years have seen an increasing use of different kinds of evaluations based on empirical research methods and sample data. Various applied areas of computing struggle with different concerns of validity, presumably because an overarching theoretical framework has been missing. In this keynote, we introduce a framework for researching algorithms that highlights several validity concerns. We discuss, in turn, research strategies to address these concerns. Our framework can be useful for any type of applied research in computer science that builds on the evaluation of algorithms.",

keywords = "Knowledge Engineering and Knowledge Management",

author = "Jan Mendling",

year = "2021",

month = oct,

day = "27",

language = "English",

note = "IC3K : 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management. ; Conference date: 27-10-2021",

url = "https://IC3K.scitevents.org",

}

TY - CONF

T1 - Validity Concerns for Evaluating Algorithms

AU - Mendling, Jan

PY - 2021/10/27

Y1 - 2021/10/27

N2 - The evaluation of algorithms has been debated in computer science for decades. Recent years have seen an increasing use of different kinds of evaluations based on empirical research methods and sample data. Various applied areas of computing struggle with different concerns of validity, presumably because an overarching theoretical framework has been missing. In this keynote, we introduce a framework for researching algorithms that highlights several validity concerns. We discuss, in turn, research strategies to address these concerns. Our framework can be useful for any type of applied research in computer science that builds on the evaluation of algorithms.

AB - The evaluation of algorithms has been debated in computer science for decades. Recent years have seen an increasing use of different kinds of evaluations based on empirical research methods and sample data. Various applied areas of computing struggle with different concerns of validity, presumably because an overarching theoretical framework has been missing. In this keynote, we introduce a framework for researching algorithms that highlights several validity concerns. We discuss, in turn, research strategies to address these concerns. Our framework can be useful for any type of applied research in computer science that builds on the evaluation of algorithms.

KW - Knowledge Engineering and Knowledge Management

UR - https://IC3K.scitevents.org

M3 - Conference demo

T2 - IC3K

Y2 - 27 October 2021

ER -

Validity Concerns for Evaluating Algorithms

Abstract

Conference

Check availability

Other files and links

Activities

Validity Concerns for Evaluating Algorithms

Cite this