to the 1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering (WSESE2024) to be held in conjunction with
https://2024.ese-workshops.org twitter:@chairswsese #wsese2024
With the steep increase in the number of empirical studies and the advent of secondary studies that aggregate or perform meta-analysis on those studies, one main concern that arises is the quality of the primary studies (e.g., a single experiment). While researchers have raised concerns about different types of quality issues for many years, many of these issues remain, at least partially due to the complexity of empirical studies in our field—whether human subjects are involved or not. Specifically, problems related to appropriate design and the correct usage of statistical tests are crucial for the trustworthiness of the results. Consequently, as a community, we need to better understand these issues and how to mitigate, if not eliminate them. The workshop’s aim is to increase awareness of the importance of the quality and appropriateness of the methods applied during the different stages of software engineering empirical studies to yield reliable results and to disseminate this knowledge to the broader SE community.
Topics of interest include, but are not restricted to:
- Issues with the motivation and definition of appropriate research questions.
- Issues with the operationalization, e.g., missing standard metrics.
- Issues with the systematic identification of threats to validity and how to address them
- Issues selecting an appropriate study design and the consequences of that selection,
- Issues with drawing appropriate conclusions from the findings and generalizing them
- Issues with aggregating results from individual studies
- Issues with reproduction, replication, or families of studies
- Issues with quantitative, qualitative approaches and combined approaches
- Issues with understanding failures and successes: lessons learned