Reporting bias

Conquering Data Bias

Konstantinos Kattidis

Data Analytics Lead

Unveiling reporting bias

People reporting results

  • Reporting bias affects how data is presented to others
  • It occurs when the decision to publish or emphasize analysis findings is influenced by the nature and direction of the results
  • Reporting bias can manifest in different forms, each with its own implications for data analysis
Conquering Data Bias

Scenario: reporting marketing results

Person cherry picking positive trends

  • A marketing manager analyzing sales data
  • Selectively includes data from high-performing product lines in his reports
  • He highlights positive trends and minimizes negative ones, painting a rosy picture of the company's performance
  • Leading to misguided strategic decisions
Conquering Data Bias

Selective reporting: highlighting the positive

  • The scenario illustrates selective reporting or otherwise called, cherry-picking
  • It refers to intentionally or unintentionally excluding data that does not align with a predetermined conclusion or desired outcome
  • This bias can lead to skewed or misleading interpretations of the available data

 

Finger selecting from five choices

Conquering Data Bias

Publication bias: favoring significant results

It occurs when studies with statistically significant results are more likely to be published than those with nonsignificant findings

  • It can lead to an overrepresentation of studies showing positive outcomes
  • Resulting in skewed understanding of the true effect of interventions or treatments

Person publishing research

Conquering Data Bias

Spin bias: distorting the narrative

  • It involves how the included data are presented or interpreted
  • It involves exaggerating the significance of findings or downplaying limitations
  • For instance:
    • A company press release spinning modest sales growth as a major success story
    • Hiding underlying challenges

 

Person presenting analysis results hiding underlying challenges

Conquering Data Bias

The origins of reporting bias

Intentional manipulation, inadvertent oversight, and systemic issues within organizations

  • Reporting bias occurs from various factors

  • These include:

    • Intentional manipulation
    • Inadvertent oversight
    • Systemic issues within organizations

  • This can lead to misguided policies, wasted resources, and erosion of trust

Conquering Data Bias

Let's practice!

Conquering Data Bias

Preparing Video For Download...