Research methods
Week 1
Lecture 1: Introduction
Different research methods answer different questions or give different insights into the same
research topic. Using different methods results in a richer understanding of complex
phenomena. Quantitative methods are used to test theories and qualitative methods are used
to develop new theories. Also, more ‘scientific’ entrepreneurs (so, avoiding confirmation bias
and being more critical) perform significantly better.
Confirmation bias: looking to confirm what you already think instead of going into it blank.
The research cycle:
The problem description example which was used in the lecture:
“The European climate law sets a legally binding target of net zero greenhouse gas
emissions by 2050. The EU institutions and the member states are bound to take the
necessary measures at EU and national level to meet the target.
To reach this, one of the initiatives are zero emission zones (ZEZ).”
Research topic
A common source for research topics in SCM are practical problems
faced by organisations. But practical problems don’t equal research
topics. Hence, practical problems have to be combined with literature
to contribute to knowledge.
In our ZEZ context: practically relevant and lack of understanding in
literature.
We need literature to motivate and position (neglect, confusion, and application spotting),
create a framework, interpret and explain, and relate to existing literature.
We now have a practically relevant topic that is grounded in the literature, but this is way too
broad “Implementing zero emission zones to reach climate goals”.
Research question
With research questions (RQ), we narrow down a topic to a meaningful and manageable size.
RQs are not the same as hypotheses, proposition, or aims of a study.
There are four types of RQs
depending on the maturity of
knowledge:
1. Exploratory
2. Descriptive
3. Explanatory
4. Prescriptive
,Next, based on the maturity of knowledge we choose a research approach:
Research approach
What approach is most fitting to answer your research questions? Options:
Qualitative Quantitative
Case study Surveys
Action research Descriptive analysis
Design research Mathematical models (linear programming)
Qualitative archival data Simulation
Ethnography Econometric modelling
Longitudinal field studies Experimentation
So, when do we use which method?
o Methodological fit (with maturity of theory): internal
consistency among elements of the research
project – research question, prior work, research
design, and theoretical contribution.
There should be internal consistency among all
main elements of a research project.
It is important because:
- Data collection: choosing the right methodology
ensures that the data collected is relevant and
appropriate for answering the research question.
- Valid results: a well-aligned methodology provides valid, reliable, and credible findings
that accurately reflect the research context.
- Efficiency: proper methodological fit avoids wasted resources by targeting the right data
sources and analysis techniques, streamlining the research process.
o Philosophical position
o Practical considerations like access and skills
Generally, the research question guides you to a method. For a topic like ZEZ we can still
employ many different methods, it depends on the question we ask.
Methods
Survey research is the collection of information from individuals about themselves or about the
social units to which they belong.
Example RQ: “How aware are business owners and residents of ZEZ policies and their
objectives?”
Approach: questions on knowledge of ZEZ regulations, understanding of environmental goals,
perceived personal impact, and ask from where they got their information.
, Descriptive analysis characterises the world or a phenomenon - answering questions about
who, what, where, when, and to what extent.
Example RQ: “What is the average air pollution concentration before and after implementation
of LEZs (Less Emission Zones) in different areas?”
Approach: compare average air pollution concentration and quantify the percentage reduction.
An experiment, in the standard scientific sense of the term, is a procedure in which some object
of study is subjected to interventions (manipulations) that aim at obtaining a predictable
outcome or at least predictable aspects of the outcome.
Example RQ: “How do drivers’ attitudes to low emission zones change after experiencing it?”
Approach: test drivers’ attitude towards LEZs before and after they start using more electric
modes of transport.
Mathematical modelling is the process of formulating an abstract model in terms of
mathematical language to describe the complex behaviour of a real system. Mathematical
models are quantitative models. Mathematical models can also be statistical models, fuzzy
logic models and empirical relationships.
Example RQ: “How will zero emission sones influence educational achievement?”
Approach: Using school-level data, exploit the staggered adoption of LEZs since 2008 in a
difference-in-differences framework. Using geo-referenced data from the German Socio-
economic Panel, see whether respiratory infections reduced.
Simulation is the imitation of the operations of real-world process or system over time. When
the model or problem studied is too complex for formal mathematical analysis, simulation is
preferable. Simulation also allows us to run counterfactuals and thus compare alternative
scenarios that we don’t observe in real life.
Counterfactual: studying something that doesn’t exist/happen in real life.
Example RQ: “How will the implementation of ZEZ impact vehicle kilometres?”
Approach: develop an empirical logistic simulation model for urban freight transportation. Multi-
agent simulation system for analysis of urban freight transportation demand.
A case study is a history of past or current phenomenon, drawn from multiple sources of
evidence. It can include data from direct observation and systematic interviewing as well as
from public private archives.
Example RQ: “How does the presence of a ZEZ impact local businesses and community
behaviour in diverse case locations and what are the key contextual factors that drive their
approaches.”
Approach: mixed-method analysis: estimate emissions/kilometres based on expected
behavioural changes and known characteristics of Utrecht.
Action research is a process in which knowledge is integrated with existing organisational
knowledge and applied to address real issues. It is simultaneously concerned with bringing
about change in organisations, and developing self-help competencies in organisational
members and adding to scientific knowledge.
Example RQ: “How can urban policy makers and stakeholders collaboratively enhance the
design and implementation of ZEZs to maximise environmental benefits in Groningen?”
Approach: hosting workshops to align stakeholders on ZEZ goals and implementing pilots to
test initiatives implemented. Researchers is in collaborative process with stakeholders and
together aim to solve a problem.
Design research involves a rigorous process to design artifacts to solve observed problems,
to make research contributions, to evaluate the designs, and to communicate the results to
appropriate audiences. Such artifacts may include constructs, models, methods, and
instantiations. They may also include social innovations or new properties of technical, social,
Week 1
Lecture 1: Introduction
Different research methods answer different questions or give different insights into the same
research topic. Using different methods results in a richer understanding of complex
phenomena. Quantitative methods are used to test theories and qualitative methods are used
to develop new theories. Also, more ‘scientific’ entrepreneurs (so, avoiding confirmation bias
and being more critical) perform significantly better.
Confirmation bias: looking to confirm what you already think instead of going into it blank.
The research cycle:
The problem description example which was used in the lecture:
“The European climate law sets a legally binding target of net zero greenhouse gas
emissions by 2050. The EU institutions and the member states are bound to take the
necessary measures at EU and national level to meet the target.
To reach this, one of the initiatives are zero emission zones (ZEZ).”
Research topic
A common source for research topics in SCM are practical problems
faced by organisations. But practical problems don’t equal research
topics. Hence, practical problems have to be combined with literature
to contribute to knowledge.
In our ZEZ context: practically relevant and lack of understanding in
literature.
We need literature to motivate and position (neglect, confusion, and application spotting),
create a framework, interpret and explain, and relate to existing literature.
We now have a practically relevant topic that is grounded in the literature, but this is way too
broad “Implementing zero emission zones to reach climate goals”.
Research question
With research questions (RQ), we narrow down a topic to a meaningful and manageable size.
RQs are not the same as hypotheses, proposition, or aims of a study.
There are four types of RQs
depending on the maturity of
knowledge:
1. Exploratory
2. Descriptive
3. Explanatory
4. Prescriptive
,Next, based on the maturity of knowledge we choose a research approach:
Research approach
What approach is most fitting to answer your research questions? Options:
Qualitative Quantitative
Case study Surveys
Action research Descriptive analysis
Design research Mathematical models (linear programming)
Qualitative archival data Simulation
Ethnography Econometric modelling
Longitudinal field studies Experimentation
So, when do we use which method?
o Methodological fit (with maturity of theory): internal
consistency among elements of the research
project – research question, prior work, research
design, and theoretical contribution.
There should be internal consistency among all
main elements of a research project.
It is important because:
- Data collection: choosing the right methodology
ensures that the data collected is relevant and
appropriate for answering the research question.
- Valid results: a well-aligned methodology provides valid, reliable, and credible findings
that accurately reflect the research context.
- Efficiency: proper methodological fit avoids wasted resources by targeting the right data
sources and analysis techniques, streamlining the research process.
o Philosophical position
o Practical considerations like access and skills
Generally, the research question guides you to a method. For a topic like ZEZ we can still
employ many different methods, it depends on the question we ask.
Methods
Survey research is the collection of information from individuals about themselves or about the
social units to which they belong.
Example RQ: “How aware are business owners and residents of ZEZ policies and their
objectives?”
Approach: questions on knowledge of ZEZ regulations, understanding of environmental goals,
perceived personal impact, and ask from where they got their information.
, Descriptive analysis characterises the world or a phenomenon - answering questions about
who, what, where, when, and to what extent.
Example RQ: “What is the average air pollution concentration before and after implementation
of LEZs (Less Emission Zones) in different areas?”
Approach: compare average air pollution concentration and quantify the percentage reduction.
An experiment, in the standard scientific sense of the term, is a procedure in which some object
of study is subjected to interventions (manipulations) that aim at obtaining a predictable
outcome or at least predictable aspects of the outcome.
Example RQ: “How do drivers’ attitudes to low emission zones change after experiencing it?”
Approach: test drivers’ attitude towards LEZs before and after they start using more electric
modes of transport.
Mathematical modelling is the process of formulating an abstract model in terms of
mathematical language to describe the complex behaviour of a real system. Mathematical
models are quantitative models. Mathematical models can also be statistical models, fuzzy
logic models and empirical relationships.
Example RQ: “How will zero emission sones influence educational achievement?”
Approach: Using school-level data, exploit the staggered adoption of LEZs since 2008 in a
difference-in-differences framework. Using geo-referenced data from the German Socio-
economic Panel, see whether respiratory infections reduced.
Simulation is the imitation of the operations of real-world process or system over time. When
the model or problem studied is too complex for formal mathematical analysis, simulation is
preferable. Simulation also allows us to run counterfactuals and thus compare alternative
scenarios that we don’t observe in real life.
Counterfactual: studying something that doesn’t exist/happen in real life.
Example RQ: “How will the implementation of ZEZ impact vehicle kilometres?”
Approach: develop an empirical logistic simulation model for urban freight transportation. Multi-
agent simulation system for analysis of urban freight transportation demand.
A case study is a history of past or current phenomenon, drawn from multiple sources of
evidence. It can include data from direct observation and systematic interviewing as well as
from public private archives.
Example RQ: “How does the presence of a ZEZ impact local businesses and community
behaviour in diverse case locations and what are the key contextual factors that drive their
approaches.”
Approach: mixed-method analysis: estimate emissions/kilometres based on expected
behavioural changes and known characteristics of Utrecht.
Action research is a process in which knowledge is integrated with existing organisational
knowledge and applied to address real issues. It is simultaneously concerned with bringing
about change in organisations, and developing self-help competencies in organisational
members and adding to scientific knowledge.
Example RQ: “How can urban policy makers and stakeholders collaboratively enhance the
design and implementation of ZEZs to maximise environmental benefits in Groningen?”
Approach: hosting workshops to align stakeholders on ZEZ goals and implementing pilots to
test initiatives implemented. Researchers is in collaborative process with stakeholders and
together aim to solve a problem.
Design research involves a rigorous process to design artifacts to solve observed problems,
to make research contributions, to evaluate the designs, and to communicate the results to
appropriate audiences. Such artifacts may include constructs, models, methods, and
instantiations. They may also include social innovations or new properties of technical, social,
