EMPIRICAL RESEARCH IN MIS
Table of Contents
Introduction & Assignment ............................................................................................................................................... 2
Introduction ................................................................................................................................................................. 2
Assignment – “Research proposal”............................................................................................................................... 3
Chapter 2 – Information Systems Research as a Science .................................................................................................. 5
Chapter 3 – The Research Process ................................................................................................................................... 7
Summary Chapter 3 ..................................................................................................................................................... 9
Chapter 4 – theorising .................................................................................................................................................... 10
Systematic Literature Review ......................................................................................................................................... 12
Example ..................................................................................................................................................................... 15
Closing remarks ......................................................................................................................................................... 15
Other references ........................................................................................................................................................ 16
Tooling........................................................................................................................................................................... 17
Chapter 5 – Research methods ...................................................................................................................................... 21
5.1 Quantitative research methods............................................................................................................................. 21
5.2 Qualitative research methods ............................................................................................................................... 28
5.3 Mixed methods and design science ....................................................................................................................... 32
1
,INTRODUCTION & ASSIGNMENT
Introduction
• Learning objectives
o This course aims to increase the skills and capabilities of the students in applying scientific research
methods related to topics in management information systems (MIS).
o Specific attention goes to the need for balanced "rigor" and "relevance" in MIS research and how this
balance can be realized through quantitative, qualitative, and design science methods.
o Students execute a (brief) literature study and build, based on that, a research plan including problem
statement, research question/objectives and possible research designs
➔ Goal = preparation for master thesis
➔ Focus = applying research methods
• About me
o PhD Researcher
▪ Baekeland mandate in collaboration with AE
▪ Topic: Organizational cyber resilience
o
• Course material
o Slides on blackboard
o Textbook (Scientific Research in Information Systems, Springer, 2021) → optional reading
• Practical
o Lectures:
▪ Monday 16h – 18h
▪ Room: C.102
▪ No class: Easter Break (April 7th, April 14th and April 21st )
o Assignment feedback moments: March 10th and March 31st
o Deadline assignment submission: May 5th
o Presentations: May 5th and May 12th
o Multiple choice exam: April 28th
➔ No June exam!
• Course outline
2
, • Evaluation
o Students, in teams of 3-4, select a topic of interest to them in the area of IS (IT governance related or
enterprise IT architecture related).
o For this topic, a brief exploratory literature study in performed, analyzing at least 8-10 high-quality (isi-
indexed/WoS) papers in a structured way. Based on this review, a mixed-method research plan is
proposed, including problem statement, research questions/objectives and research design and
rationales for each of the choices made.
o The end-deliverable (a robust research proposal) is submitted in a paper of 10-15 pages and a
presentation at the end of the course.
o The total evaluation score is based on
▪ 25% on the multiple choice exam (individual)
▪ 75 % on the quality of the end-report presentation and defense.
o There is no separate exam. Individual scores might differ from group score when discrepancies are
identified during the continuous evaluation and group work.
o In case of failure for the course, the retake exam will be organized as an individual assignment and an
oral examination (closed book).
Assignment – “Research proposal”
• Examples
o Work package 1 and 2 are 2 separate master theses
o Work package 2 is an empirical mixed methods approach
• Assignment 1 – Problem Statement & Research Question
o Provide an answer to the Why- and the What-questions
of research
o Place the research in the broader literature
o Explain important concepts and models of the research
o Use at least 8-10 peer-reviewed references
• Assignment 2 – Use of Literature & Planning an SLR
o Elaborate on relevant literature and provide a concise overview of the existing body of knowledge.
o Explain the plan of attack for a possible SLR (special literature review). Do not perform the SLR!
▪ Make sure to include the search string that could be used to perform the SLR.
▪ Run the search string in WoS to evaluate the number of references.
▪ If refinement of the search string is necessary, explain your reasoning.
o Reflect on factors like inclusion/exclusion criteria, quality of references, …
3
, • Assignment 3 – Methodology & Quality criteria
o Decide on a research methodology, explain your choice, elaborate and reflect
o Conceptual design:
▪ Decide on a research methodology
▪ Explain your choice
o Technical design:
▪ Elaborate on the chosen methodology
▪ Provide answers to questions like:
• Which persons are included in the research? Why?
• Which persons are excluded from the research? Why?
• How many survey results do you want?
o Reflection:
▪ Reflect in terms of validity, reliability, potential risks and risk mitigations …
▪ Provide answers to questions like:
• How are you ensuring external validity in your research?
• What are you going to do if you cannot find a company that is willing to cooperate with
your research?
• Is your choice in terms of interviewees driven by factors like reliability?
• What will you do if you cannot gather the intended amount of survey responses? And
what will be the impact on validity/reliability?
• Reflections – Use of AI tools
o Explain how you used AI tools
o For each tool:
▪ Provide examples of how you used the tool (screenshots, prompts, output …)
▪ Reflect on the advantages and disadvantages you encountered
o If you did not use any AI tools:
▪ State that you did not used any AI tools
▪ Reflect on a potential use case of an AI-tool in the context of your assignment
4
Table of Contents
Introduction & Assignment ............................................................................................................................................... 2
Introduction ................................................................................................................................................................. 2
Assignment – “Research proposal”............................................................................................................................... 3
Chapter 2 – Information Systems Research as a Science .................................................................................................. 5
Chapter 3 – The Research Process ................................................................................................................................... 7
Summary Chapter 3 ..................................................................................................................................................... 9
Chapter 4 – theorising .................................................................................................................................................... 10
Systematic Literature Review ......................................................................................................................................... 12
Example ..................................................................................................................................................................... 15
Closing remarks ......................................................................................................................................................... 15
Other references ........................................................................................................................................................ 16
Tooling........................................................................................................................................................................... 17
Chapter 5 – Research methods ...................................................................................................................................... 21
5.1 Quantitative research methods............................................................................................................................. 21
5.2 Qualitative research methods ............................................................................................................................... 28
5.3 Mixed methods and design science ....................................................................................................................... 32
1
,INTRODUCTION & ASSIGNMENT
Introduction
• Learning objectives
o This course aims to increase the skills and capabilities of the students in applying scientific research
methods related to topics in management information systems (MIS).
o Specific attention goes to the need for balanced "rigor" and "relevance" in MIS research and how this
balance can be realized through quantitative, qualitative, and design science methods.
o Students execute a (brief) literature study and build, based on that, a research plan including problem
statement, research question/objectives and possible research designs
➔ Goal = preparation for master thesis
➔ Focus = applying research methods
• About me
o PhD Researcher
▪ Baekeland mandate in collaboration with AE
▪ Topic: Organizational cyber resilience
o
• Course material
o Slides on blackboard
o Textbook (Scientific Research in Information Systems, Springer, 2021) → optional reading
• Practical
o Lectures:
▪ Monday 16h – 18h
▪ Room: C.102
▪ No class: Easter Break (April 7th, April 14th and April 21st )
o Assignment feedback moments: March 10th and March 31st
o Deadline assignment submission: May 5th
o Presentations: May 5th and May 12th
o Multiple choice exam: April 28th
➔ No June exam!
• Course outline
2
, • Evaluation
o Students, in teams of 3-4, select a topic of interest to them in the area of IS (IT governance related or
enterprise IT architecture related).
o For this topic, a brief exploratory literature study in performed, analyzing at least 8-10 high-quality (isi-
indexed/WoS) papers in a structured way. Based on this review, a mixed-method research plan is
proposed, including problem statement, research questions/objectives and research design and
rationales for each of the choices made.
o The end-deliverable (a robust research proposal) is submitted in a paper of 10-15 pages and a
presentation at the end of the course.
o The total evaluation score is based on
▪ 25% on the multiple choice exam (individual)
▪ 75 % on the quality of the end-report presentation and defense.
o There is no separate exam. Individual scores might differ from group score when discrepancies are
identified during the continuous evaluation and group work.
o In case of failure for the course, the retake exam will be organized as an individual assignment and an
oral examination (closed book).
Assignment – “Research proposal”
• Examples
o Work package 1 and 2 are 2 separate master theses
o Work package 2 is an empirical mixed methods approach
• Assignment 1 – Problem Statement & Research Question
o Provide an answer to the Why- and the What-questions
of research
o Place the research in the broader literature
o Explain important concepts and models of the research
o Use at least 8-10 peer-reviewed references
• Assignment 2 – Use of Literature & Planning an SLR
o Elaborate on relevant literature and provide a concise overview of the existing body of knowledge.
o Explain the plan of attack for a possible SLR (special literature review). Do not perform the SLR!
▪ Make sure to include the search string that could be used to perform the SLR.
▪ Run the search string in WoS to evaluate the number of references.
▪ If refinement of the search string is necessary, explain your reasoning.
o Reflect on factors like inclusion/exclusion criteria, quality of references, …
3
, • Assignment 3 – Methodology & Quality criteria
o Decide on a research methodology, explain your choice, elaborate and reflect
o Conceptual design:
▪ Decide on a research methodology
▪ Explain your choice
o Technical design:
▪ Elaborate on the chosen methodology
▪ Provide answers to questions like:
• Which persons are included in the research? Why?
• Which persons are excluded from the research? Why?
• How many survey results do you want?
o Reflection:
▪ Reflect in terms of validity, reliability, potential risks and risk mitigations …
▪ Provide answers to questions like:
• How are you ensuring external validity in your research?
• What are you going to do if you cannot find a company that is willing to cooperate with
your research?
• Is your choice in terms of interviewees driven by factors like reliability?
• What will you do if you cannot gather the intended amount of survey responses? And
what will be the impact on validity/reliability?
• Reflections – Use of AI tools
o Explain how you used AI tools
o For each tool:
▪ Provide examples of how you used the tool (screenshots, prompts, output …)
▪ Reflect on the advantages and disadvantages you encountered
o If you did not use any AI tools:
▪ State that you did not used any AI tools
▪ Reflect on a potential use case of an AI-tool in the context of your assignment
4
