Research
Rigorous Futures Research
Developing strong and rigorous chains of custody
Research
In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.
1. Trace Back to the Original Source
The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.
2. Stay Up-to-Date
Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.
3. Identify and Avoid Source Bias
When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.
4. Use Multiple Sources for Triangulation
In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.
5. Scrutinize
When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.
6. Be Wary of Overly Impressive Statistics
Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.
7. Understand the Context
Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.
8. Challenge your own Bias
We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.
As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.
In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.
1. Trace Back to the Original Source
The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.
2. Stay Up-to-Date
Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.
3. Identify and Avoid Source Bias
When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.
4. Use Multiple Sources for Triangulation
In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.
5. Scrutinize
When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.
6. Be Wary of Overly Impressive Statistics
Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.
7. Understand the Context
Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.
8. Challenge your own Bias
We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.
As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.
In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.
1. Trace Back to the Original Source
The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.
2. Stay Up-to-Date
Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.
3. Identify and Avoid Source Bias
When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.
4. Use Multiple Sources for Triangulation
In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.
5. Scrutinize
When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.
6. Be Wary of Overly Impressive Statistics
Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.
7. Understand the Context
Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.
8. Challenge your own Bias
We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.
As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.
In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.
1. Trace Back to the Original Source
The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.
2. Stay Up-to-Date
Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.
3. Identify and Avoid Source Bias
When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.
4. Use Multiple Sources for Triangulation
In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.
5. Scrutinize
When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.
6. Be Wary of Overly Impressive Statistics
Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.
7. Understand the Context
Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.
8. Challenge your own Bias
We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.
As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.
In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.
1. Trace Back to the Original Source
The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.
2. Stay Up-to-Date
Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.
3. Identify and Avoid Source Bias
When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.
4. Use Multiple Sources for Triangulation
In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.
5. Scrutinize
When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.
6. Be Wary of Overly Impressive Statistics
Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.
7. Understand the Context
Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.
8. Challenge your own Bias
We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.
As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.
Other Blog Posts
Research
March 5, 24
How will declining birthrates and ageing populations shape our potential futures?
Research
May 2, 2019
Contemplating the right question is often more important than crafting the right answer.
Education
May 1, 2020
As a school student, how might you think about Earlywork as an opportunity to showcase who you are and what you’re capable of?
Story
March 6, 2023
A Science Fiction Prototyping approach to imagining our future oceans.
Research
June 5, 2023
Inputting research and information as networked knowledge nodes with supertags surfaces connections and patterns you might not otherwise pick up.
Design
September 10, 2023
Is AI Stripping Creativity from Architecture? The Dangers of Algorithm-Driven Design
Education
September 24, 2023
What if . . we framed education as an example of chaos theory?
Education
October 17, 2023
Will school education will eventually reform as an emergent system with technology embedded as a key shaping force?
Education
April 18, 2024
What if . . instead of the failures of students, we focused on the failure of systems?. . and used that understanding to collectively reimagine education?
Research
August 20, 2024
UX (User eXperience) is in some ways, a philosophical enquiry, inviting us to question - What is this really about? What is the role of design in this moment?
Books
September 19, 2024
If we disallow radical flank activism does the right to protest mean anything at all?
Think
September 21, 2024
Thinking about Foucault in the context of women worldwide and reproductive justice
Books
November 13, 2024
When we think about development, can the concept of 'equity' be reconceptualised to connect with the context of the Global South without recovering / making visible, plural definitions of 'prosperity' or 'wellbeing'?
👋 say hello