Research

Rigorous Futures Research

Developing strong and rigorous chains of custody

Research

In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.

1. Trace Back to the Original Source

The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.

2. Stay Up-to-Date

Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.

3. Identify and Avoid Source Bias

When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.

4. Use Multiple Sources for Triangulation

In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.

5. Scrutinize

When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.

6. Be Wary of Overly Impressive Statistics

Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.

7. Understand the Context

Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.

8. Challenge your own Bias

We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.

As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.

In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.

1. Trace Back to the Original Source

The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.

2. Stay Up-to-Date

Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.

3. Identify and Avoid Source Bias

When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.

4. Use Multiple Sources for Triangulation

In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.

5. Scrutinize

When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.

6. Be Wary of Overly Impressive Statistics

Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.

7. Understand the Context

Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.

8. Challenge your own Bias

We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.

As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.

In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.

1. Trace Back to the Original Source

The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.

2. Stay Up-to-Date

Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.

3. Identify and Avoid Source Bias

When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.

4. Use Multiple Sources for Triangulation

In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.

5. Scrutinize

When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.

6. Be Wary of Overly Impressive Statistics

Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.

7. Understand the Context

Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.

8. Challenge your own Bias

We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.

As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.

In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.

1. Trace Back to the Original Source

The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.

2. Stay Up-to-Date

Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.

3. Identify and Avoid Source Bias

When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.

4. Use Multiple Sources for Triangulation

In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.

5. Scrutinize

When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.

6. Be Wary of Overly Impressive Statistics

Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.

7. Understand the Context

Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.

8. Challenge your own Bias

We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.

As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.

In futures research, reliable desk research is crucial for building accurate insights and avoiding flawed assumptions. When gathering data and information or scanning for signals, being conscious of your approach and checking your own bias is critical to ensure the quality and integrity of your research.

1. Trace Back to the Original Source

The “Google-and-cite” trap is an easy but risky approach. To avoid this, always dig until you reach the original source. If you encounter secondary sources, follow each citation until you find the first time the information was published, whether it's a research journal or an original Tweet. This process not only strengthens credibility but also allows you to understand the full context of the data and potential limitations. Linking directly to original posts or reports enables your readers to verify and explore the information themselves. Don't forget if you're looking older or a temporary post, you can always try the wayback machine and explore the web archive to cite or screenshot.

2. Stay Up-to-Date

Keeping abreast of signals of change is critical - always consider, is the signal really new or is it just new to me? Bias information searching can lead to misguided foresight, especially where behaviors are shifting. Instead of relying on pre-2020 data in these areas, opt for sources from the last 2-3 years or conduct your own research if nothing recent exists. Identifying the specific data lifespan or pace layering of change for the domain is key; some areas, like natural science constants, remain relevant indefinitely, while others, like consumer behavior or digital trends, need near-continuous updating.

3. Identify and Avoid Source Bias

When you’re looking for trends and substantive patterns (ie. not outlier signals of change), remember organizations, startups and individuals often publish or post in alignment with their own agenda. For instance, a software company promoting digital transformation is likely to overemphasize the urgency of adopting tech solutions, or a tech startup may overstate the novelty or adoption of a new technology function. Similarly, statistics from sources with a vested interest in the outcome — such as marketing reports from service providers — are often biased, regardless of the data’s underlying validity. When possible, seek data from neutral, independent research groups or peer-reviewed academic sources. If you must use potentially biased information, be explicit about its source and limitations in your analysis.

4. Use Multiple Sources for Triangulation

In foresight, triangulating information—checking against multiple independent sources—helps validate data quality. Comparing findings from diverse outlets, such as government reports, industry analyses, and academic studies, helps you identify anomalies and prevent over-reliance on one perspective. This process enables a more balanced understanding of complex issues and increases confidence in your conclusions. Even when it comes to signal scanning where we deliberate look to the fringes of a domain for signs of change - one single is interesting, two of a similar nature are worth taking note of and three signals in a similar space or challenging a similar perspective mean there's something worth really noodling on.

5. Scrutinize

When looking for trends, projections or plans, think about how you're evaluating a study or report, closely examine the research methods. Questions to ask include: How large was the sample size? What data collection methods were used? Was the study limited to specific demographics or regions? Understanding these elements helps assess whether findings are generalizable or may have significant limitations. Transparent, well-documented methodologies typically indicate more reliable research.

6. Be Wary of Overly Impressive Statistics

Statistics that sound too impressive or dramatic should raise red flags. Exaggerated claims can be a sign of biased sources or manipulation techniques, like selective reporting or “cherry-picking” data to highlight specific outcomes. Always verify these figures against other data points or reputable sources, especially when statistics are foundational to the insights you’re developing.

7. Understand the Context

Being aware of context is critical to understanding the broader landscape surrounding data. Signals are rarely meaningful in isolation. Factors such as socioeconomic shifts, political changes, and cultural contexts can profoundly impact the relevance and interpretation of signals - either reinforcing a shift or signalling a potential disruption or changing dynamic. Keeping context in mind can reveal deeper insights and bring nuance to foresight narratives, ultimately leading to more robust future scenarios. By embedding these principles into your desk research, you enhance the reliability and rigor of your foresight work, creating a strong foundation for analyzing and exploring potential futures.

8. Challenge your own Bias

We all come to a domain with preconceived ideas about what we think might be happening, changes we expect to see or areas within a domain we think are more forward-looking. After your first round of research, ask yourself - what signals can I find that might challenge this completely? How might the opposite be true? What would a contrarian view look like and is there anything in this space that might substantiate another perspective? Likewise with geographic bias - look for signals across multiple regions, read blogs, papers and the tweets or posts of people in another region or part of the industry. Check your own bias frequently and make a big effort to gather multiple perspectives across the globe and from different segments, types of actors within the domain and mainstream vs outlier or contrarian sources.

As foresight researchers, our insights are only as good as the information they’re based on; cultivating a critical eye and a systematic approach to research empowers us to avoid pitfalls and deliver valuable, forward-looking insights with strong and rigorous chains of custody.

Other Blog Posts

Research

March 5, 24

How will declining birthrates and ageing populations shape our potential futures?

Politics

April 3, 202

Research

May 2, 2019

Contemplating the right question is often more important than crafting the right answer.

Education

May 1, 2020

As a school student, how might you think about Earlywork as an opportunity to showcase who you are and what you’re capable of?

Story

March 6, 2023

A Science Fiction Prototyping approach to imagining our future oceans.

Research

June 5, 2023

Inputting research and information as networked knowledge nodes with supertags surfaces connections and patterns you might not otherwise pick up.

Design

September 10, 2023

Is AI Stripping Creativity from Architecture? The Dangers of Algorithm-Driven Design

Education

September 24, 2023

What if . . we framed education as an example of chaos theory?

Education

October 17, 2023

Will school education will eventually reform as an emergent system with technology embedded as a key shaping force?

Research

October 24, 2023

Education

April 18, 2024

What if . . instead of the failures of students, we focused on the failure of systems?. . and used that understanding to collectively reimagine education?

Think

May 29, 2024

Navigating the space between

Think

May 30, 2024

Embracing Multiple Temporalities

Research

August 20, 2024

UX (User eXperience) is in some ways, a philosophical enquiry, inviting us to question - What is this really about? What is the role of design in this moment?

History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric

Books

September 9, 2024

History for Tomorrow by Roman Krznaric

History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric

Books

September 9, 2024

History for Tomorrow by Roman Krznaric

Climate Futures Activism
Climate Futures Activism
Climate Futures Activism
Climate Futures Activism

Books

September 19, 2024

If we disallow radical flank activism does the right to protest mean anything at all?

History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric
History for Tomorrow by Roman Krznaric

Books

September 21, 2024

History for Tomorrow by Roman Krznaric

Reproductive Justice
Reproductive Justice
Reproductive Justice
Reproductive Justice

Think

September 21, 2024

Thinking about Foucault in the context of women worldwide and reproductive justice

Books

September 30, 2024

History for Tomorrow by Roman Krznaric

Think

October 15, 2024

Is AI is a technology of extraction?

Books

October 27, 2024

History for Tomorrow by Roman Krznaric

Books

November 13, 2024

When we think about development, can the concept of 'equity' be reconceptualised to connect with the context of the Global South without recovering / making visible, plural definitions of 'prosperity' or 'wellbeing'?

👋 say hello