Neglecting qualitative data and lack of stakeholder engagement are two common mistakes in monitoring and evaluation (M&E). Experiential knowledge shows that while mixed methods are the preferred data collection methodology for most clients in research, and monitoring and evaluation, qualitative data collection often happens only after or simultaneously with quantitative data collection. While qualitative data collection expects to fill gaps in quantitative data, simultaneous quantitative and qualitative data collection frequently leaves several gaps unaddressed.
The researcher cannot analyze quantitative data and, based on the analysis, develop qualitative tools to address data gaps more precisely. Therefore, the qualitative data remains underutilized, often merely getting summed up and not integrated completely. Another grey area in research and M&E is the lack of stakeholder engagement in the design of the approach and tools, primarily at the community level, where most projects or programs are implemented.
These pitfalls can be critical from the point of view of providing a comprehensive research (or M&E) outcome, given that people’s voices do not get included in research findings. The solution to these challenges can be using a transformative approach in research and M&E.
What is a Transformative Approach or Transformative Research Paradigm?
The transformative research paradigm has emerged as a response to the limitations of traditional research methodologies, with the potential to bring about significant change in how we understand and address social problems. Methodologies commensurate with a transformative approach include using mixed methods, viewing the researcher’s role as a social change agent, learning from social activism, employing specific strategies for culturally responsive inclusion, addressing power differences, and planning for sustainability. According to Mertens (2011), the transformative paradigm considers “lives and experiences of marginalized groups and the transformative ontological assumptions of this approach look into the reality in terms of power relations and differential access of power.” Transformative research has been previously used in the context of forced migration, tribal migration, and disability studies to ensure that the research was participatory and engaging. Therefore, a transformative approach can be the most suitable approach while undertaking research with members of marginalized communities, such as people with disabilities.
Transformative Approach in Disability Research in Afghanistan
The Asia Foundation Model Disability Survey for Afghanistan showed that 17.3% of children and 80% of adults had some form of disability, with prevalence higher in women. Further, calculations based on the NSA Estimated Population of Afghanistan (2020−21) data showed that around 3 million children in Afghanistan might be facing severe disability. Based on the state of disability, with a particular focus on child disability in Afghanistan, the Enabled Children Initiative (ECI) initiated a communication campaign to address the stigma associated with disability. Such stigma can adversely affect a person or child with disability throughout his or her life. Further, a lack of public awareness of disability can prove to be a major impediment to creating an enabling environment for them.
As a first step in developing a nationwide communication campaign, Adroit Associates undertook a knowledge, attitude, and practice (KAP) study in the form of a baseline assessment to explore and study the present beliefs and associations regarding disability, with a major focus on child disability. The unique aspect of this baseline study was the use of a transformative approach. This approach essentially included a multiphase design of tools. This approach included undertaking qualitative data collection first. Based on an analysis of qualitative data (primarily focus group findings), a quantitative tool was developed. Additional qualitative tools in the form of key informant interviews were used, along with the questionnaire, to arrive at comprehensive findings for the study. Using such a multiphase approach to data collection helped address all possible data gaps and develop useful insights on disability in Afghanistan.
The major findings from the study included an in-depth understanding of perceptions about disability, how disability affects the individual and family, the stigma associated with disability, and ways in which stigma, abuse, neglect, and indifference can be addressed at the societal level. One of the significant findings was that most respondents believed that disability was not an inability and that with the right opportunity and the environment, even people with disabilities could perform well. In addition, most respondents strongly agreed that people with disabilities should be involved in decision-making, have equal livelihood opportunities, have equal rights with other able-bodied individuals, and can do much better than able-bodied people. Several case studies pointed to the fact that people with disabilities have led by example in Afghan society, and their limitations to excel have been merely based on the lack of a supportive environment.
Conclusion
This baseline study, conducted using a transformative approach, was a departure for Adroit Associates from its more traditional approach to conducting research, monitoring, and evaluation assignments. In fact, the approach was found to be intriguing and highly interesting by ECI and resulted in awarding the study to Adroit. The study, conducted across 16 provinces in Afghanistan, explored the complex and dynamic nature of disability, focusing on attitudes, knowledge, and practices related to disabilities, particularly among children.
Utilizing a transformative mixed-methods approach, the study involved 134 focus group discussions, 67 key informant interviews, 16 case studies, and 1,886 surveys. Findings revealed that while physical disabilities are more readily recognized, mental and intellectual disabilities remain contested. War and conflict were major causes of disabilities, with inbreeding noted as a significant factor for congenital disabilities. The study highlighted the stigma, abuse, and neglect faced by people with disabilities, emphasizing the need for societal change. While there was support for inclusive education and activities, respondents were hesitant to grant full autonomy to individuals with disabilities. The primary responsibility for care was placed on family members, especially mothers, with limited awareness of community support systems. Television emerged as the most preferred medium for information, suggesting its potential for raising awareness in the upcoming public awareness campaign.
The experience from this baseline assessment shows that a transformative approach can provide greater possibilities for practitioners to include subjects in the research process with a major voice in designing tools for data collection. This increases the ownership of the research among the research subjects. Further, the transformative research approach also reduces the power of the researcher over the research subjects, making the research process empowering for the subjects.