Skip to main content

Basic field research pitfalls that sabotage our research

Isn't research exciting? We can help identity problems that are perhaps not apparent on the surface and yet exist, or are likely to arise in the future; at the same time, we also help practitioners arrive at solutions. It is quite a fulfilling job. Nonetheless, have you ever wondered about the consequences of a perfectly well planned but ill-designed  research?

Recently, a practitioner wondered why their agricultural innovation initiative failed to take off. We researched and found that more than 50% of the initiative’s target population were landless laborers, and they did not care about sophisticated agricultural innovation when they did not have any land. “We had conducted a baseline survey, and were aware that they were landless laborers, but we thought they would be ready if provided with an opportunity,” expressed the practitioner.  

This is a perfect example of a million-dollar social development program gone wrong due to the most elementary mistake- not identifying and defining the true research problem.  “Will landless laborers adopt the agricultural innovation if they are provided with loan to lease land?” or “Should we introduce this initiative now when majority of our target market is landless laborers?” would have saved this program. 

Many times, we get so excited about the notion of conducting research that we forget to invest more time on clearly defining the research problem. No matter how rigorous our sampling strategy, research tools and data collection procedures are, all the efforts, time and money spent are wasted if the research problem is misunderstood or ill defined. As experts say, “A serious mistake is not made as a result of wrong answers but because of asking the wrong questions at the wrong time.

I’d like to emphasize on “research at the wrong time” part.  Take this as an example, you are asked to understand the financial behavior of consumers. How misleading the findings on saving and spending habits would be if you conduct this research during shopping seasons, such as Diwali, Eid, or Christmas. 

Another example is if you are to conduct a research to understand rural women's knowledge of reproductive rights and incidences of domestic violence, will you trust your findings if all women were interviewed in front of their husband? In general, rural women do not open up about domestic issues in front of their husband.

In short, we need to be aware of respondents’ lifestyle, culture, and priorities when we decide on the timing and place of our research.



In one of the gender-based studies, we designed two modules, one for the male head of the household, and one for female. While a male surveyor kept male respondents busy asking about agriculture and other livelihoods strategies related questions, a female surveyor built rapport with female respondents, and asked about their reproductive rights and other sensitive issues.  The majority of women reported of domestic violence;  not informing their husband about precautions they were taking to plan or prevent pregnancy; and not having any financial decision making autonomy. We could have never got such sensitive data if we had not been a little innovative about our research approach.  


Lastly, how surveyors are asking questions makes a huge difference. In a hot summer afternoon, somewhere in a remote village,  it is very likely that surveyors choose a respondent who is readily available (not necessarily randomly selected).  While we have a rigorous monitoring system to avoid these errors, sometimes surveyors' technique of asking might produce wrong data.    

For example, many times, respondents are unwilling to provide accurate information, particularly when you ask about money. As a researcher, we must foresee such snags. Once,  a client asked us to find the crop productivity in a certain study area. The questions were difficult, as we were asking respondents to remember the quantity of crops, selling rate and income they made in the previous year. Despite going through our standard training session, each surveyor's different technique of probing made a huge variation in answers. The first set of initial data was a disaster. We re-trained and monitored surveyors on probing technique again. After all  surveyors asked the question in the same way,  data turned out well.

In closing, while conducting research can be very exciting, it is also vulnerable to many pitfalls.  As a researcher, it is our responsibility to continuously improve the quality of our research. In order to do so, we must learn and stay mindful of possible errors, and take timely action to prevent them from creeping into our studies.

Finally, no matter how many years you have spent designing research studies, going back to Research 101 and reading the basics, will always do you good.









Comments

Popular Posts

Vocationalisation of education in India: Current Scenario, Key Challenges and New directions

“Every handicraft has to be taught not merely mechanically as is done today, but scientifically. This is to say, the child should learn the why and wherefore of every process.” - Gandhi’s Philosophy of Education

The greatest challenge in Indian education system today is to provide skill based education to the youth. This is exacerbated by a mismatch in demand and supply for the skilled workforce. The penetration of vocational education and training remains poor not only in rural areas, but also in urban regions where there is a higher installed capacity to impart the same. This post is an attempt to make the readers understand the need of vocational education in India. Also, this is an attempt to summarise a few recommendations on the same. 
A recent survey (61st round) conducted by the NSSO found that:

1. The percentage of population that completed primary education was 70%, but less than 10% went on to complete a graduation course and above. Almost 97% of individuals in the age bracket…

Rockstar of Financial Inclusion: Business Correspondent Model of India

About Author:  Jatinder Handoo is a social business enthusiast and a branchless banking practitioner. Currently works at FINO PayTech Ltd and is based out of Mumbai. He is reachable at jatinder.handoo@fino.co.in
India is a hot bed of financial exclusion. A country which houses nearly 16% of the global population  has more than 65% of its people outside the formal financial system (Global Findex 2012). The Indian banking system has adopted multiple approaches to make universal financial inclusion a reality right from early days Indian post-independence banking system. Be it bank nationalization in 1969 or formation of Regional Rural Banks. Formation of NABARD or fostering microfinance through Bank-SHG linkage programme in early 90’s. A shimmering ray hope was rekindled with the growth of JLG based microfinance, however later studies made it clear that the model is credit led, concentrated predominately in the southern region of India thus could not be seen as painting complete financial…

A Platform for Knowledge - Enabling people to learn ..

I received a rather interesting link/website via my email today. The link read as MR University and all I could think of was, "Ok, this must be another website portal of some university or college". Well, on clicking the link and looking through the contents of the site, I was pleasantly surprised. The site http://www.mruniversity.com/ is an online education portal or platform that allows users or teachers to upload short videos on topics or lessons they wish to impart. First topic that I come across is Development Economics.
The intent of the website is eloquently put out by the two economists, Tyler Cowen and Alex Tabarrok in the intro video. What started as a blog focusing on economics and its various implications in understanding why things are the way they are around us, has now an interesting addition. A video portal titled MRUniversity or Marginal Revolution University that focuses on online education with subjects pertaining to economics. It brought back to my mind,…