Skip to main content

The Challenges in Collecting Self-Reported Agricultural Data

Some of the greatest challenges that we encounter as researchers involved in primary data collection lie in tackling inherent biases in self-reported data such as respondent bias, enumerator bias, and recall bias. This blog series deals with one of the ways in which we, at the KGFS study are exploring the potential to reduce such bias by utilizing creative survey instruments and design. One of the more particular objectives of our project aims to evaluate the impact of access to finance on agricultural practices and identify robust methods of collecting self-reported data on agricultural input usage in order to do so. 

Unbiased information on agricultural practices throughout a cropping season is crucial for analyzing their effect on more objective outcomes such as yield or crop forecasts and making comparisons across farmers, as well as for recommending the right interventions. Collecting such information from farmers if often a tricky task due to the following reasons:
  1. Non-availability of the specific person in the household in charge of certain productive activities at the time of the single point survey.
  2. Non-measurement or usage of non-standard measurement units.
  3. Social desirability bias, especially in answering questions about wages, fertilizer use etc.
  4.  Lack of information that can be used to cross check self-reported data
  5. Following multiple schedules and practices such as intercropping and sharecropping, make it difficult for farmers to single out the inputs and productive expenditures that go into the cultivation of that particular crop unit in question.
  6. Questionnaires in most studies are administered at one point in time and test recall of expenses or usage over the entirety of the last completed season (which could entail a large recall period of over four months, depending on the crop schedule and the lag at which the survey is conducted).
  7. Most small-scale farmers do not meticulously track their expenses and usage and are more prone to being spontaneous spenders and users.
  8. Due to the highly specialized nature of agricultural practices, inadequate training of survey staff on the various aspects of cultivation and common terminology causes them to overlook presence of unreported or wrongly reported data. 

The standard multipurpose household survey used to obtain farm-related data is thus prone to large measurement errors that undermine its usefulness in agricultural analyses. Additionally, prohibitively high costs of making repeated visits to collect periodic data and administering customized treatments present a trade-off between data quality and scale. 

However, there are several follow up survey instruments that enable researchers to reduce recall periods by maintaining continuous contact with the respondent over a period of time while not having to bear the high costs of revisits. Such instruments include a) Mail surveys, b) Online surveys, c) Group Administered Surveys, d) Telephonic interviews (or Computer Assisted Telephonic Interviews, CATI)  and several other mixed mode surveys such as Interactive Voice Response, Audio Computer-Assisted Self-Interviewing. A commonly underutilized survey methodology that we have chosen to administer on our pilot sample is a Diary-based survey.

A diary based data collection instrument is a self-administered document that necessitates reporting within a specific time interval or as and when certain events occur. Diaries have been used in a variety of domains including health, psychology and economics and most popularly to record consumption expenditure in studies such as the World Bank’s Living Standards Measurement Study (LSMS). Their potential in recording production data in agriculture (through what are referred to as “harvest diaries”) is slowly being realized.

An LSMS survey being conducted (Photocredit: World Bank)

Traditional pen and paper diaries are also the most natural way of recording information among those unfamiliar with technology or residing in areas where use of technology is infeasible. For our study, we have decided to explore the potential of using harvest diaries to record the quantity and value of inputs employed by paddy farmers in our study areas in rural Tamilnadu during the ongoing paddy season, locally known as “samba”.  Over the next two posts, this series will share our experience in designing a diary based follow up and the lessons we have learnt thus far. 


Popular Posts

Vocationalisation of education in India: Current Scenario, Key Challenges and New directions

“Every handicraft has to be taught not merely mechanically as is done today, but scientifically. This is to say, the child should learn the why and wherefore of every process.” - Gandhi’s Philosophy of Education

The greatest challenge in Indian education system today is to provide skill based education to the youth. This is exacerbated by a mismatch in demand and supply for the skilled workforce. The penetration of vocational education and training remains poor not only in rural areas, but also in urban regions where there is a higher installed capacity to impart the same. This post is an attempt to make the readers understand the need of vocational education in India. Also, this is an attempt to summarise a few recommendations on the same. 
A recent survey (61st round) conducted by the NSSO found that:

1. The percentage of population that completed primary education was 70%, but less than 10% went on to complete a graduation course and above. Almost 97% of individuals in the age bracket…

Rockstar of Financial Inclusion: Business Correspondent Model of India

About Author:  Jatinder Handoo is a social business enthusiast and a branchless banking practitioner. Currently works at FINO PayTech Ltd and is based out of Mumbai. He is reachable at
India is a hot bed of financial exclusion. A country which houses nearly 16% of the global population  has more than 65% of its people outside the formal financial system (Global Findex 2012). The Indian banking system has adopted multiple approaches to make universal financial inclusion a reality right from early days Indian post-independence banking system. Be it bank nationalization in 1969 or formation of Regional Rural Banks. Formation of NABARD or fostering microfinance through Bank-SHG linkage programme in early 90’s. A shimmering ray hope was rekindled with the growth of JLG based microfinance, however later studies made it clear that the model is credit led, concentrated predominately in the southern region of India thus could not be seen as painting complete financial…

A Platform for Knowledge - Enabling people to learn ..

I received a rather interesting link/website via my email today. The link read as MR University and all I could think of was, "Ok, this must be another website portal of some university or college". Well, on clicking the link and looking through the contents of the site, I was pleasantly surprised. The site is an online education portal or platform that allows users or teachers to upload short videos on topics or lessons they wish to impart. First topic that I come across is Development Economics.
The intent of the website is eloquently put out by the two economists, Tyler Cowen and Alex Tabarrok in the intro video. What started as a blog focusing on economics and its various implications in understanding why things are the way they are around us, has now an interesting addition. A video portal titled MRUniversity or Marginal Revolution University that focuses on online education with subjects pertaining to economics. It brought back to my mind,…