"So What Do I Get From This?"
"Kya sir, 'log survey karne aate hain, karke chale jaate hain aur hame kuchh nahin milta', voh budda bol raha tha", the surveyor said. "usko ID card bhi nahin diya. Ab uska kya javaab de?"
Translation: "What sir, 'people come, conduct surveys and leave, while we get nothing out of it", the surveyor said. "That's what the old man was saying. He didn't even get an ID card. What can I tell him?"
He's just hit a nerve here, forcing me to try and explain what the respondents get from our survey. PIs seem to have good explanations for this sort of thing: policy relevance, extending an analogy, ensuring better delivery of services or a better allocation of resources.
It's hard for me as an RA to be able to step back and look at larger picture like that. Generally, my focus is limited to the study: the respondents, the survey and the surveyors. I have neither the knowledge of the current state of policy nor a guiding philosophy for what research should achieve; something that PIs tend to have. I am then left with this uphill struggle, trying to find something to justify the respondent's time given to the survey.
I suppose the traditional argument still holds: that by evaluating the programs we can get a better understanding of their impact and hence help promote more effective development programs. This is then helpful for the recipients of these schemes and since the respondents are typically recipients as well, they should see the benefits of the study too. Whether the costs are higher than expected benefits is not immediately clear.
It is clear that this is something we must consider and that the least we can do is to make our surveys as short, painless and unobtrusive as possible. Let's make it a point to push our surveys and PIs in this direction and make this a standard of survey design.