© Olena Kaminska. Article available under the CC BY-SA 4.0 licence
ARTICLE
ABSTRACT
Conflict situations pose unique challenges before survey sample design, three of which are examined in this paper in the context of the ongoing full-scale war in Ukraine. Firstly, defining the population becomes a complex task as a result of substantial population changes. This includes internal displacement, a significant proportion of the population emigrating (but with a potential future return), and a considerable number of individuals actively engaged in combat who are currently unreachable for interviews. Secondly, defining households, particularly for longitudinal studies, is complicated by the temporary separation of many families. Thirdly, accurate accounting for vacant and demolished dwellings is essential, as national statistics often lack precise and reliable data in these areas. This study outlines the design of two samples: one for a cross-national European Social Survey in Ukraine (ESS), and the other for the longitudinal household panel study, UKRAINS. By carefully addressing these complex sampling challenges, it is possible to develop high-quality probability samples that account for population mobility and unpredictability in a wartime context.
KEYWORDS
sample design, population definition, eligibility, conflict, war.
REFERENCES
Aguilera, A., Krishnan, N., Munoz, J., Russo Riva, F., Sharma, D. and Vishwanath, T., (2020). Sampling for Representative Surveys of Displaced Populations. In J. Hoogeveen & U. Pape (Eds.), Data Collection in Fragile States (Chapter 8). International Bank for Reconstruction and Development/The World Bank.
Box, K., Thomas, G., (1944). The Wartime Social Survey. Journal of the Royal Statistical Society, 107(3/4), 151-189. Wiley for the Royal Statistical Society. Stable URL: https://www.jstor.org/stable/2981213.
Cafiero, C., Yassin, F., Hopkins, C. and Battistella, E., (2021). Food Security & Livelihoods Assessment in Eastern Ukraine. FAO. Retrieved from https://fscluster.org/sites/default/files/documents/eastern_ukraine_gca_food_security_and_livelihood_final-ready_to_print.pdf.
European Social Survey European Research Infrastructure Consortium (ESS ERIC) Director, in collaboration with the Core Scientific Team (CST), (2021). Round 11 Survey Specification for ESS ERIC Member, Observer and Guest Countries (v1), November 29, 2021. Retrieved from https://www.europeansocialsurvey.org/sites/default/files/ 2023-06/ESS11_survey_specification.pdf.
ILO Decent Work Technical Support Team and Country Office for Central and Eastern Europe, (2016). Employment needs assessment and employability of internally displaced persons in Ukraine: summary of survey findings and recommendations / Budapest: ILO. Retrieved from https://www.ilo.org/wcmsp5/groups/public/---europe/---ro-geneva/---sro-budapest/documents/publication/wcms_457535.pdf.
IOM UN migration, (2024). Ukraine & neighbouring countries 2022-2024: 2 years of response. Retrieved from https://www.iom.int/sites/g/files/tmzbdl486/files/documents/2024-02/iom_ukraine_neighbouring_countries_2022-2024_2_years_of_response.pdf.
Khoury, R. B., (2020). Hard-to-survey populations and respondent-driven sampling: Expanding the political science toolbox. American Political Science Review, 18(2). https://doi.org/10.1017/S1537592719003864.
Kish, L., (1965). Survey Sampling. John Wiley and Sons Inc., New York.
Kulu, H., Christison S., Liu C. and Mikolai J., (2022). The war and the future of Ukraine’s population. MigrantLife, Working paper 9.
Libanova, E., Pozniak, O., (2023). War-driven wave of Ukrainian emigration to Europe: An attempt to evaluate the scale and consequences (the view of Ukrainian researchers). Statistics in Transition new series and Statistics of Ukraine, A New Role for Statistics: Joint Special Issue, 24(1), pp. 259–276. ISSN 1234-7655.
Lubbad, I., (2024). Presentation at the inaugural meeting: Revision of the United Nations Handbooks related to Household Surveys. Household surveys in conflict and humanitarian settings. Cluster 4: Statistics, Information Society and Technology, Economic and Social Commission for Western Asia.
Lynn, P., (2004). Development of a sampling method for household surveys in postwar Bosnia and Herzegovina. Statistics in Transition, 6(6), pp. 953–977.
Mikheieva, O., Kuznetsova, I., (2023). Internally displaced and immobile people in Ukraine between 2014 and 2022: Older age and disabilities as factors of vulnerability. Migration Research Series, No. 77. International Organization for Migration (IOM), Geneva.
Mneimneh, Z. N., Axinn, W. G., Ghimire, D., Cibelli, K. L. and Alkaisy, M. S., (2014). Conducting surveys in areas of armed conflict, 7, pp. 134–156. Cambridge University Press. https://doi.org/10.1017/CBO9781139381635.010.
Myroshnychenko, V., (2023). The shifting demography of the Occupied Territories (2022-2023). Retrieved from https://t4pua.org/en/2119.
Organization for Security and Co-operation in Europe (OSCE), (2014). Protocol on the results of consultations of the Trilateral Contact Group, signed in Minsk, 5 September 2014, OSCE, retrieved 3, July 2024, https://www.osce.org/files/f/documents/a/a/123258.pdf.
Organization for Security and Co-operation in Europe (OSCE), (2015). Package of Measures for the Implementation of the Minsk Agreements, 12 February 2015, OSCE, retrieved 3, July 2024, https://www.osce.org/files/f/documents/5/b/ 140221.pdf.
Ostiller, N., and The Kyiv Independent news desk, (2023). Up to 800,000 Russians have reportedly moved to Crimea since occupation in 2014. The Kyiv Independent. Retrieved from https://kyivindependent.com/media-around-800-000-russians-havemoved-to-occupied-crimea-since-illegal-annexation-in-2014/.
Paniotto, V., (2022). Challenges of surveys in Ukraine under conditions of war. In Workshop The future of social research in and on Russia and Ukraine. Hanse- Wissenschaftskolleg Delmenhorst.
Raifman, S., DeVost, M. A., Digitale, J. C., et al., (2022). Respondent-Driven Sampling: a Sampling Method for Hard-to-Reach Populations and Beyond. Curr Epidemiol Rep, 9, pp. 38–47. https://doi.org/10.1007/s40471-022-00287-8.
Reichel, D., Morales, L., (2017). Surveying immigrants without sampling frames – evaluating the success of alternative field methods. CMS, 5, 1. https://doi.org/10.1186/s40878-016-0044-9.
Rickard, K., Toal, G., Bakke, K. M. and O’Loughlin, J., (2023). How Reliable Are Polls In Wartime Ukraine? PONARS Eurasia Policy Memo No. 830. United Nations University, Virginia Tech, University College London, Peace Research Institute Oslo (PRIO), University of Colorado Boulder.
Rogoza, J., (2023). Ukraine in the face of a demographic catastrophe. OSW Commentary, Centre for Eastern Studies, 524.
Sarioglo, V., Ogay, M., (2023). Approach to population estimation in Ukraine using mobile operators' data. Statistics in Transition new series and Statistics of Ukraine, A New Role for Statistics: Joint Special Issue, 24(1), pp. 131–144. ISSN 1234-7655.
Shannon, H. S., Hutson, R., Kolbe, A., Stringer, B. and Haines, T., (2012). Choosing a survey sample when data on the population are limited: A method using Global Positioning Systems and aerial and satellite photographs. Emerging Themes in Epidemiology, 9(5). http://www.ete-online.com/content/9/1/5.
Spagat, M., (2012). Estimating the Human Costs of War: The Sample Survey Approach. In M. R. Garfinkel & S. Skaperdas (Eds.), The Oxford Handbook of the Economics of Peace and Conflict. Oxford Handbooks. https://doi.org/10.1093/oxfordhb/9780195392777.013.0014.
UNHCR, Regional Bureau for Europe. (2024, February). Ukraine refugee situation: Population movements | Factsheet #1. Retrieved from https://data.unhcr.org/en/documents/details/106707.
UNICEF, (2024). Humanitarian action for children: Ukraine and refugee response. Retrieved from https://www.unicef.org/media/150011/file/2024-HAC-Ukraine.pdf
West, P. W., (2016). Simple random sampling of individual items in the absence of a sampling frame that lists the individuals. N. Z. j. of For. Sci., 46, 15. https://doi.org/10.1186/s40490-016-0071-1.
Wikipedia contributors, (2024). 2001 Ukrainian census. In Wikipedia, The Free Encyclopedia. Retrieved 10, 30, July 3, 2024, from https://en.wikipedia. org/w/index.php?title=2001_Ukrainian_census&oldid=1216156907.