This experimental project that combines data science and statistical processes, design-thinking techniques, and qualitative research methods. It was launched by UNHCR’s Innovation Service in May 2017 to make better decisions with regards to population movements in the Horn of Africa.
Project Jetson, with its machine-learned predictive analytics engine, is first of its kind in the humanitarian sector. The overall goal is to expand to more regions with improved automation processes and publish one deployable package for partners and other audiences to benefit from it.
The above range is based on different computer models that are selected based on two factors: 1) the best model data that ‘fits’ the historical data (R^2), and 2) its mean absolute error (MAE).
The MAE measures the accuracy of future month predictions, and is the difference between the future predictive arrivals vs. actual future arrivals. In short, it describes the margin of error of arrivals. So the higher the MAE, the less accurate the prediction. The MAE varies from model to model.
R^2 is the value of how close the model is based on historical data. The closer (or fit) the model, the higher the value, with 1.0 being the most ideal fit.
Version 1 and 2 focused on the concept of the predictive analytics engine and simulated arrival figures. Version 3 provides a functioning technology and model that predicts regional arrivals with 75% to 99% accuracy of the model.
Design: The newest version of Jetson provides a lighter, faster, and a simpler user interface with the key focus on predicted monthly arrival figures rather than a simulation of population from version 1 and 2.
Automation Process: 50% of processes completed in version 1 and 2 were done by humans but are now performed automatically, by machines, freeing up valuable time for further development and expansion of prediction regions. We are still refining the processes to be almost semi-automated (still humans are needed to ‘click’ the button to execute the various processes). .
Climate: FAO-SWALIM, WMO, IGAD-ICPAC, UNOSAT, World Bank
Infrastructure: UNOSAT
Conflict: ACLED
Food Security: FAO-FSNAU, FEWES
Data Science support: UN Global Pulse, Essex University, Uptake.org
The next steps for Project Jetson are to improve the software deployment of the service and introduce new prediction regions.
We aim to have the predictive analytics software as a complete package that can be installed and run locally, by operations (and in some cases individuals).
The Jetson complete package will consist of the following processes:
Collecting data from multiple online sources
Transforming data into-machine readable formats and pushing it online
Running the predictive analytics algorithms
Analysing the model's results
Running the analysed statistical correlations to compare model's accuracy vs. actual figures
Detecting the arrival range (predicted population arrivals)
Deciding on best model according to human decision-making rules
Communicating and visualizing the results for the operation
The deployable package will also include a model monitoring element that picks the best algorithm for the next month and detects the population arrival range, according to analysed correlations. The arrival range on the website is the result of this process.
The automation effort of all technical processes involved will be continuing, therefore minimising human decision making and ‘interference’ where not relevant. This will leave more resources for the Jetson team to focus on top line decisions for the predicted arrivals and the project in general.