this is SIGIR 2018 Search Engine Volatility Appendix