“Towards the quantitative evaluation of visual attention models” in Vision Research
“Towards the quantitative evaluation of visual attention models” by Z. Bylinskii, E.M. DeGennaro, R. Rajalingham, H. Ruda, J. Zhang, J.K. Tsotsos has been accepted in Vision Research.
It provides some examples of operationalizing and benchmarking different visual attention tasks, along with the relevant design considerations.
http://www.sciencedirect.com/science/article/pii/S0042698915001522