What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?

Mayer N, Ilg E, Fischer P, Hazirbas C, Cremers D, Dosovitskiy A, Brox T (2018)


Publication Type: Journal article

Publication year: 2018

Journal

Book Volume: 126

Pages Range: 942-960

Journal Issue: 9

DOI: 10.1007/s11263-018-1082-6

Abstract

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising algorithms to creating suitable and abundant training data for supervised learning. How to efficiently create such training data? The dominant data acquisition method in visual recognition is based on web data and manual annotation. Yet, for many computer vision problems, such as stereo or optical flow estimation, this approach is not feasible because humans cannot manually enter a pixel-accurate flow field. In this paper, we promote the use of synthetically generated data for the purpose of training deep networks on such tasks. We suggest multiple ways to generate such data and evaluate the influence of dataset properties on the performance and generalization properties of the resulting networks. We also demonstrate the benefit of learning schedules that use different types of data at selected stages of the training process.

Involved external institutions

How to cite

APA:

Mayer, N., Ilg, E., Fischer, P., Hazirbas, C., Cremers, D., Dosovitskiy, A., & Brox, T. (2018). What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation? International Journal of Computer Vision, 126(9), 942-960. https://doi.org/10.1007/s11263-018-1082-6

MLA:

Mayer, Nikolaus, et al. "What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?" International Journal of Computer Vision 126.9 (2018): 942-960.

BibTeX: Download