The use of plant models in deep learning: an application to leaf counting in rosette plants

Jordan Ubbens1, Mikolaj Cieslak2, Przemyslaw Prusinkiewicz2, Ian Stavness1
1 University of Saskatchewan, Saskatoon, Canada
2 University of Calgary, Calgary, Canada

Abstract

Deep learning presents many opportunities for image-based plant phenotyping. Here we consider the capability of deep convolutional neural networks to perform the leaf counting task. Deep learning techniques typically require large and diverse datasets to learn generalizable models without providing a priori an engineered algorithm for performing the task. This requirement is challenging, however, for applications in the plant phenotyping field, where available datasets are often small and the costs associated with generating new data are high. In this work we propose a new method for augmenting plant phenotyping datasets using rendered images of synthetic plants. We demonstrate that the use of high-quality 3D synthetic plants to augment a dataset can improve performance on the leaf counting task. We also show that the ability of the model to generate an arbitrary distribution of phenotypes mitigates the problem of dataset shift when training and testing on different datasets. Finally, we show that real and synthetic plants are significantly interchangeable when training a neural network on the leaf counting task.

Reference

Jordan Ubbens, Mikolaj Cieslak, Przemyslaw Prusinkiewicz, and Ian Stavness. The use of plant models in deep learning: an application to leaf counting in rosette plants. Plant Methods 14(1):6, 2018.

Download PDF here (3.5 Mb) or from the publisher's site.
Download supporting information here (276 Kb) or from the publisher's site.