Applying Deep Learning to Melanocyte Counting on Fluorescent TRP1 Labelled Images of In Vitro Skin Model

Authors

  • Tristan Lazard Mines Paris, PSL University, Centre for Mathematical Morphology
  • Samy Blusseau Mines Paris, PSL University, Centre for Mathematical Morphology https://orcid.org/0000-0003-0294-8172
  • Santiago Velasco-Forero Mines Paris, PSL University, Centre for Mathematical Morphology
  • Étienne Decencière Mines Paris, PSL University, Centre for Mathematical Morphology
  • Virginie Flouret L'Oréal Research and Innovation
  • Catherine Cohen L'Oréal Research and Innovation
  • Thérèse Baldeweck L'Oréal Research and Innovation

DOI:

https://doi.org/10.5566/ias.2640

Keywords:

cell counting, convolutional neural networks (CNN), deep learning, fluorescence microscopy, histology, immunohistochemistry (IHC), reconstructed skin

Abstract

Cell counting is an important step in many biological experiments. It can be challenging, due to the large variability in contrast and shape of the cells, especially when their density is so high that the cells are closely packed together. Automation is needed to increase the speed and quality of the detection. In this study, a cell counting method is developed for images of melanocytes obtained after fluorescent labelling with TRP1 (Tyrosinase-related protein 1) of 3D reconstructed skin samples. Following previous approaches, a strategy based on predicting the local cell density, by means of a convolutional neural network (a U-Net), was adopted. The method showed great efficiency on a test set of 76 images, with an assessed counting error close to 10% on average, which is a commonly accepted target in cytology and histology. For comparison purposes, we have made our dataset publicly available.

References

Arteta C, Lempitsky V, Zisserman A (2016). Counting in

the wild. In: Leibe B, Matas J, Sebe N, Welling M,

eds., Proceedings of the European Conference on Computer Vision (ECCV).

Cham: Springer

International Publishing.

Berge H, Taylor D, Krishnan S, Douglas TS (2011).

Improved red blood cell counting in thin blood smears.

In: I S BIOMED IMAGING.. IEEE.

Chadha GK, Srivastava A, Singh A, Gupta R, Singla D

(2020). An automated method for counting red blood

cells using image processing. PROCEDIA COMPUT

SCI 167:769–78.

Cohen JP, Boucher G, Glastonbury CA, Lo HZ, Bengio Y

(2017). Count-ception: Counting by fully convolutional

redundant counting. In: Proceedings of the IEEE

International Conference on Computer Vision (ICCV)

Workshops.

Duval C, Cohen C, Chagnoleau C, Flouret V, Bourreau

E, Bernerd F (2014). Key regulatory role of dermal

fibroblasts in pigmentation as demonstrated using a

reconstructed skin model: impact of photo-aging. PLoS

One 9:1–25.

Falk T, Mai D, Bensch R, Çiçek Ö, Abdulkadir A,

Marrakchi Y, Böhm A, Deubner J, Jäckel Z, Seiwald

K, et al. (2019). U-net: deep learning for cell counting,

detection, and morphometry. NAT METHODS 16:67–70.

Han S, Lee S, Fu C, Salama P, Dunn KW, Delp EJ

(2019). Nuclei counting in microscopy images with

three dimensional generative adversarial networks. In:

Angelini ED, Landman BA, eds., Medical Imaging

: Image Processing, vol. 10949. International

Society for Optics and Photonics, SPIE.

He S, Minn KT, Solnica-Krezel L, Anastasio MA, Li

H (2021). Deeply-supervised density regression for

automatic cell counting in microscopy images. MED

IMAGE ANAL 68:101892.

Khan A, Gould S, Salzmann M (2016). Deep convolutional

neural networks for human embryonic cell counting. In:

Hua G, Jégou H, eds., Proceedings of the European Conference on Computer Vision (ECCV) Workshops. Cham: Springer International Publishing.

Kingma DP, Ba J (2015). Adam: A method for stochastic

optimization. In: Bengio Y, LeCun Y, eds., ICLR.

Laradji IH, Rostamzadeh N, Pinheiro PO, Vazquez D,

Schmidt M (2018). Where are the blobs: Counting by

localization with point supervision. In: Proceedings of

the European Conference on Computer Vision (ECCV).

Lempitsky V, Zisserman A (2010). Learning to count

objects in images. ADV NEUR IN 23:1324–32.

Liu Q, Junker A, Murakami K, Hu P (2019). A novel

convolutional regression network for cell counting.

In: 2019 IEEE 7th International Conference on

Bioinformatics and Computational Biology ( ICBCB).

Paulauskaite-Taraseviciene A, Sutiene K, Valotka J,

Raudonis V, Iesmantas T (2019). Deep learning-based

detection of overlapping cells. In: Proceedings of

the 2019 3rd International Conference on Advances in

Artificial Intelligence, ICAAI 2019. New York, NY,

USA: Association for Computing Machinery.

Ronneberger O, Fischer P, Brox T (2015).

U-net: Convolutional networks for biomedical image

segmentation.

In: Navab N, Hornegger J, Wells

WM, Frangi AF, eds., Medical Image Computing

and Computer-Assisted Intervention – MICCAI 2015.

Cham: Springer International Publishing.

Schmitz C, Eastwood BS, Tappan SJ, Glaser JR, Peterson

DA, Hof PR (2014).

Current automated 3d cell

detection methods are not a suitable replacement

for manual stereologic cell counting.

FRONT NEUROANAT 8:27.

Sierra JS, Pineda J, Viteri E, Tello A, Millán MS, Galvis

V, Romero LA, Marrugo AG (2020). Generating

density maps for convolutional neural network-based

cell counting in specular microscopy images. J PHYS CONF SER 1547:012019.

Xie W, Noble JA, Zisserman A (2018a). Microscopy cell

counting and detection with fully convolutional

regression networks.

COMPUT METHOD BIOMEC:

Imaging and Visualization 6:283–92.

Xie Y, Xing F, Shi X, Kong X, Su H, Yang L (2018b).

Efficient and robust cell detection: A structured

regression approach. MED IMAGE ANAL 44:245–

Zheng Y, Chen Z, Zuo Y, Guan X, Wang Z, Mu X (2020).

Manifold-regularized regression network: A novel end-

to-end method for cell counting and localization.

In: Proceedings of the 2020 the 4th International

Conference on Innovation in Artificial Intelligence,

ICIAI 2020. New York, NY, USA: Association for

Computing Machinery.

Downloads

Published

2022-11-30

Issue

Section

Original Research Paper

How to Cite

Lazard, T., Blusseau, S., Velasco-Forero, S., Decencière, Étienne, Flouret, V., Cohen, C., & Baldeweck, T. (2022). Applying Deep Learning to Melanocyte Counting on Fluorescent TRP1 Labelled Images of In Vitro Skin Model. Image Analysis and Stereology, 41(3), 171-180. https://doi.org/10.5566/ias.2640

Most read articles by the same author(s)