Investigating Deep Learning for Identification of Crabs and Lobsters on Fishing Boats

Muhammad Iftikhar*, Bernard Tiddeman, Marie Neal, Natalie Hold, Mark Neal

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

12 Downloads (Pure)


This paper describes a collaboration between marine and computer scientists to improve fisheries data collection. We evaluate deep learning (DL)-based solutions for identifying crabs and lobsters onboard fishing boats. A custom made electronic camera systems onboard the fishing boats captures the video clips. An automated process of frame extraction is adopted to collect images of crabs and lobsters for training and evaluating DL networks. We train Faster R-CNN, Single Shot Detector (SSD), and You Only Look Once (YOLO) with multiple backbones and input sizes. We also evaluate the efficiency of lightweight models for low-power devices equipped on fishing boats and compare the results of MobileNet-based SSD and YOLO-tiny versions. The models trained with higher input sizes result in lower frames per second (FPS) and vice versa. Base models are more accurate but compromise computational and run time cost. Lighter versions are flexible to install with lower mAP than full models. The pre-trained weights for training models on new datasets have a negligible impact on the results. YOLOv4-tiny is a balanced trade-off between accuracy and speed for object detection for low power devices that is the main step of our proposed pipeline for automated recognition and measurement of crabs and lobsters on fishing boats.
Original languageEnglish
Number of pages3
Publication statusPublished - 14 Sept 2023
EventComputer Graphics & Visual Computing - Aberystwyth University, Aberystwyth, United Kingdom of Great Britain and Northern Ireland
Duration: 14 Sept 202315 Sept 2023


ConferenceComputer Graphics & Visual Computing
Abbreviated titleCGVC
Country/TerritoryUnited Kingdom of Great Britain and Northern Ireland
Period14 Sept 202315 Sept 2023
Internet address


  • Computing methodologies
  • Neural networks
  • Machine learning
  • Object detection
  • Artificial intelligence


Dive into the research topics of 'Investigating Deep Learning for Identification of Crabs and Lobsters on Fishing Boats'. Together they form a unique fingerprint.

Cite this