Facial recognition technology for next-generation fish-count surveys

In the latest generation of the CAM-Trawl system developed by the Fish Management Acquisition (FMA) program, ADL worked with NMFS Alaska Fisheries Science Center making key improvements to the computer portion of the CAM-Trawl system, including higher compute performance, standards-based vision software, more rugged enclosure and user-friendly LED indicators.


This article is contributed by ADL          Download PDF version of this article


The conservation and management of fish stocks relies heavily on fish-count surveys. In an effort to improve the shortcomings of these surveys, NOAA (National Oceanic and Atmospheric Administration) and its National Marine Fisheries Service (NMFS) developed a camera-based trawl (CAM-Trawl) to bring the power of image capture and facial recognition technology to best address this problem. The Alaska Fisheries Science Center is the research branch of the National Oceanic and Atmospheric Administration National Marine Fisheries Service responsible for research on living marine resources in the coastal oceans off Alaska and parts of the West Coast of the United States. This region of nearly 3 million square miles includes the North Pacific Ocean and the East Bering Sea which support some of the most important commercial fisheries in the world. These waters are also home to the largest marine mammal populations in the nation.

The conservation and management of fish stocks relies heavily on fish-count surveys. Traditionally, this has been done through the use of fishing trawlers set up to do acoustic or bottom trawling which cast enormous nets into the sea to capture as many fish as possible over a specified area. These fish are then brought on-board and manually counted to develop the trawl survey. This methodology suffers from a number of shortcomings: errors associated with extrapolating from a small area survey to large area estimates, errors associated with extrapolating from the relatively long period of time necessary to gather and count fish over a region to real-time characteristics of the fish population, the relatively high cost of time and equipment for manual trawl surveys, the fact that some small fish species of interest are too small to be caught by the net mesh, and lastly, the fact that killing fish in the course of a trawl survey affects local fish populations which can sometimes be dangerously low.

Figure 1. First generation CAM Trawl Picture

 

As a result, NOAA (National Oceanic and Atmospheric Administration) and its National Marine Fisheries Service (NMFS) have been working for a number of years on a camera-based trawl (CAM-Trawl) technology to bring the power of image capture and facial recognition (loosely termed, Fishal Recognition) technology to best address the problem. Early generations of this CAM-Trawl system used the lengthy process of image capturing, storing images, and then removing the storage media for image analysis at some later time back at the lab.

In the latest generation of the CAM-Trawl system developed by the Fish Management Acquisition (FMA) Program, ADL Embedded Solutions worked closely with the NFMS Alaska Fisheries Science Center to make key improvements to the computer portion of the FMA CAM-Trawl system. These include the following. Upgrading to GeniCam-compliant vision platform to take advantage of the latest camera technology and image recognition algorithms. Upgrading to marine quality system enclosure with IP-67 rated ingress protection. Upgrading to a quad-core Intel Core i7 processor to enable real-time processing of image data. Design and building of a rugged small form factor system for mounting  flexibility and ease of storage and transportation. The resulting FMA computer solution from ADL has helped achieve all the stated goals for this project. Namely, real-time fish-count data analysis capability for NOAA marine researchers to aid in their fish conservation efforts is now a reality.

Figure 2. The housed ADL system

 

The new system includes an ADL main control computer shown at left and an ADL image acquisition computer on the right in figure 2.  System features include: stainless steel, water-proof (IP67) enclosures, Intel Core i7 processors, IP67-rated water-proof circular connectors with protective caps, LED activity lights for various functions, removable drive assemblies, and Topside Handrail Mounting Adapter. The ADL image acquisition computer (Vision Box) is responsible for: camera interface using up to 6x GigE ports, image capture, real-time image recognition using processing algorithms on the Intel Quad Core i7 processor, and image storage including metadata for data/time, fish identity, etc.

The ADL control computer typically resides in the wheelhouse. It will steadily monitor a number of external sensors including geo data, time, pressure sensors, RFID tag readings and will orchestrate one or more Vision Boxes based on sensor input. Remote power on/off, clock syncing, start/stop image acquisition, etc is all dictated by the ADL control computer in a one-to-many relationship.

The results for the new FMA system have been very positive after experimental trawl surveys in 2016. Work is now underway to standardize the key components of the new system as a means of promoting the adoption of this real-time Fishal Recognition FMA system on many more surveys in the near future.


Related


Defining IoT and Industry 4.0 with embedded systems

Embedded systems play a vital role in both characterizing and developing the Internet of Things as well as in creating new processes in automation. They address several requirements of IoT solutions a...

 


Bs&T at PCIM2018

powerlosstester presenting BsT-pulse 3 phase version and BsT-SQ for powerloss measurement of inductive components new findings of tester, the highest Bs ferrite material D9B for SiC application GaN fe...


Würth and AnDAPT describe their new programmable power solution

In this video an engineer from AnDAPT describes their new programmable power solution and their partnership with Würth at the APEC exhibition  in San Antonio, Texas. Drawing from Würth&...


MAGMENT: Magnetizable concretes, sole enablers for dynamic inductive wireless charging.

MAGMENT is a patented material technology, engineered from cement and magnetic particles from recycled electronic waste. We are the inventors and sole company worldwide to offer both the concrete mate...


A look at Analog Devices' wireless power demonstration at APEC 2018

In this video Steve from Analog Devices walks us through a wireless power transmission demonstration at APEC 2018 in San Antonio, Texas. The LTC4120 is a constant-current/constant-voltage wireless rec...


Analog Devices talks about their Power over Ethernet solutions at APEC

In this video Analog Devices talks about their Power over Ethernet solutions at APEC 2018 in San Antonio, Texas. Their LTC4291 provides four PSE Ports with two power channels per port, and is fully co...


Silicon Labs demonstrates their latest PoE solutions at APEC 2018

In this video John Wilson of Silicon Labs demonstrates their latest Power over Ethernet solutions at APEC 2018 in San Antonio, Texas. The live demonstration shows how a remote device can effectively p...


Vitrek explains their advanced testing solutions at APEC 2018

In this video Vitrek explains their advanced testing solutions at APEC 2018 in San Antonio, Texas. The devices displayed includes their 4700 high-voltage meter, which can measure up to 10kV and can pe...


Dirk Giesen describes the Parasoft tool suite for Embedded Software Development

Are you responsible for embedded software development in your organization? Your goal should be to create safe, secure, and reliable software. To make sure your device will work properly, deploy Paras...


Ross Sabolik of Silicon Labs talks about advanced Power over Ethernet

In this video Ross Sabolik of Silicon Labs talks about smart  Power over Ethernet systems with Alix Paultre at their APEC exhibit in San ANtonio, Texas. As PoE migrates to higher power levels and...


Dialog Semi walks through their latest IC solutions for battery chargers

In this video an engineer from Dialog Semiconductor walks us through their latest ICs for battery chargers at APEC 2018. Dialog's Qualcomm Quick Charge adapter solutions offer high efficiency to e...


Steve Allen of pSemi explains their latest LED driver solution

Steve Allen of pSemi explains their latest LED boost product based on Arctic Sand's two-stage architecture. Their PE23300 has a charge-pump, switched-capacitor architecture that offloads most of t...


Teledyne describes their latest 12-bit Wavepro HD oscilloscope

In this video Teledyne LeCroy describes their latest Wavepro HD oscilloscope to Alix Paultre of Power Electronics News at the company's launch event. The WavePro HD high-definition oscilloscope de...