Facial recognition technology for next-generation fish-count surveys

In the latest generation of the CAM-Trawl system developed by the Fish Management Acquisition (FMA) program, ADL worked with NMFS Alaska Fisheries Science Center making key improvements to the computer portion of the CAM-Trawl system, including higher compute performance, standards-based vision software, more rugged enclosure and user-friendly LED indicators.


This article is contributed by ADL          Download PDF version of this article


The conservation and management of fish stocks relies heavily on fish-count surveys. In an effort to improve the shortcomings of these surveys, NOAA (National Oceanic and Atmospheric Administration) and its National Marine Fisheries Service (NMFS) developed a camera-based trawl (CAM-Trawl) to bring the power of image capture and facial recognition technology to best address this problem. The Alaska Fisheries Science Center is the research branch of the National Oceanic and Atmospheric Administration National Marine Fisheries Service responsible for research on living marine resources in the coastal oceans off Alaska and parts of the West Coast of the United States. This region of nearly 3 million square miles includes the North Pacific Ocean and the East Bering Sea which support some of the most important commercial fisheries in the world. These waters are also home to the largest marine mammal populations in the nation.

The conservation and management of fish stocks relies heavily on fish-count surveys. Traditionally, this has been done through the use of fishing trawlers set up to do acoustic or bottom trawling which cast enormous nets into the sea to capture as many fish as possible over a specified area. These fish are then brought on-board and manually counted to develop the trawl survey. This methodology suffers from a number of shortcomings: errors associated with extrapolating from a small area survey to large area estimates, errors associated with extrapolating from the relatively long period of time necessary to gather and count fish over a region to real-time characteristics of the fish population, the relatively high cost of time and equipment for manual trawl surveys, the fact that some small fish species of interest are too small to be caught by the net mesh, and lastly, the fact that killing fish in the course of a trawl survey affects local fish populations which can sometimes be dangerously low.

Figure 1. First generation CAM Trawl Picture

 

As a result, NOAA (National Oceanic and Atmospheric Administration) and its National Marine Fisheries Service (NMFS) have been working for a number of years on a camera-based trawl (CAM-Trawl) technology to bring the power of image capture and facial recognition (loosely termed, Fishal Recognition) technology to best address the problem. Early generations of this CAM-Trawl system used the lengthy process of image capturing, storing images, and then removing the storage media for image analysis at some later time back at the lab.

In the latest generation of the CAM-Trawl system developed by the Fish Management Acquisition (FMA) Program, ADL Embedded Solutions worked closely with the NFMS Alaska Fisheries Science Center to make key improvements to the computer portion of the FMA CAM-Trawl system. These include the following. Upgrading to GeniCam-compliant vision platform to take advantage of the latest camera technology and image recognition algorithms. Upgrading to marine quality system enclosure with IP-67 rated ingress protection. Upgrading to a quad-core Intel Core i7 processor to enable real-time processing of image data. Design and building of a rugged small form factor system for mounting  flexibility and ease of storage and transportation. The resulting FMA computer solution from ADL has helped achieve all the stated goals for this project. Namely, real-time fish-count data analysis capability for NOAA marine researchers to aid in their fish conservation efforts is now a reality.

Figure 2. The housed ADL system

 

The new system includes an ADL main control computer shown at left and an ADL image acquisition computer on the right in figure 2.  System features include: stainless steel, water-proof (IP67) enclosures, Intel Core i7 processors, IP67-rated water-proof circular connectors with protective caps, LED activity lights for various functions, removable drive assemblies, and Topside Handrail Mounting Adapter. The ADL image acquisition computer (Vision Box) is responsible for: camera interface using up to 6x GigE ports, image capture, real-time image recognition using processing algorithms on the Intel Quad Core i7 processor, and image storage including metadata for data/time, fish identity, etc.

The ADL control computer typically resides in the wheelhouse. It will steadily monitor a number of external sensors including geo data, time, pressure sensors, RFID tag readings and will orchestrate one or more Vision Boxes based on sensor input. Remote power on/off, clock syncing, start/stop image acquisition, etc is all dictated by the ADL control computer in a one-to-many relationship.

The results for the new FMA system have been very positive after experimental trawl surveys in 2016. Work is now underway to standardize the key components of the new system as a means of promoting the adoption of this real-time Fishal Recognition FMA system on many more surveys in the near future.


Related


Cloud for flat-panel controllers and RFID readers

The first cloud for flat-panel controllers offers full connectivity to enable central parameterization and constant monitoring of the operational status of displays. This brings two clear advantages: ...

PCAP Touch displays - what does the future hold?

In this article the author compares three different touch technologies and examines their suitability for industrial applications. Figure 1. Example of a touch panel with Force Touch in a medic...

Fluffing the Cloud

The synergistic development aspect of electronic design was very apparent these past weeks at the APEC and Embedded World shows, as engineers from around the globe came together in San Antonio, Texas,...

 


Dialog Semi walks through their latest IC solutions for battery chargers

In this video an engineer from Dialog Semiconductor walks us through their latest ICs for battery chargers at APEC 2018. Dialog's Qualcomm Quick Charge adapter solutions offer high efficiency to e...


Steve Allen of pSemi explains their latest LED driver solution

Steve Allen of pSemi explains their latest LED boost product based on Arctic Sand's two-stage architecture. Their PE23300 has a charge-pump, switched-capacitor architecture that offloads most of t...


Teledyne describes their latest 12-bit Wavepro HD oscilloscope

In this video Teledyne LeCroy describes their latest Wavepro HD oscilloscope to Alix Paultre of Power Electronics News at the company's launch event. The WavePro HD high-definition oscilloscope de...


Dialog Semi walks through their latest IC solutions for battery chargers

In this video an engineer from Dialog Semiconductor walks us through their latest ICs for battery chargers at APEC 2018. Dialog's Qualcomm Quick Charge adapter solutions offer high efficiency to e...


ROHM explains their latest wireless battery charger solution kit

In this video an engineer from ROHM goes over their latest wireless power development kit, co-developed with Würth for embedded development. The kit provides a complete wireless power transfer sy...


Tektronix describes their latest mixed-signal oscilloscope

In this video Tektronix explains the features in their latest 5 Series MSO Mixed Signal Oscilloscope. Features include an innovative pinch-swipe-zoom touchscreen user interface, a large high-definitio...


AVX shows a supercapacitor demonstrator at APEC

In this video Eric from AVX explains their supercapacitor demonstrator box at APEC 2018 in San Antonio, Texas. The box shows how a 5V 2.5-farad supercapacitor can quickly charge up using harvested ene...


OnSemi explains their latest passive smart wireless sensor for industrial applications

In this video On Semiconductor explains their latest wireless sensor for hazardous environments at APEC in San Antonio, Texas. Intended for applications like high-voltage power cabinets and other plac...


TI demonstrates an improved gaming power system at Embedded World

In this video Texas Instruments' explains Significant reduction in ripple, which results in improved reliability and increased design margins, among other advantages. Another benefit that improve...


Infineon explains their latest motor drive technology at APEC 2018

In this video Infineon demonstrates new gate drivers using their LS-SOI technology at APEC 2018. In the demo Victorus, an Infineon application engineer, shows in real time how much better thermal the ...


STMicro goes over their latest wireless-enabled microcontroller for the IoT

In this video STMicroelectronics goes over their latest wireless-enabled STM32WB microcontroller for the IoT and intelligent devices in several live connectivity demonstrations at Embedded World 2018....


Infineon explains their latest wireless charging solution at Embedded World

In this video Infineon goes over their latest wireless charging solutions at the Embedded World show in Nuremberg, Germany. The spokesperson explains the difference between their Qi-compatible solutio...


Grammatech talks about the importance of software in engineering

In this video Mark Hermeling of Grammatech talks to Alix Paultre after the Embedded World show in Nuremberg about the importance of software verification for security and safety in electronic design. ...


Lattice Semi walks through their booth demos at Embedded World

In this video Lattice Semiconductor walks us through their booth demonstrations at Embedded World 2018. The live demonstrations include an operating IoT remote vehicle, a low-power network used for vi...


Maxim describes their latest security solution at Embedded World 2018

In this video Scott from Maxim Integrated describes their latest security solution at Embedded World 2018. In the live demo he shows the DS28E38 DeepCover Secure ECDSA Authenticator, an ECDSA public k...


Garz & Fricke at Embedded World 2018 - Embedded HMIs and SBCs “Made in Germany”

You are looking for a HMI-system or single components as touches, displays and ARM-based SBCs? Welcome at Garz & Fricke – the Embedded HMI Company! Our offering ranges from typical single co...


ECRIN Systems myOPALE: Remote Embedded Modular Computers

myOPALE™ offers disruptive technology to multiply capabilities of your next Embedded Computers in a smaller foot print thanks to PCI Express® over Cable interconnect, standard 5.25’&rs...


TechNexion rolls out embedded systems, modules, Android Things kits at Embedded World 2018

In this video John Weber of TechNexion talks to Alix Paultre about how the company helps its customers getting products to market faster. By choosing to work with TechNexion, developers can take advan...


Mike Barr talks cybersecurity

In this video Mike Barr, CEO of the Barr Group, talks to Alix Paultre about cybersecurity at the Embedded World conference in Nuremberg, Germany. Too many designers, even in critical spaces like milit...