Pacific 2012: CASE STUDY: Moving targets | ADM Dec 2011 / Jan 2012

Gregor Ferguson | Sydney

Melbourne-based SME Sentient Vision Systems is an example of an SME that has benefited from the CTD Program and in return has successfully commercialised the capability that it demonstrated for front line use with the ADF and coalition forces.

Sentient develops computer vision and artificial intelligence software for defence and civilian applications. Since 1999, the company has specialised in imagery analysis, building practical software solutions that automatically detect and track moving objects.

In October 2006, under Round 13, Defence selected Sentient’s CTD proposal to develop and demonstrate a high-definition, real-time Video Motion Target Indication (VMTI) system running on a PC that would locate and track small moving ground targets from the air.

Sentient had developed a spatially-aware computer-vision analysis technology that could detect movement; however, there were a number of practical limitations that required further development to overcome.

The original technology assumed the surface that was viewed was flat, without major obstacles such as trees and buildings. And it wasn’t possible to process large images in real time, according to Dr Paul Boxer, co-founder and Managing Director of Sentient.

The CTD project enabled Sentient to continue developing its core technology, addressing the original limitations and ensuring the resultant technology could meet the requirements of the ADF. This later evolved into a successful commercial product called Kestrel.

DSTO provided critical support by linking Sentient to potential users within Defence and to partner companies, connections that for a SME would have been much harder to make otherwise. Working together with the CTD Program Office (CTDPO), ‘Target Performance Measures’ were then developed for the demonstrator ensuring realistic and practical goals.

“This was an excellent way to create a demonstration of leading edge technology and build in some challenging stretches, without committing to requirements that may be impossible to achieve,” according to Dr Boxer.

CTDPO / DSTO linkages also helped Sentient to build a unique library of representative real-time imagery, including in-theatre footage, that enabled comprehensive testing and refinement of the technology.

Without Kestrel With Kestrel

In 2008, 16 months into the CTD program, Kestrel was tested by the RAAF’s 92 Wing on an AP-3C Orion. Despite the immaturity of the software, it performed well enough to progress to operational flight testing in the Middle East with the Maritime Patrol Group. This evaluation in operational conditions showed Kestrel to be very useful on surveillance mission by providing additional situational awareness.

From the CTD project, Sentient Vision Systems developed Kestrel, a fast and accurate technology that can process up to 5 mega pixel imagery in real time and find targets that even humans can’t see.

CTD Extension Program (2009 - 2011)

Following the success of the Kestrel demonstration, Sentient was awarded a CTD Extension Program (EP) contract in early 2009. This supported further development of the technology into a deployable solution and added new user requirements to extend detection to surveillance in the maritime environment, and to support enhanced on-board autonomous air vehicle systems.

The EP recognised that you could take demonstrable technology at a low TRLand transition it briskly towards service entry.

“The EP award was a key step for Sentient,” said Dr Boxer. “It gave us the confidence and funding to continue development. Without this support it is unlikely we would have got Kestrel to the high TRL it is at today and hence into a leading product.”

DSTO specialists provided critical insights to Sentient on the needs and requirements of the services that would use the technology. The CTDPO and other DSTO groups also saw the opportunity to drive future international technical standards through submitting the data formats developed for Kestrel to NATO’s STANAG (Standardization Agreement) group for VMTI processes.

As the EP progressed, further evaluations took place with defence users on a wide range of UAVs and manned air platforms including AAI Shadow, Insitu ScanEagle, AV Wasp and Raven. This led to deployment of Kestrel with the RAAF’s Heron UAVs in Afghanistan where the value of its automated VMTI capability has been strongly endorsed by the operators.

Automated detection of maritime targets proved to be equally challenging given the significant issues presented by whitecaps, sea states and lighting conditions. Again, the CTDPO and DSTO domain experts were able to guide the Sentient team as requirements were refined and invaluable access was given to real-time maritime surveillance imagery enabling a comprehensive library to be built up for testing.

Kestrel Maritime was evaluated by Defence through 2010 and in 2011 was enhanced with automated Life Jacket detection – the ability to detect small, high visibility objects within wide maritime surveillance areas, a capability with significant search and rescue benefits.

Exports!

DSTO’s, and the CTDPO’s, connections  helped Sentient spark some interest among coalition partners, in particular the US. In 2010, DSTO helped Sentient execute a Data Exchange Agreement with the US DoD enabling the US Army, the largest UAV user in the world, to evaluate and successfully demonstrate Kestrel. This access to US Defence would have been impossible for Sentient to achieve without the backing of DSTO and the CTD program.

Sentient’s positive experience and the benefits it received from the initial CTD project encouraged it, in 2009, to apply successfully for a further CTD project to demonstrate a close-in situational awareness system for ground vehicles. This aims to detect and highlight potential threats from vehicles and personnel providing ground forces with enhanced intelligence and situational awareness.

Through collaboration with other Australian SMEs, including UAV Vision, OccularRobotics and Cybertech, connections that CTDPO and DSTO scientists helped to establish, Sentient has been able to exploit state-of-the-art technology to refine and test its software.

Thanks in large part to the CTD program, Sentient has successfully established a commercial Computer Vision development capability within Australia which has demonstrated and produced world-leading technology that has already been adopted by Defence. The products from this development are on the threshold of producing strong domestic and export revenues, creating strong economic and reputation benefits for both Sentient and the Australian defence industry.

This success story is one of several examples of the benefits to the ADF and Australia of a properly managed CTD Intermediate and Transition Pathway says CTD Program Director Dr Alan Hinge. He told ADM he looks forward to continued growth of the CTD program and more success stories from this vital Defence / Industry partnership.