[O15] Scalable Information Fusion: Adaptivity for Complex Environments and Secure Data
Visual analysis by human operators or service personnel is widely acknowledged to benefit from a fused representation, where images or video information from different spectral bands are combined into a single representation. To provide maximum utility fused data, or its constituent components, must be delivered in a timely manner, must facilitate simple and flexible processing and must be robust to loss and network congestion.
Non infrastructure-based Mobile Ad-Hoc Networks are emerging as suitable platforms for exchanging and fusing real-time multi-sensor content. Such networks are characterised by the highly dynamic behaviour of the transmission routes and high path outage probabilities. They exemplify the type of complex, heterogeneous end-end transmission environments which will be commonly encountered in future military scenarios. The low-bandwidth, noisy nature of the physical channel in many sensor networks represents the most serious challenge to implementation of the digital battlefield of the future. One of the key challenges in such complex networking environments is the need to reliably transport and fuse real time video. Video is acknowledged to be inherently difficult to transmit and this is compounded by the need to support multiple sources to aid fusion and situational awareness while maintaining data security.
We will focus our work on embedded video bitstreams (MPEG-4 (SVC) which offer scalability and enhanced flexibility for adaptation to varying channel types, interference levels, network structures and content types. These mitigate the need for highly inefficient video transrating processes and instead present a more tractable requirement in the form of dynamic bitstream management.
A multisource approach to streaming is proposed which will support video fusion in a bandwidth-efficient manner while having the potential to significantly increase the robustness of real-time transmission in complex heterogeneous networks. Source coding and fusion will be based on the concept of scalability using an embedded bitstream. This means that the source need only be encoded once and that the coded representation can be truncated to support multiple diverse terminal types and to provide inherent congestion management without feedback. Such a system must be designed to maintain optimum fusion performance and hence intelligibility in the presence of bitstream truncation.
The potential advantages of this scheme include:
- A joint framework for scalable fusion and compression supporting both lossless and lossy representations.
- Flexibility for optimisation depending on content type and application.
- Graceful degradation: the capability of the fused video bitstream to adapt to differing terminal types and dynamic network conditions
- Error resilience: the structure of the code stream can aid subsequent error correction systems alleviating catastrophic decoding failures.
- Secure delivery: the ability to design encryption schemes which support truncation.
- Region-of-Interest coding: supporting definition of ROIs for priority transmission.
Project Supervisor
Professor David Bull PhD, FIET, SMIEEE, CEng holds the Chair in Signal Processing at the University of Bristol. His previous roles include: Lecturer at the University of Wales (Cardiff) and Systems Engineer for Rolls Royce. He joined Bristol in 1992 and established its Signal Processing Research Group in 1994. He was Head of the Electrical and Electronic Engineering Department between 2001 and 2006 and is now Director of the Bristol Vision Institute (BVI). In 2001 he co-founded ProVision Communication Technologies Ltd. where he is now Chairman. David has worked widely in the fields of 1 and 2-D signal processing. He has won two IEE Premium awards for this work and has published numerous patents, several of which have been licensed and exploited commercially. His current activities are focused on the problems of image and video communications and analysis for low bit rate wireless, internet, military, consumer and broadcast applications. In particular he has worked on content-based video coding, error resilient source coding, linear and non-linear filterbanks, motion estimation, image and video fusion, architectural optimisation (for filters, transforms and wavelet filterbanks) and content description for video archiving. He is widely supported in these areas by both industry, Europe, MoD and EPSRC and has generated over £8M of research income in the past 10 years. He has contributed to several European Union projects including WINHOME, TRUST, SCOUT, MEDIANET, WCAM and ASTALS. He has published over 350 papers, various articles and 2 books and has also given numerous invited/keynote lectures and tutorials. In 1996 David helped to establish the UK DTI Virtual Centre of Excellence in Digital Broadcasting and Multimedia Technology and was one of its Directors from 1997-2000. He was also a founder member of the UK’s Defence Technology Centre in Data and Information Fusion, serving on its Science and Technology Board for 2 years. He was appointed as an independent member of UK Government’s Defence Scientific Advisory Council (DSAC) in 2002, contributing to the UK(MoD)-US(DoD) Working Group on Persistent Surveillance (2004). He has also advised Government through membership of the UK Foresight Panel and through the DTI/EPSRC steering Group on Digital Broadcasting and Multimedia Technology. Throughout his career, David has acted as a consultant to many companies including QinetiQ, BAe Systems, General Dynamics, MBDA, BSkyB, Sony, Group4 Security and the Metropolitan Police. He is also a member of the Steering Committee for the UK Technology Strategy Board’s Special Interest Group on Imaging.
