High Speed Video And Image Processing With Java And Hadoop - Oracle
High Speed Video and Image Processing with Java and Hadoop Melli Annamalai Senior Principal Product Manager Rob Abbott Big Data Technical Lead Krishna Kuchimanchi Hadoop Developer September 20, 2016 Copyright 2016, Oracle and/or its affiliates. All rights reserved.
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright 2016, Oracle and/or its affiliates. All rights reserved. 4
Growing Volumes of Video and Image Data Drones Surveillance cameras Courtesy: c-span.org Corporate archives Stock images License plates Copyright 2016, Oracle and/or its affiliates. All rights reserved. 5
Some Challenges Large volumes of data (addressing scale) Diversity in types of video/image processing Moving video data across the network (out of the scope of this presentation) Copyright 2016, Oracle and/or its affiliates. All rights reserved. 6
Addressing Scale Identified faces, license plate text, matching timestamps, etc Input Input Video and Image Processing Face recognition License plate identification Fingerprint matching Optical character recognition Specialized processing Identified faces, timestamps, individual frames 6x compute power Copyright 2016, Oracle and/or its affiliates. All rights reserved. 7
Scale-out Capability of Apache Hadoop 18x compute power on Oracle Big Data Appliance Copyright 2016, Oracle and/or its affiliates. All rights reserved. 8
Multimedia Analytics Framework Enables processing of video and image data in Hadoop Leverages Hadoop parallelism for high speed processing – Ships with OpenCV (www.opencv.org) – Integrate third party software into framework Massive storage and InfiniBand network of Oracle Big Data Appliance enables processing and management of petabytes of multimedia data Part of Oracle Big Data Spatial and Graph Copyright 2016, Oracle and/or its affiliates. All rights reserved. 9
Multimedia Analysis Framework How it Works Output JSON or CSV or image with labels, timestamp in video Process Split Input HDFS Copyright 2016, Oracle and/or its affiliates. All rights reserved. 10
Framework Runs a MapReduce Job Submitted as a Hadoop job hadoop jar ordhadoop-multimedia-analytics.jar –conf vprocess.xml vinput voutput Map tasks on each node decode segment of video/image and call processFrame() DECODE (JCODEC/FFMPEG) ANALYZE DECODE (JCODEC/FFMPEG) ANALYZE (OPENCV/PLUGIN CODE) (OPENCV/PLUGIN CODE) DECODE (JCODEC/FFMPEG) ANALYZE DECODE (JCODEC/FFMPEG ANALYZE (OPENCV/PLUGIN CODE) (OPENCV/PLUGIN CODE) DECODE (JCODEC/FFMPEG) ANALYZE DECODE (JCODEC/FFMPEG) ANALYZE (OPENCV/PLUGIN CODE) (OPENCV/PLUGIN CODE) Copyright 2016, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal/Restricted/Highly Restricted 11
Multimedia Analytics Framework Benefits Faster video processing – Processing massive video/image volumes ideal for Hadoop architecture Extensible framework – Use with a variety of third party video/image processing engines Use framework without specialized Hadoop skills – Gain Hadoop scalability without Hadoop-specific management and programming skills Integrate video/image processing with Big Data applications Copyright 2016, Oracle and/or its affiliates. All rights reserved. 12
Integrate with Video/Image Processing Technology Oracle Analytics products Display/ visualize MAP MAP MAP Hadoop APIs for data ingest MAP MAP MAP MAP MAP MAP MAP MAP MAP MAP MAP MAP MAP Multimedia Analytics Partner module MAP Framework OpenCV MAP MAP Hadoop platform Copyright 2016, Oracle and/or its affiliates. All rights reserved. MAP MAP MAP Oracle Partner 13
Extensibility Address diversity in video/image processing requirements Copyright 2016, Oracle and/or its affiliates. All rights reserved. 14
Extensibility: Implement processFrame() Input: (key, value (frame from video or image)) Output: (key, value) Defined by implementation Implement reduce task: For example, group by output key @Override public void processFrame(Text key, OrdImageWritable value) @Override public Text getKey() @Override public OrdImageWritable getValue() Copyright 2016, Oracle and/or its affiliates. All rights reserved. 15
Part of Oracle Big Data Cloud Service Big Data Cloud Service (Includes Big Data Spatial and Graph, Multimedia Analytics Framework) Copyright 2016, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal/Restricted/Highly Restricted 16
Building Applications Copyright 2016, Oracle and/or its affiliates. All rights reserved. 17
License Plate Recognition Copyright 2016, Oracle and/or its affiliates. All rights reserved. 18
Integrate with Video/Image Processing Technology Oracle Analytics products Display/ visualize Hadoop APIs for data ingest License plate recognition Oracle Hadoop platform Copyright 2016, Oracle and/or its affiliates. All rights reserved. Partner 19
Number Plate Demonstration Overview Exploration (Citizen Data Science) via Big Data Discovery Send Email to recipient if ‘number plate matches fine’ Captured Images Number Plates Big Data Lite VM with Oracle Spatial & Graph & license plate recognition Oracle SQL Developer DB Queries Oracle DB 11G 11G Database Number plate fact & customer fact data to ‘Detect & Act’ on fines Copyright 2016, Oracle and/or its affiliates. All rights reserved.
Copyright 2016, Oracle and/or its affiliates. All rights reserved. 21
Copyright 2016, Oracle and/or its affiliates. All rights reserved. 22
Copyright 2016, Oracle and/or its affiliates. All rights reserved. 23
Copyright 2016, Oracle and/or its affiliates. All rights reserved. 24
Optical Character Recognition With Apache Tesseract Copyright 2016, Oracle and/or its affiliates. All rights reserved. 25
Implement OCR processing in processFrame() Input: (key, value (frame from video or image) Output: (key, value) Output value image overlaid with recognized text @Override public void processFrame(Text key, OrdImageWritable value) { call Tesseract APIs ocrString instance.doOCR() Details in /using oracle big data spatial Copyright 2016, Oracle and/or its affiliates. All rights reserved. 26
Copyright 2016, Oracle and/or its affiliates. All rights reserved. 27
Partnership with Griaule Copyright 2016, Oracle and/or its affiliates. All rights reserved. 28
Griaule Biom etrics S/A Specialized in software for large scale biometric identification systems (Big Data Biometrics) Provides technology for Systems Integrators who provide solutions to the end customer 15 years researching biometrics, with over 20 certifications (FBI, NIST, FVC, etc.) Largest ABIS in the world using fingerprint as primary technology for deduplication Multimodal fingerprint, face and voice technologies Copyright 2016, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal/Restricted/Highly Restricted 29
Identification Uses Recognize people amid crowds Facial aging and weight changes Over 20 FBI certifications in biometrics Most precise finger print algorithm in the world since the FVC2006 Copyright 2016, Oracle and/or its affiliates. All rights reserved.
Architecture Easily integrated Plan to integrate with all Griaule’s identification systems (facial, voice, fingerprint and more) Full access to Griaule’s intelligence systems Copyright 2016, Oracle and/or its affiliates. All rights reserved.
Implement Griaule processing in processFrame() Input: (key, value (frame from video or image) Output: (key, value) Output value face with green or yellow bounding box @Override public void processFrame(Text key, OrdImageWritable value) { Copyright 2016, Oracle and/or its affiliates. All rights reserved. 32
Demo Copyright 2016, Oracle and/or its affiliates. All rights reserved. Image Courtesy Griaule 33
Roadmap Real-time analysis of streaming video Spark streaming integration Copyright 2016, Oracle and/or its affiliates. All rights reserved. 34
Summary Multimedia Analytics Frameworks enables fast video and image processing in Hadoop Extensibility API for third party software integration enables many different types of processing Video and image data can be analyzed along side other Big Data types Copyright 2016, Oracle and/or its affiliates. All rights reserved. 35
Copyright 2016, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal/Restricted/Highly Restricted 36
-Processing massive video/image volumes ideal for Hadoop architecture Extensible framework -Use with a variety of third party video/image processing engines Use framework without specialized Hadoop skills -Gain Hadoop scalability without Hadoop-specific management and programming skills
Using Cross Products Video 1, Video 2 Determining Whether Two Quantities are Proportional Video 1, Video 2 Modeling Real Life Video 1, Video 2 5.4 Writing and Solving Proportions Solving Proportions Using Mental Math Video 1, Video 2 Solving Proportions Using Cross Products Video 1, Video 2 Writing and Solving a Proportion Video 1, Video 2
L2: x 0, image of L3: y 2, image of L4: y 3, image of L5: y x, image of L6: y x 1 b. image of L1: x 0, image of L2: x 0, image of L3: (0, 2), image of L4: (0, 3), image of L5: x 0, image of L6: x 0 c. image of L1– 6: y x 4. a. Q1 3, 1R b. ( 10, 0) c. (8, 6) 5. a x y b] a 21 50 ba x b a 2 1 b 4 2 O 46 2 4 2 2 4 y x A 1X2 A 1X1 A 1X 3 X1 X2 X3
A: Yes, High-Speed option may reduce the performance of other network service, but High-Speed option controls QoS(Quality of Service) and protects other important services. Q3: Is every file transfer speed improved with High-Speed option? A: High-Speed option improves only for users who have High-Speed option.
Actual Image Actual Image Actual Image Actual Image Actual Image Actual Image Actual Image Actual Image Actual Image 1. The Imperial – Mumbai 2. World Trade Center – Mumbai 3. Palace of the Sultan of Oman – Oman 4. Fairmont Bab Al Bahr – Abu Dhabi 5. Barakhamba Underground Metro Station – New Delhi 6. Cybercity – Gurugram 7.
The input for image processing is an image, such as a photograph or frame of video. The output can be an image or a set of characteristics or parameters related to the image. Most of the image processing techniques treat the image as a two-dimensional signal and applies the standard signal processing techniques to it. Image processing usually .
ENFSI-BPM-DI-02 (vs01) BPM for Forensic Image and Video Enhancement Image Enhancement - Any process intended to improve the appearance of specific detail within a digital image or video in respect of an intended purpose and use Image Operation - Image processing function
Image Deblurring with Blurred/Noisy Image Pairs Lu Yuan1 Jian Sun2 Long Quan2 Heung-Yeung Shum2 1The Hong Kong University of Science and Technology 2Microsoft Research Asia (a) blurred image (b) noisy image (c) enhanced noisy image (d) our deblurred result Figure 1: Photographs in a low light environment. (a) Blurred image (with shutter speed of 1 second, and ISO 100) due to camera shake.
How to edit the imported video on Mac Leawo Video onverter for Mac can also serve as a video editor to help users make a unique video. This page will tell the detailed steps of how to edit a video on mac. Five main video editing function will meet all your basic needs to edit a video. 1. Edit video on Mac . Import the file
