Video Search Engine

Video Big Data (Part 2) - What kind of Video Data?

videospace-video-big-data.jpg

In the last installment, we explained:

  • Why Video Big Data will absolutely dwarf current Big Data
  • How Video is the most difficult medium to extract data from

Which explains why Video Big Data remains a largely unexplored field. But also means the intense opportunities available because we have not even scrap the tip of this huge data iceberg.

In this installment, we will examine the kind of data elements that we can extract from videos. 

1. Speech
In a hour of video, a person can say up to 9,000 words. So imagine the amount of data just from speech alone. However, the process of transcribing speech is filled with problems and we are currently only starting to get an acceptable level of accuracy.

2. Text
Besides speech, text is probably the second most important element inside videos. For example, in a presentation or lecture, besides speech the speaker would augment the session with a set of slides. Or news tickers appearing during a news broadcast. 

3. Objects
There are thousands of objects inside a video within different timeframe. Therefore, it can be quite challenging to identity what objects are in the video content and in which scene they appear in. 

4. Activities
The difference between video and still images is motion. Different video scenes contain complex activities, such as “running in a group” or “driving a car”. Ability to extract activities will give a lot of insight what the videos are about. This includes offensive content that might contain nudity and profanity.

5. Motion
Detecting motion enables you to efficiently identify sections of interest within an otherwise long and uneventful video. That might sound simple, but what if you have 10,000 hours of videos to review every night? That’s a near impossible task to eyeball every video minute.

6. Faces
Detecting faces from videos adds face detection ability to any survelliance or CCTV system. This will be useful to analyze human traffic within a mall, street or even a restaurant or café. When we include facial recognition, it opens up another data dimension.

7. Emotion
Emotion detection is an extension of the Face Detection that returns analysis on multiple emotional attributes from the faces detected. With emotion detection, one can gauge audience emotional response over a period of time.

This list of video data is certainly not exhaustive but is a definitely a good starting point to the field of Video Big Data. In the next installment, we will examine some of the techniques used to extract these video data. 

Yours sincerely,

The Babbobox Team

Announcement – Adding “Object Detection” to VideoSpace Search Engine

We are delighted to announce that we are adding “Object Detection” capability to our Video Search Engine.

This is a significant milestone as it enhances our already extensive video search capabilities. Thus, establishing VideoSpace Search Engine’s as one of the most powerful Video Search Engine in the world.

With Object Detection, this is the list of elements that we can index and search inside videos:

  • Objects (NEW!)
  • Speech
  • Text
  • Motion
  • Face
  • Emotion
  • Offensive Content
  • Custom (e.g. Logos, Objects, Landmarks, etc.)
videospace video search engine object detection

The new “Object Detection” feature enables us to detect entities (like cat, flower, computer, etc.) and pinpoint the exact location there is the scene(s) appear inside videos.

For example, in this short four minute VIDEO, we are able to:

  • detect 111 unique entities
  • mark exactly where these 111 entities appear

To find out more about Object Detection in videos, please click HERE.

Video Platform from a DevOps prespective - Babbobox CTO, Sabrina Lim at CloudExpo Asia 2017

Babbobox CTO, Sabrina Lim (yes.. she's a female CTO), will be speaking at CloudExpo Asia - DevOps Live at 12.05pm on 12 Oct.

babbobox_CTO_sabrina_lim

Essentially, she'll be speaking about a combination technologies covering Media, Search, A.I., Cognitive and unstructured data (all the stuff that we are using) from the DevOps perspective. So yes... it'll be a bit geeky and techie!

So if you are at the show, do drop by and say hi!