Scanner: Processing Terabytes of Video on Hundreds of Machines

Scanner: Processing Terabytes of Video on Hundreds of Machines

  • May 22, 2018
Table of Contents

Scanner: Processing Terabytes of Video on Hundreds of Machines

There are now many state-of-the-art computer vision algorithms which are a git clone away. We found that existing systems for distributed data analysis were not well suited to dealing with the computational challenges of applying computer vision algorithms to terabyte or petabyte sized video collections, so we designed and built a system called Scanner to make efficient video analysis easier.

Source: cmu.edu

Share :
comments powered by Disqus

Related Posts

Tensor Compilers: Comparing PlaidML, Tensor Comprehensions, and TVM

Tensor Compilers: Comparing PlaidML, Tensor Comprehensions, and TVM

One of the most complex and performance critical parts of any machine learning framework is its support for device specific acceleration. Indeed, without efficient GPU acceleration, much of modern ML research and deployment would not be possible. This acceleration support is also a critical bottleneck, both in terms of adding support for a wider range of hardware targets (including mobile) as well as for writing new research kernels.

Read More
How an AI Startup Could Defeat Now Unbeatable Bugs

How an AI Startup Could Defeat Now Unbeatable Bugs

The need for new medications is higher than ever, but so is the cost and time to bring them to market. Developing a new drug can cost billions and take as long as 14 years, according to the U.S. Food and Drug Administration. Yet with all that effort, only 8 percent of drugs make it to market, the FDA said.

Read More