Skip to content
dlandes edited this page Dec 7, 2014 · 3 revisions

QCTools (Quality Control Tools for Video Preservation) is a free and open source software tool that helps users analyze and understand their digitized video files through use of audiovisual analytics and filtering to help users detect corruptions or compromises in the results of analog video digitization or in born-digital video. The goal of the project is to cut down the time it takes to perform high-quality video preservation and direct time towards preservation issues that are solvable - for example, identifying tapes that would benefit from a second transfer, saving not only the precious time of preservationists and institutional resources, but giving collections a necessary advantage in the bigger race against time to preserve their significant cultural artifacts. QCTools incorporates archival standards and best practices for reformatting and capturing metadata that enables the long-term preservation of and access to the original artifact, the digital object, and the associated catalog record.

Who can benefit from using QCTools (and how)?#

Potential users of the quality control tools include specialists and non-specialists:
* Archivists, librarians, and conservators

Moving image archives that collect digital video may receive digitized content with undiagnosed playback problems and errors. QCTools can help archivists understand what is wrong with certain files and then take steps to correct or explain these errors. Archivists need to be able to trust that the digitized files are up to a certain level of quality, and have quantifiable data to prove it. QCTools allows archivists to not be required to overly rely on visual queues and guesswork for the acknowledgment of problematic video quality.

QCTools will benefit not only moving image collections but also traditional archives that include video collections that may fall into neglect. The rapid rate of deterioration makes the preservation of magnetic media-based archival elements of foremost import when deciding on preservation strategies; however, because the knowledge base is so specialized, many archivists lack a way to evaluate digitization measures. QCTools will make it easier and more approachable for these archives to preserve and maintain digitized moving image materials.

Media asset managers and media production coordinators

Users working in this industry can use QCTools to perform quality checks on incoming media, as well as existing stored media. Work on large video collections can be done in-house and via spot-checking, instead of outsourcing much of the material. Furthermore, quality of video can be assured suitable for broadcast environments.

For example, if a production company is working with editing footage, it is better to know early on if there is a problem with any of the video files, so that they can be retransferred or discarded from use.

Preservation technicians and moving image digitization specialists

Preservation technicians and moving image digitization specialists need to maintain a high level of quality for all materials they are processing. QCTools assists with these projects. Instead of having to do a full visual check of video files to monitor for errors, technicians can use QCTools to identify problem areas for more efficient spot-checking. When integrated into a digitization workflow, QCTools can reduce time and increase the discovery of errors.

For example, using QCTools regularly to verify audiovisual artifacts caused by VHS Head Switching Noise or a U-Matic machine's Video Head Clog can prevent the need for additional transfers due to a machine that needs cleaning.

Artists and curators

Artists digitizing their work, or having their work digitized for them, may not have the background knowledge necessary to understand why their videos look the way they do. QCTools can help artists interpret these errors so the necessary steps can be taken to keep digitized video looking as close to as they originally did.

Historians and collections managers

Historians and collection managers that do not usually work with audiovisual historical documents may not know how to proceed with preserving video formats, and additionally not have the standard tools that may be found in archives equipped to handle audiovisual materials. QCTools can work in lieu of access to expensive proprietary software.

For example, a small state historical society may have a collection of tapes, but because they are a small staff and cannot afford to outsource digitization, the tapes have been neglected. If the staff is able to get the equipment to digitize the tapes in-house, QCTools can help them diagnose issues and make the digitization process less intimidating while ensuring high quality digital files.

##What video formats does QCTools accept? #

QCTools accepts a variety of video formats, including *.avi, *.mkv, *.mov, and *.mp4, as well as a diverse selection of codecs. Uncompressed video formats are ideal for the most accurate interpretation of the video. QCTools relies on FFmpeg's libavcodec and libformat libraries to analyze and playback video which allows QCTools to support a wide variety of digital audiovisual formats.

##What do the Graphs measure? #

The following provides an overview of QCTools graph functionality. For more detailed descriptions, please see the Filter Descriptions tab.

###Y Channel Filters (Y, YDiff, YDiffX) # The Y Channel carries brightness information (also called luma). Black and white moving image files will contain only Y data whereas a colorized video with have both Y, and U/V. If you are analyzing a black and white video, then, you should see no U/V data. If you do, this may indicate that your video has color noise. These filters are ideal for determining if your video is overly bright, or dark. The Diff filters simply measure the �difference� in value between the Y values of two consecutive pixels. Large differences would likely indicate a dramatic change in the brightness of your video which may indicate the presence of a problem.

###U/V Channel Filters (U, V, UDiff, VDiff) # These 2 channels together carry color information (or chroma); dramatic activity in these graphs could indicate that your video has color abnormalities. A normal reading indicating consistent color values would show graph values on or around 128. This might manifest as a rainbow effect in your video.

###Saturation# This graph detects the measure of vibrancy or brightness of color. Overly saturated (too bright) or under-saturated (too washed-out) are not ideal.

###Hue# Hue is the degree to which a color is accurate (does skin tone look normal? Do the blues, reds, etc., of your video look as you expect they should?). This graph filter will help you detect areas of your video which may have strange color representation.

###Temporal Outliers# This filter looks at a collection of pixels that reside near to one another; in video with no errors, you would expect for these pixels to have roughly a similar value. If there are large differences between a pixel and it�s neighbors, this may be an indication of an error. This graph filter is especially good at detecting white speckling artifacts.

###Vertical Repetitions (VREP)# This graph filter works by looking for rows of similar or duplicate pixels. Often, if there is signal interruption or loss, your deck or Time Base Corrector, in an effort to fill in the gaps, will duplicate existing data. The VREP filter will alert you to this repetitive data, which often manifests as vertical lines across your picture. This filter is useful with analog source content only.

###Broadcast Range (BRNG)# This filter detects pixels which lie outside of 'broadcast range' or those deemed to have unacceptable values as per established broadcasting standards. Also see Broadcast Standards.

###Mean Square Error per Field (MSeF)# This detects the image difference between the two fields of video. The bigger the difference, the more it indicates a potential problem (head clogs, deck issues).

###Peak Signal to Noise per Field (PSNRf)# This filter is helpful for detecting the lossinessof a video. Lossiness is a term often associated with the compression process and it refers to data or information that is lost when the video undergoes this process.

##What Graphs should I chose?#

The graphs dectect a wide array of errors and as you become more familiar with the tool and your video collection, you will likely opt for different graph filters depending on the errors you suspect or anticipate. There are some multipurpose options, however, that may be especially helpful to start with in order to get a high-level sense of where, and what type of errors are present. The YUV and Diffs (Y values, U values, V values, YDiff, YDiffX) are beneficial for detecting light/dark and color issues. The TOUT (Temporal Outliers) filter is targeted to detecting white noise such as white speckle pattern you may find in damaged VHS tape. The HEAD (Head Switching) filter is meant to quantify visible playback issues at the bottom of analog frames of video caused by head switching. These graph filters are ideal to start with as a new user.

##What is FFmpeg?#

FFmpeg is a complete, cross-platform solution to record, convert and stream audio and video. QCTools utilizes FFmpeg to decode video for analysis. The playback filters use FFmpeg's libavfilter in order to process the decoded audiovisual data for different types of displays. More at FFmpeg.

##How can I integrate the QCTools export feature into my workflow?#

QCTools currently supports a frame-by-frame analysis/export in XML format (based on the FFprobe metadata standard. Please also see the 'Data Format' tab). These files can be integrated into your preservation metadata.

##What about my audio?#

QCTools currently supports audio analysis.

##What is [this error] called?#

You may be able to find the answer in the A/V Artifact Atlas, which is closely associated with QCTools. The AV Artifact Atlas is for use in the identification and definition of the technical issues and anomalies that can afflict audio and video signals.

##Are there additional resources that may be useful to me?#

The Glossary of Video Terms is helpful for a general primer on common terms.

Again, The A/V Artifact Atlas is an especially good resource to find examples of video errors, with accompanying descriptions and visual references.

The European Broadcasting Union (EBU) has published a technical specification recommending audio loudness levels: EBU R128

Clone this wiki locally