Data compression

Data compression, a fundamental topic of computer science, is the process of encoding data so that it takes less storage space or less transmission time than it would if it were not compressed. This is possible because most real-world data is very redundant or not most concisely represented in its obvious form.

One very simple means of compression, for example, is run-length encoding, wherein large runs of consecutive identical data values are replaced by a simple code with the data value and length of the run. This is an example of lossless data compression, where the data is compressed in such a way that it can be recovered exactly. For symbolic data such as spreadsheets, text, executable programs, etc., losslessness is essential because changing even a single bit cannot be tolerated (except in some limited cases).

In other kinds of data such as sounds and pictures, a small loss of quality can be tolerated without losing the essential nature of the data, so lossy data compression methods can be used. These frequently offer a range of compression efficiencies, where the user can choose whether he wants highly-compressed data with noticeable loss of quality or higher-quality data with less compression. In particular, compression of images and sounds can take advantage of limitations of the human sensory system to compress data in ways that are lossy, but nearly indistinguishable from the original.

Many data compression systems are best viewed with a four-stage model.

Closely allied with data compression are the fields of coding theory and cryptography. Theoretical background is provided by information theory and algorithmic information theory. When compressing information in the form of signals we often use digital signal processing methods. The idea of data compression is deeply connected with statistical inference and particularly with the maximum likelihood principle.

Data compression topics:

Common Data compression algorithms:

The Lempel-Ziv (LZ) compression methods are the most popular algorithms for lossless storage. DEFLATE is a variation on LZ which is optimized for decompression speed and compression ratio. Compression can be slow. DEFLATE is used in PKZIP, gzip and PNG. LZW (Lempel-Ziv-Welch) was patented by Unisys until June of 2003, and is used in GIF images. This patent is the main reason for GIF's increasing obsolescence. Also noteworthy are the LZR (LZ-Renau) methods, which serve as the basis of the Zip method. LZ methods utilize a table based compression model where table entries are subsitituted for redundant data. For most LZ methods, this table is generated dynamically from earlier data in the input. The table itself is often Huffman encoded (eg. SHRI, LZX). The current LZ based code that performs best is the obsolete LZX, although RAR and ACE are now coming close. LZX was purchased by Microsoft, slightly reduced in potency, and used in the CAB format.

Compression of sounds is generally called audio compression, where methods of psychoacoustics are used to remove non-audible components of the signal to make compression more efficient. Audio compression is therefore lossy compression. Different audio compression standards are listed under audio codecs.

See also:*algorithmic complexity theory, minimum description length, zip, tar, gzip, bzip2

External Links



In the News

Early Treatment Of Macular Degeneration With Macugen May Help Patients
The study found that early detection and treatment of age-related macular degeneration with pegaptanib sodium may enable AMD patients to maintain and, in some cases, regain vision.

[Ironic] Professional beggars prowling about the streets of Moroccan c
The government plans to crack down on the scam used by faux beggars in growing numbers for a kind of "emotional blackmail", a cabinet minister was quoted as saying...

Chicken or egg question looms over climate debate
Which came first, the warmer temperatures or the clearer skies? Answers to that and similar "chicken or egg" type questions could have a significant impact on our understanding of both the climate system and manmade global warming.

[Ironic] Professional beggars prowling about the streets of Moroccan c
The government plans to crack down on the scam used by faux beggars in growing numbers for a kind of "emotional blackmail", a cabinet minister was quoted as saying...

'Perception' Gene Tracked Humanity's Evolution, Scientists Say
A gene thought to influence perception and susceptibility to drug dependence is expressed more readily in human beings than in other primates, and this difference coincides with the evolution of our species, say scientists at Indiana University Bloomington and three other academic institutions. Their report appears in the December issue of Public Library of Science Biology.

No Porn for You, Video IPod!
Usually the adult industry races to embrace new technology -- but not so with the video iPod. Thanks to fears of litigation and a government crackdown, the porn peddlers will not get caught with their pants down. By Larry Buhl.

Scientists Develop A New Way To Target Alzheimer's Disease
A group of scientists at NYU School of Medicine have devised a way to reduce amyloid beta deposition by interfering with the deadly embrace of these proteins.

'Hash' Competition Could Help Strengthen Computer Security
NIST is planning a competition to develop one or more cryptographic 'hash' algorithms to augment and revise the current Secure Hash Standard (Federal Information Processing Standard 180-2).

New Drug Targets May Fight Tuberculosis And Other Bacterial Infections
Over the course of the 20th Century, doctors waged war against infectious bacterial illness with the best new weapon they had: antibiotics. But the emergence of dangerous, multi-drug resistant strains of tuberculosis and other killer infections means that in the 21st century antibiotics are losing ground against bacterial disease. Researchers now say exciting new molecular targets -- so-called "virulence factors"that bacteria use to thrive once they are in the host -- present an alternative, potent means of stopping TB, leprosy and other bacterial illness.

Agatha Christie and Archaeology
Companion to an exhibit, "Agatha Christie and Archaeology: Mystery in Mesopotamia,"which "presented a fascinating look at the secret life of one of the world's most popular writers. Agatha Christie (1890-1976) originally became interested in archaeology on a visit to the site of Ur (in modern Iraq) in 1928. It was at Ur that she met her future husband, the archaeologist Max Mallowan."Includes annotated photos and images of archaeological items. From the British Museum.




MP3 Music Downloads

Preview songs, Download Free Music,Burn CDs at ITunes.com
iTunes_RGB_9mm

 


Google




InformationQuickFind.com - Find Information Fast

Links | Privacy Policy | News |