Data Compression - IT Library : ZDNet Asia

Case Studies

Vendor Webcast

Show all content

Title Date Added Company

TechNet Webcast: SQL Server 2008 (Part 2 of 3): Manage Large-Scale Data Warehousing (Level 300) 2008-05-12 Microsoft Tips

The attendee of this webcast will learn how to incorporate the new features in Microsoft SQL Server 2008 to manage large-scale data warehouses that can scale to larger number of users and growing volumes of data. The presenter covers new technologies like Resource Governor, data compression, and enhanced indexed views.

Tags: Database Management, Business Intelligence - Data Warehousing

A Novel Visual Perceptual Model With an Application to Hi-Fidelity Image Annotation 2006-04-08 Microsoft

This paper introduces a novel visual perception model that aims to quantify the localized tolerance to noise for arbitrary imagery. The model is built by mixing the outputs from an entropy and a differential localized standard deviation filter. The mixture is then low-pass filtered and normalized to provide a model that produces substantially better perceptual hi-fidelity than existing tools of similar complexity. Although there exist numerous applications for the new model, from compression to medical imaging and denoising, the authors demonstrate its efficacy using an image annotation application. The objective is to embed 32 bits of meta-data into a single image in a way that is robust to aggressive JPEG compression and cropping.

Tags: Software Engineering, Data Visualization

Reading Compressed Text Files Using SAS Software 2006-12-26 01:00:57 SAS Institute

External raw data files continuously needed at work are every day more and greater. Normally, those files come in any of the more popular compressed formats like zip, 7zip, gzip and rar. A common practice is to previously decompress files and next, read them with SAS. Taking advantage of the PIPE device of the FILENAME statement and the aid of some tools free to use, one can directly read compressed data without extracting them first. This paper shows different ways to read compressed data, considering several formats and software tools used to produce archives. Open code software will be used to access compressed data as well as a special dynamic library of the SAS Software.

Distributed Data Aggregation in Sensor Networks by Regression Based Compression 2005-08-27 University of Cincinnati

This paper proposes a method for data compression and its subsequent regeneration using a polynomial regression technique. The approximate data received over the considered area by fitting it to a function and communicate this by passing only the coefficients that describe the function. This paper extends the previous algorithm TREG to consider non-complete aggregation trees. The proposed algorithm DUMMYREG is run at each parent node and uses information present in the existing child to construct a complete binary tree. In addition to obtaining values in regions devoid of sensor nodes and reducing communication overhead, this new approach further reduces the error when the readings are regenerated at the sink.

Tags: Network Security, Mobile - Wireless Communications

Communication Strategies and Coding for Relaying 2006-12-13 01:00:24 Alcatel-Lucent

Information-theoretic models for relaying are developed and applied to wireline and wireless networks. For wireline networks with node constraints, data compression is shown to improve rates. For wireless networks with half-duplex constraints, decode-and-forward strategies are developed that can give substantial rate gains over no-relay transmission and traditional multihopping. The performance of the strategies is verified by designing coded modulations that approach certain information-theoretic limits. The codes used are irregular Low-Density Parity-Check (LDPC) codes.

Compression Algorithm Testing - Making Things Smaller: An analysis of Data Compression Algorithms 20040402000410 Quantum

This White paper describes the results of testing the data compression algorithms of Super Tape Drives. The testing requirements were to compare the data compression algorithm performance of the SDLT 320 manufactured by Quantum against the Linear Tape Open (L.T.O.) drives from HP, IBM, and Seagate and the Advanced Intelligent Tape drive from Sony.

How Does Compression Work 20040302121617 MacKiDo

Many people don't understand compression -- how do you make something smaller? In some ways you don't -- you just encode the data in a more efficient way. This article will explain a few basic types and concepts about data storage and compression. These concepts are far simpler than people realize -- it's just the implementation details can be a pain.
Basically, compression on computers is achieved by looking for commonality (in shape or pattern), and then saving the description of that shape or pattern (using tables or mathematical algorithms) instead of saving the whole image itself. If you don't get it, read on, and it may become more clear.

Compression of Moving Pictures for Digital Cinema Using the MPEG-2 Toolkit White Paper 20040302121617 Grass Valley Group

The scope of compression techniques provided in the MPEG-2 toolkit is broad enough to meet today�s picture quality expectations of digital cinema theatrical presentations with enhancements in rate control, 4:4:4 chroma format color space, and greater color precision than the profiles that are defined for television. This optimization for the unique requirements of digital cinema, while beyond currently defined MPEG profiles, is enabled by the wide range of the MPEG-2 toolkit and can be implemented using standard off-the-shelf silicon devices.

Advanced MPEG-2 Encoding 20040302121606 Harmonic

This white paper introduces the advanced MPEG-2 encoding techniques featured on the standard definition DiviCom� MV50 encoder from Harmonic. This sixth-generation encoder supersedes the market-leading MV45 encoder, adding extra processing power, new filters and intelligent controls to consistently deliver the highest quality video in satellite, broadcast, and xDSL networks, where bandwidth efficiency matters most.

Digital Video Editing: the Transition to MPEG-2 20040302121508 C-Cube Microsystems

In the market the low-cost DVE systems are rapidly growing and fueling even grater demand for MPEG-2.Low-cost, video capture/editing add-in boards (AIBs) are now available, as well as easy to use software for consumer platforms, which are being powered by a new generation of low-cost compression-decompression controllers (CODECs). Non-linear video editors (NLVEs)offer significant cost and convenience advantages over tape-based linear editors. To reduce system cost, non-linear editors usually store video in compressed digital form.

Jump to [1] 2

Title	Date Added	Company
TechNet Webcast: SQL Server 2008 (Part 2 of 3): Manage Large-Scale Data Warehousing (Level 300)	2008-05-12	Microsoft Tips
The attendee of this webcast will learn how to incorporate the new features in Microsoft SQL Server 2008 to manage large-scale data warehouses that can scale to larger number of users and growing volumes of data. The presenter covers new technologies like Resource Governor, data compression, and enhanced indexed views. Tags: Database Management, Business Intelligence - Data Warehousing
A Novel Visual Perceptual Model With an Application to Hi-Fidelity Image Annotation	2006-04-08	Microsoft
This paper introduces a novel visual perception model that aims to quantify the localized tolerance to noise for arbitrary imagery. The model is built by mixing the outputs from an entropy and a differential localized standard deviation filter. The mixture is then low-pass filtered and normalized to provide a model that produces substantially better perceptual hi-fidelity than existing tools of similar complexity. Although there exist numerous applications for the new model, from compression to medical imaging and denoising, the authors demonstrate its efficacy using an image annotation application. The objective is to embed 32 bits of meta-data into a single image in a way that is robust to aggressive JPEG compression and cropping. Tags: Software Engineering, Data Visualization
Reading Compressed Text Files Using SAS Software	2006-12-26 01:00:57	SAS Institute
External raw data files continuously needed at work are every day more and greater. Normally, those files come in any of the more popular compressed formats like zip, 7zip, gzip and rar. A common practice is to previously decompress files and next, read them with SAS. Taking advantage of the PIPE device of the FILENAME statement and the aid of some tools free to use, one can directly read compressed data without extracting them first. This paper shows different ways to read compressed data, considering several formats and software tools used to produce archives. Open code software will be used to access compressed data as well as a special dynamic library of the SAS Software.
Distributed Data Aggregation in Sensor Networks by Regression Based Compression	2005-08-27	University of Cincinnati
This paper proposes a method for data compression and its subsequent regeneration using a polynomial regression technique. The approximate data received over the considered area by fitting it to a function and communicate this by passing only the coefficients that describe the function. This paper extends the previous algorithm TREG to consider non-complete aggregation trees. The proposed algorithm DUMMYREG is run at each parent node and uses information present in the existing child to construct a complete binary tree. In addition to obtaining values in regions devoid of sensor nodes and reducing communication overhead, this new approach further reduces the error when the readings are regenerated at the sink. Tags: Network Security, Mobile - Wireless Communications
Communication Strategies and Coding for Relaying	2006-12-13 01:00:24	Alcatel-Lucent
Information-theoretic models for relaying are developed and applied to wireline and wireless networks. For wireline networks with node constraints, data compression is shown to improve rates. For wireless networks with half-duplex constraints, decode-and-forward strategies are developed that can give substantial rate gains over no-relay transmission and traditional multihopping. The performance of the strategies is verified by designing coded modulations that approach certain information-theoretic limits. The codes used are irregular Low-Density Parity-Check (LDPC) codes.
Compression Algorithm Testing - Making Things Smaller: An analysis of Data Compression Algorithms	20040402000410	Quantum
This White paper describes the results of testing the data compression algorithms of Super Tape Drives. The testing requirements were to compare the data compression algorithm performance of the SDLT 320 manufactured by Quantum against the Linear Tape Open (L.T.O.) drives from HP, IBM, and Seagate and the Advanced Intelligent Tape drive from Sony.
How Does Compression Work	20040302121617	MacKiDo
Many people don't understand compression -- how do you make something smaller? In some ways you don't -- you just encode the data in a more efficient way. This article will explain a few basic types and concepts about data storage and compression. These concepts are far simpler than people realize -- it's just the implementation details can be a pain. Basically, compression on computers is achieved by looking for commonality (in shape or pattern), and then saving the description of that shape or pattern (using tables or mathematical algorithms) instead of saving the whole image itself. If you don't get it, read on, and it may become more clear.
Compression of Moving Pictures for Digital Cinema Using the MPEG-2 Toolkit White Paper	20040302121617	Grass Valley Group
The scope of compression techniques provided in the MPEG-2 toolkit is broad enough to meet today�s picture quality expectations of digital cinema theatrical presentations with enhancements in rate control, 4:4:4 chroma format color space, and greater color precision than the profiles that are defined for television. This optimization for the unique requirements of digital cinema, while beyond currently defined MPEG profiles, is enabled by the wide range of the MPEG-2 toolkit and can be implemented using standard off-the-shelf silicon devices.
Advanced MPEG-2 Encoding	20040302121606	Harmonic
This white paper introduces the advanced MPEG-2 encoding techniques featured on the standard definition DiviCom� MV50 encoder from Harmonic. This sixth-generation encoder supersedes the market-leading MV45 encoder, adding extra processing power, new filters and intelligent controls to consistently deliver the highest quality video in satellite, broadcast, and xDSL networks, where bandwidth efficiency matters most.
Digital Video Editing: the Transition to MPEG-2	20040302121508	C-Cube Microsystems
In the market the low-cost DVE systems are rapidly growing and fueling even grater demand for MPEG-2.Low-cost, video capture/editing add-in boards (AIBs) are now available, as well as easy to use software for consumer platforms, which are being powered by a new generation of low-cost compression-decompression controllers (CODECs). Non-linear video editors (NLVEs)offer significant cost and convenience advantages over tape-based linear editors. To reduce system cost, non-linear editors usually store video in compressed digital form.