Extracting data from an unknown compressed file
I have a binary file which I need to extract the information from it. I know that it is a compressed file and the first 3 character of the file is zip I am pretty sure LZ Substitution and/or Huffman Coding is being used to compress this file. However the file does not follow any regular archives format such as .rar , .zip and etc.
I have tried to read the file and found out the following schema
The file has 3 parts :
Part (A) shows the header which is 16 bytes and includes 8 bytes as signature with the following characters value : 122,105,112,1,0,12,0,0
Part (B) is a list of address (271), each points to a particular address of file, which I believe are the records start point in part (C).
Part (C) is the actual Data
The first address(716 in the figure) shows the first record(chunk) address in part (C), since Part (C) begins exactly when the part (B) ends the first address is the address where part (B) ends and part (C) starts, and also since file ends after part (C) finishes, the last address in the list of part B points to the end of file where last record(chunk) in part (C) ends.
In order to make it fit in the figure I had to cut the records(chunks) in part (C) they have much more character, as you see in the figure the first record(chunk) has 472 Bytes length.
Each chunk has a different length so they are not equal in length. Also the length of the biggest record is stored in header (bytes 13,14,15,16) which is 955 (187,3,0,0) I dont know why it may come handy while reading a compressed file.
As you see all records start with two bytes (120,218) The ending characters are not going to be repeated record by records actually they look very random.
I don't see any similarity between huffman tree or huffman table at the end of the records, but in order to take look at the file, I have uploaded it here.
Any help to extract the compressed data in the file is really appreciated.
Each row in (C) part is a zlib compressed chunk file.
The first two bytes are 120,218 which is zlib signature and the 4 last should be adler32.
- How to decode url like base64
- What's is the correct way to decode my JSON
- String codification UTF-8 to get 1 Byte
- How to read a JSON object in Go without decoding it (for use in reading a large stream)
- Trying to decode a JSON value that can be a String or Int
- Base64 Decoding Error :No mapping for the Unicode character exists in the target multi-byte code page
- Convert HTML entities and special characters to UTF8 text in PHP
- Base64 Java encode and decode a string
- Can't install .apk after decoding and rebuild (Apktool, Apkstudio)
- Python decode() mangles bytes object (either returns empty string, or only last line of text)
- PHP Json decode object exist
- PHP XML Decode File
- PHP JSON decode without foreach
- UnicodeDecodeError: 'charmap' codec can't decode byte X in position Y: character maps to <undefined>
- PHP JWT not verified other than PHP
- Convert.FromBase64String() throws "invalid Base-64 string" error
- Decode base64_encode Image from JSON in Swift
- lxml.etree.XMLSyntaxError for Korean Charachters
- AVFrame with NV12 format breaks using D3D11 HW acceleration
- How to decode dynamic keys using prefix
- UnicodeEncodeError: 'utf-8' codec can't encode character '\ud83c' in position 0: surrogates not allowed
- Haskell IO, cassava documentation, Data.csv
- Decode JSON into Elm Maybe
- Using PHP, how do I decode an email's body with non-ASCII characters to plain text?
- Difficulty in accessing json data from jsonbin
- How can I decode JSON with a key named 'Type' in Swift?
- How do I get hex blocks from a base 64 encoded string?
- Elm testing: how to check if a Result is an Err?
- Write Base64-encoded image to file
- Need help decoding this Base64 into readable text. It's from a ARG I'm participating in and it appears broken? Looking for insight