[FEATURE] Supporting rar/zip books

[erbold-bu]

Books sometimes come as multiple files, especially educational books, because some books have their answers as a separate file. Most book uploaders just zip/rar them together and upload them as one package.

I'm not sure if I can post a link here, so as an example, you can search for "新完全マスター" on a popular book aggregator and see a bunch of zip/rar results. Most of the time there's only one uploader for a specific book, and it's only available in zip/rar format. Because of this, it doesn't show up on the Calibre-Web book downloader.

Can we please support:

• Filtering and downloading zip/rar books
• Unzipping the downloaded books to the ingest folder after its downloaded, otherwise Calibre-Web-Automated doesn't support zip/rar files. I don't think we should care about anything else like folder structure, because Calibre-Automated doesn't seem to care about nested folders—it just extracts all files it supports and deletes everything else.

Thanks.

[erbold-bu]

Here is the example book's MD5: 069b249519f944a9b43fcf869ad762ca

[calibrain]

While this might be a niche and unsupported feature, you could technically do it today
We have a _SUPPORTED_FORMATS flag, where you can add zip and rar
And then, you could add a post processing script through the _CUSTOM_SCRIPT env variable
The script is triggered before the file is moved to the CWA ingest folder, so you could unzip into temp and then move the hole thing atomically in the script.

Feel free to also send a PR, I can review it and merge it

I will leave the feature request open if anyone wants to take it up, or if I have time in the future to properly implement it too

[SagarKharat94440]

Hi! I’d like to work on this feature.
From what I understand, I can extend _SUPPORTED_FORMATS to include .zip and .rar, and then write a custom post-processing script (triggered by _CUSTOM_SCRIPT) that detects these files, extracts them into a temp directory, and moves the extracted content to the ingest folder.

Just to confirm — should the script:

Only extract .zip and .rar files and skip everything else?

Delete the original archive after successful extraction?

Thanks!

[calibrain]

@SagarKharat94440 if you want to do an upstream commit to CWA-BD, you can directly work in the python and send a PR

You can add some logic here :

calibre-web-automated-book-downloader/backend.py

Line 183 in 8ea2fee

That would look at the extension, and if its a zip or a rar, would trigger some extra logic to unzip to a folder, (in tmp for example) , and then update the book_path to the new folder so we can call the move operation on it

If you choose to use the custom script, its more for a personal usage instead, and you would extract the zip / rar directly in your CWA folder, and then delete the original zip / rar in the script so it does not try to process it again (or keep it and it will move the file to CWA folder, and gets ignored by it)