GitXplorerGitXplorer
s

twilog-web-archiver

public
3 stars
0 forks
0 issues

Commits

List of commits on branch main.
Verified
83b890d3307200b07bb902d04dbad34da350a21f

Update README.rst

sshuuji3 committed 2 years ago
Verified
56830f33be7bc81868d748c51be5f9c788cd0330

chore: dump v1.0.1

sshuuji3 committed 2 years ago
Verified
fc9756991ce50c9e55d4eb87743cbf75fb423984

feat: add user-agent string

sshuuji3 committed 2 years ago
Verified
bb560ad8feb5ca63b87a4291ebe7a95fabdd65aa

feat: add additional sleep to reduce rate limiting

sshuuji3 committed 2 years ago
Verified
9f7cdd362e3fd7a291e004de439c49ff2c90185c

chore: add a log message

sshuuji3 committed 2 years ago
Verified
7d373d53723e63a697119fb2de0f6caa496226bf

fix: import missing Exception

sshuuji3 committed 2 years ago

README

The README file for this repository.

⚠ This library will no longer be updated.

twilog-web-archiver

Save month list pages of twilog.org using archive.org.

Requirement

  • :code:Python >= 3.9

Install

.. code-block:: bash

pip install twilog-web-archiver

Usage

.. code-block:: bash

twilog-web-archiver SCREEN_NAME

Example output

.. code-block:: bash

twilog-web-archiver nhk_pr
archived (cached: True): https://web.archive.org/web/20230411042930/https://twilog.org/NHK_PR/month-2304
archived (cached: True): https://web.archive.org/web/20230411051906/https://twilog.org/NHK_PR/month-2303
archived (cached: False): https://web.archive.org/web/20230411051956/https://twilog.org/NHK_PR/month-2303/2
archived (cached: False): https://web.archive.org/web/20230411052032/https://twilog.org/NHK_PR/month-2303/3
...

Description

When a user has registered twilog.org, you will see the month list page in the user archive page, i.e. https://twilog.org/NHK_PR/archives <https://twilog.org/NHK_PR/archives>_.

This program saves every pages in this month list into Wayback Machine on archive.org <archive.org>_.

License

  • GNU GPL 3.0 or later <LICENSE>_