This post contains some useful scripts that I have written with the help of GitHub Copilot. You can download and modify them as you see fit.
rclone
.timestamps
to back up/restore the updated time of all files/folders in a foldercrawl_articles
folder, and run pip install -r requirements.txt
to install some required libraries, then go back and run python crawl.py --help
to see how to use it.