Browse Source

adjusted requirements.txt

dev
Tom 10 months ago
parent
commit
8244ba0cfd
  1. 4
      README.md
  2. 4
      data.json
  3. 18
      requirements.txt

4
README.md

@ -81,7 +81,7 @@ to find repos of the mirrored projects to check, just search "projectName mirror
- sagemath: same source tarballs as them (the sage-*.tar.gz files under 'Source Code')
- salt stack: checking the "Latest release" text under the 'About' header
- scientific: https://scientificlinux.org/downloads/sl-mirrors/ not checking this one since it's abandoned
slackware: https://mirrors.slackware.com/slackware/ check whether we have each release and whether the timestamp for CHECKSUMS.md5 in each release is the same, for slackware-iso, just make sure - that our list of directories is the same
- slackware: https://mirrors.slackware.com/slackware/ check whether we have each release and whether the timestamp for CHECKSUMS.md5 in each release is the same, for slackware-iso, just make sure that our list of directories is the same
- tdf: https://download.documentfoundation.org/
- trisquel: http://archive.trisquel.info/trisquel/ checking Release file for all versions in packages/dist and md5sum.txt in iso/ with two other mirrors
- ubuntu: https://launchpad.net/ubuntu/+mirror/mirror.csclub.uwaterloo.ca-archive
@ -89,6 +89,6 @@ slackware: https://mirrors.slackware.com/slackware/ check whether we have each r
- ubuntu-ports-releases: https://cdimage.ubuntu.com/releases/ has public repo, no timestamp, no status tracker, brute force looped it
- ubuntu-releases: https://releases.ubuntu.com/
- vlc: http://download.videolan.org/pub/videolan/
x.org: https://www.x.org/releases/ check all of the files under each directory under /x.org/individual/, and make sure that we have all of the files which the upstream has, ignoring the xcb - folder
- x.org: https://www.x.org/releases/ check all of the files under each directory under /x.org/individual/, and make sure that we have all of the files which the upstream has, ignoring the xcb folder
- Xiph: https://ftp.osuosl.org/pub/xiph/releases/ loop through each directory in xiph/releases/ and trying to compare the timestamp of the checksum files
- xubuntu-releases: https://cdimage.ubuntu.com/xubuntu/releases/ candidate for brute force looping since it has few folders

4
data.json

@ -21,7 +21,7 @@
"file": "zzz/time.txt"
},
"Arch": {
"out_of_sync_since": null,
"out_of_sync_since": 1634530199,
"out_of_sync_interval": 86400,
"csc": "archlinux/",
"upstream": "http://arch.mirror.constant.com/",
@ -66,7 +66,7 @@
"file": "x86/sha512.sum"
},
"Debian": {
"out_of_sync_since": 1634524215,
"out_of_sync_since": null,
"out_of_sync_interval": 86400,
"csc": "",
"upstream": "https://ftp-master.debian.org/",

18
requirements.txt

@ -1,4 +1,14 @@
requests~=2.26.0
datefinder~=0.7.1
dateparser~=1.0.0
beautifulsoup4==4.10.0
certifi==2021.10.8
charset-normalizer==2.0.7
datefinder==0.7.1
idna==3.3
numpy==1.21.2
pandas==1.3.4
python-dateutil==2.8.2
pytz==2021.3
regex==2021.10.8
requests==2.26.0
six==1.16.0
soupsieve==2.2.1
urllib3==1.26.7

Loading…
Cancel
Save