Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Major refactor, especially of the downloading and processing code. | onefang | 2019-12-23 | 1 | -282/+398 | |
| | | | | | | | | | | | | Make the code more readable, less scattered. Use a coroutine to multitask better. Plugable functions for parsing the download results, and figuring out what to download next. Track timeouts at a finer level. Dig for IPs in the forked apt-panopticons, not all at once at the beginning. Various cleanups and tweaks. | |||||
* | Clean up some commented out code from a previous refactor. | onefang | 2019-12-14 | 1 | -1/+0 | |
| | ||||||
* | Validate the mirrors_list FQDN and BaseURL. | onefang | 2019-12-14 | 1 | -10/+22 | |
| | | | | Also, move the relatd tests into this new function. | |||||
* | Have I finally fixed that copy-pasta bug? | onefang | 2019-12-13 | 1 | -2/+2 | |
| | ||||||
* | Refactor the protocols table. | onefang | 2019-12-13 | 1 | -1/+2 | |
| | ||||||
* | Comment++ | onefang | 2019-12-12 | 1 | -0/+3 | |
| | ||||||
* | Time how long it takes. | onefang | 2019-12-12 | 1 | -0/+3 | |
| | ||||||
* | Oops, copy-pasta error. | onefang | 2019-12-12 | 1 | -1/+1 | |
| | ||||||
* | Remove some more stuff we don't really need to keep around. | onefang | 2019-12-12 | 1 | -2/+2 | |
| | ||||||
* | Speed up things by being clever. | onefang | 2019-12-12 | 1 | -8/+10 | |
| | | | | | | | | Don't wait for pkgmaster to be completely finished, wait for the things we need to wait for. Knocks about a minute off the run time. Could knock another 30 seconds off by runing the IP lookups in parallel somehow. Maybe. | |||||
* | TODO++ | onefang | 2019-12-12 | 1 | -0/+1 | |
| | ||||||
* | Count curl full download timeouts. | onefang | 2019-12-12 | 1 | -0/+1 | |
| | ||||||
* | Attempt to clean up after mirrors timeout. | onefang | 2019-12-12 | 1 | -5/+10 | |
| | | | | It still wont clean up the STATUS_* files, so only partially fixed. | |||||
* | Do the curl log file stuff differently. | onefang | 2019-12-12 | 1 | -62/+70 | |
| | | | | | | | | | Use the log file as the flock lock file. Name the .curl files similar to the .log files, and don't delete them. Don't bother dealing with the stuff we decide to not download, stops spurious log files with errors in them. | |||||
* | Some refactoring of the results data handling. | onefang | 2019-12-12 | 1 | -11/+1 | |
| | ||||||
* | Whitespace-- | onefang | 2019-12-12 | 1 | -1/+1 | |
| | ||||||
* | Detect timeouts for actually downloaded files as well. | onefang | 2019-12-11 | 1 | -0/+4 | |
| | ||||||
* | More info for package size mismatches. | onefang | 2019-12-11 | 1 | -2/+1 | |
| | ||||||
* | Move common code to it's own module. | onefang | 2019-12-10 | 1 | -395/+112 | |
| | | | | Some minor clean ups and test tweaks likely came for the ride. | |||||
* | Prevent a lockup. | onefang | 2019-12-09 | 1 | -1/+1 | |
| | ||||||
* | Don't miscount some redirections as Protocol changes. | onefang | 2019-12-09 | 1 | -1/+1 | |
| | ||||||
* | MD5sums are deprecated in favour of sha256, so don't bother with them anymore. | onefang | 2019-12-07 | 1 | -7/+3 | |
| | ||||||
* | Tweakage of how Packages are checked. | onefang | 2019-12-05 | 1 | -14/+18 | |
| | ||||||
* | Various little cleanups. | onefang | 2019-12-05 | 1 | -6/+7 | |
| | ||||||
* | Store any previously parsed Packages, so we always have one to use. | onefang | 2019-12-05 | 1 | -4/+6 | |
| | ||||||
* | Pack up ancient results for later. | onefang | 2019-12-05 | 1 | -1/+7 | |
| | ||||||
* | Check for existance of Release file before trying to sort it. | onefang | 2019-12-04 | 1 | -13/+15 | |
| | ||||||
* | Not being able to remove a non existing file isn't a failure. | onefang | 2019-12-04 | 1 | -16/+16 | |
| | | | | I hates that error message. lol | |||||
* | Report the timeout differently, the other was a hack that caused problems. | onefang | 2019-12-04 | 1 | -10/+2 | |
| | ||||||
* | Move the speed calc to the main script. | onefang | 2019-12-04 | 1 | -0/+21 | |
| | ||||||
* | Don't log some of the executes. | onefang | 2019-12-04 | 1 | -8/+7 | |
| | ||||||
* | Try to keep the old results directories small and clean. | onefang | 2019-12-04 | 1 | -36/+35 | |
| | ||||||
* | Test and report speed. | onefang | 2019-12-03 | 1 | -5/+7 | |
| | ||||||
* | Don't leave those massive unpacked Packages files around. | onefang | 2019-12-03 | 1 | -0/+1 | |
| | ||||||
* | Make unpacking nicer. | onefang | 2019-12-03 | 1 | -2/+2 | |
| | ||||||
* | Add max time for each download. | onefang | 2019-12-03 | 1 | -1/+8 | |
| | ||||||
* | Implement URLSanity test. | onefang | 2019-12-02 | 1 | -8/+30 | |
| | ||||||
* | Make it match test_rewrite.sh more. | onefang | 2019-12-02 | 1 | -2/+3 | |
| | ||||||
* | TODO+=2 | onefang | 2019-12-02 | 1 | -0/+2 | |
| | ||||||
* | Typo-- | onefang | 2019-12-02 | 1 | -1/+1 | |
| | ||||||
* | Merge email and web report scripts. | onefang | 2019-12-02 | 1 | -2/+1 | |
| | ||||||
* | Add more report stuff. | onefang | 2019-12-02 | 1 | -70/+85 | |
| | | | | | TIMEOUT, report inactive mirrors and why it's not active, add a * for things tested but not supported. | |||||
* | Much work on the Updated tests. | onefang | 2019-12-01 | 1 | -39/+204 | |
| | | | | Plus keep a history of results. | |||||
* | Enable the Integrity tests by default. | onefang | 2019-11-26 | 1 | -1/+1 | |
| | ||||||
* | Basic integrity check - GPG verify Release files. | onefang | 2019-11-26 | 1 | -0/+8 | |
| | ||||||
* | Put stamp file back. | onefang | 2019-11-26 | 1 | -0/+1 | |
| | ||||||
* | Oops, clean up after curl downloads. | onefang | 2019-11-26 | 1 | -1/+1 | |
| | ||||||
* | Cut down the abount of meta files downloaded automatically | onefang | 2019-11-26 | 1 | -10/+10 | |
| | ||||||
* | Curl based downloader. | onefang | 2019-11-26 | 1 | -29/+77 | |
| | | | | | Moving back to Lua-socket might be better, due to the crappy "modified" support in curl, but then I can't fork it. | |||||
* | Minor cleanups. | onefang | 2019-11-26 | 1 | -5/+6 | |
| |