View Issue Details

IDProjectCategoryView StatusLast Update
0000045apt-panopticonTODOpublic2019-12-01 20:45
Reporteronefang Assigned Toonefang  
PrioritylowSeverityblockReproducibilityN/A
Status resolvedResolutionfixed 
Target Version0.1Fixed in Version0.1 
Summary0000045: Implement email and web page outputs.
DescriptionLua can send email directly using LuaSocket, which I'm already using.

The web page should include links to the detailed reports and the logs.
Additional InformationEvilham has a TODO to sign the email for the mirrors list.
TagsNo tags attached.

Relationships

parent of 0000061 resolvedonefang Add the name of the test to any log messages about that test. 

Activities

onefang

onefang

2019-06-25 03:28

administrator   ~0000043

Last edited: 2019-06-25 03:29

An email looks like this (this is an old one, picked coz it had failures) -

Dear Mirror Admins,

The full list of Devuan package mirrors is available at the URL:

  https://pkgmaster.devuan.org/mirror_list.txt

Please contact "mirrors@devuan.org" if any of the information
in the file above needs to be amended.

Please see below the current status of the Devuan Package Mirror
network:

---- BEGIN MIRROR-STATUS ----
pkgmaster.devuan.org....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
sledjhamr.org/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
mirror.4isp.it....
      http: [FAILED] (4 errors) https: [FAILED] (4 errors) DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
mirror.koddos.net/devuan/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
devuan.dcc.uchile.cl....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
devuan.mine.nu....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
mirror.vpgrp.io/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
ftp.fau.de/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
mirror.ungleich.ch/mirror/packages/devuan/....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
devuan.ipacct.com/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
dist-mirror.fem.tu-ilmenau.de/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
devuan.packet-gain.de....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
devuan.c3sl.ufpr.br....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
mirror.checkdomain.de/devuan....
      http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
mirrors.dotsrc.org/devuan....
      http: [OK] https: [OK] DNS-RR: [FAILED] (3 errors) Updated: [SKIP] Integrity: [SKIP]
devuan.bio.lmu.de....
      http: [OK] https: [FAILED] (4 errors) DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]
==== faulty mirrors: ====

mirror.4isp.it (http)
mirror.4isp.it (https)
mirrors.dotsrc.org (DNS-RR)
devuan.bio.lmu.de (https)
---- END MIRROR-STATUS ----

Thanks for your precious help in ensuring that Devuan GNU+Linux
remains a universal, stable, dependable, free operating system.

Love

The Dev1Devs
_______________________________________________
devuan-mirrors mailing list
devuan-mirrors@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/devuan-mirrors

onefang

onefang

2019-06-25 03:32

administrator   ~0000044

The current web page looks like this (the OKs are in green, there are no current failures, so I can't show that) -

Check date: Tue Jun 25 03:51:03 BST 2019
5.196.38.18.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
31.220.0.151.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
37.187.111.86.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
37.220.36.58.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
46.4.50.2.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
95.216.15.86.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
130.225.254.116.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
131.188.12.211.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
141.84.43.19.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
185.203.114.135.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
200.236.31.1.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: [OK] (20190625-02:30:11)
==== faulty mirrors: ====
[OK] No faulty mirrors

Last Failure: Mon Jun 24 11:57:29 BST 2019

31.220.0.151 (DNS-RR)
46.4.50.2 (DNS-RR)
onefang

onefang

2019-06-25 06:01

administrator   ~0000048

Might also be useful to send emails to mirror admins if their mirror fails a test.

Also, should only send emails if told to, maybe check if it's one of the Devuan mirror herders running it, somehow. Or maybe just play it safe ,output the emails as text, let them manually send emails.
onefang

onefang

2019-06-26 01:00

administrator   ~0000052

Have a bunch of mirror-check-output-*.lua scripts. They should parse the log files to produce output files.

The main full tests automatically calls mirror-check-output-mail.lua and mirror-check-output-web.lua after the dust settles.

An option of --out=foo calls mirror-check-output-foo.lua after the dust settles.
onefang

onefang

2019-09-10 05:37

administrator   ~0000198

Last edited: 2019-12-01 20:43

I should include things like -

"https: [N/A]", which will mean the mirror list says it's not supported. Maybe I could test HTTPS anyway, then report "https: [OK, fix list]" or some such.

onefang

onefang

2019-11-05 06:32

administrator   ~0000225

This is the current web status page, complete with errors (FAILED is red, SKIP is yellow)-

Check date: Tue Nov 5 05:51:01 GMT 2019
5.196.38.18.... DNS-RR: [FAILED] (1 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
37.187.111.86.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
37.220.36.58.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
46.4.50.2.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
95.216.15.86.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
130.225.254.116.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
131.188.12.211.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
141.84.43.19.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
190.64.49.124.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
200.236.31.1.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]
==== faulty mirrors: ====

5.196.38.18 (DNS-RR)
37.187.111.86 (DNS-RR)
37.220.36.58 (DNS-RR)
46.4.50.2 (DNS-RR)
95.216.15.86 (DNS-RR)
130.225.254.116 (DNS-RR)
131.188.12.211 (DNS-RR)
141.84.43.19 (DNS-RR)
190.64.49.124 (DNS-RR)
200.236.31.1 (DNS-RR)

Last Failure: Tue Nov 5 04:51:13 GMT 2019

5.196.38.18 (DNS-RR)
37.187.111.86 (DNS-RR)
37.220.36.58 (DNS-RR)
46.4.50.2 (DNS-RR)
95.216.15.86 (DNS-RR)
130.225.254.116 (DNS-RR)
131.188.12.211 (DNS-RR)
141.84.43.19 (DNS-RR)
190.64.49.124 (DNS-RR)
200.236.31.1 (DNS-RR)
onefang

onefang

2019-11-05 15:46

administrator   ~0000227

The email report is done.
onefang

onefang

2019-11-06 06:34

administrator   ~0000228

The web report is done.

NOTE - only the basic "replicate the old versions" bit of both email and web is done, not the other features I want to add.

Issue History

Date Modified Username Field Change
2019-06-25 03:11 onefang New Issue
2019-06-25 03:11 onefang Status new => assigned
2019-06-25 03:11 onefang Assigned To => onefang
2019-06-25 03:28 onefang Note Added: 0000043
2019-06-25 03:29 onefang Note Edited: 0000043
2019-06-25 03:32 onefang Note Added: 0000044
2019-06-25 04:12 onefang Priority high => urgent
2019-06-25 04:20 onefang Severity minor => block
2019-06-25 06:01 onefang Note Added: 0000048
2019-06-26 01:00 onefang Note Added: 0000052
2019-06-26 01:05 onefang Relationship added parent of 0000059
2019-06-26 10:22 onefang Relationship added parent of 0000061
2019-09-10 05:37 onefang Note Added: 0000198
2019-09-10 05:41 onefang Note Edited: 0000198
2019-11-05 06:32 onefang Note Added: 0000225
2019-11-05 15:46 onefang Note Added: 0000227
2019-11-06 06:34 onefang Note Added: 0000228
2019-11-06 06:35 onefang Priority urgent => low
2019-12-01 20:43 onefang Note Edited: 0000198
2019-12-01 20:45 onefang Relationship deleted parent of 0000059
2019-12-01 20:45 onefang Status assigned => resolved
2019-12-01 20:45 onefang Resolution open => fixed
2019-12-01 20:45 onefang Fixed in Version => 0.1