Discussion:
Fedora Rawhide-20181206.n.0 compose check report
Fedora compose checker
2018-12-06 15:25:01 UTC
Permalink
No missing expected images.

Compose FAILS proposed Rawhide gating check!
5 of 47 required tests failed
openQA tests matching unsatisfied gating requirements shown with **GATING** below

Failed openQA tests: 28/131 (x86_64), 3/23 (i386), 1/2 (arm)

New failures (same test not failed in Rawhide-20181205.n.0):

ID: 316407 Test: x86_64 Server-dvd-iso server_role_deploy_domain_controller **GATING**
URL: https://openqa.fedoraproject.org/tests/316407
ID: 316408 Test: x86_64 Server-dvd-iso server_realmd_join_kickstart **GATING**
URL: https://openqa.fedoraproject.org/tests/316408
ID: 316411 Test: x86_64 Server-dvd-iso realmd_join_cockpit
URL: https://openqa.fedoraproject.org/tests/316411
ID: 316412 Test: x86_64 Server-dvd-iso realmd_join_sssd **GATING**
URL: https://openqa.fedoraproject.org/tests/316412
ID: 316413 Test: x86_64 Server-dvd-iso server_freeipa_replication_master
URL: https://openqa.fedoraproject.org/tests/316413
ID: 316414 Test: x86_64 Server-dvd-iso server_freeipa_replication_replica
URL: https://openqa.fedoraproject.org/tests/316414
ID: 316415 Test: x86_64 Server-dvd-iso server_freeipa_replication_client
URL: https://openqa.fedoraproject.org/tests/316415
ID: 316424 Test: x86_64 Everything-boot-iso ***@uefi **GATING**
URL: https://openqa.fedoraproject.org/tests/316424
ID: 316425 Test: x86_64 Everything-boot-iso install_default **GATING**
URL: https://openqa.fedoraproject.org/tests/316425
ID: 316492 Test: x86_64 universal ***@uefi
URL: https://openqa.fedoraproject.org/tests/316492

Old failures (same test failed in Rawhide-20181205.n.0):

ID: 316419 Test: x86_64 Server-dvd-iso modularity_tests
URL: https://openqa.fedoraproject.org/tests/316419
ID: 316430 Test: x86_64 Workstation-live-iso base_services_start
URL: https://openqa.fedoraproject.org/tests/316430
ID: 316438 Test: x86_64 Workstation-live-iso desktop_notifications_postinstall
URL: https://openqa.fedoraproject.org/tests/316438
ID: 316440 Test: x86_64 Workstation-boot-iso ***@uefi
URL: https://openqa.fedoraproject.org/tests/316440
ID: 316441 Test: x86_64 Workstation-boot-iso memory_check
URL: https://openqa.fedoraproject.org/tests/316441
ID: 316443 Test: i386 Workstation-boot-iso install_default
URL: https://openqa.fedoraproject.org/tests/316443
ID: 316444 Test: i386 Workstation-boot-iso memory_check
URL: https://openqa.fedoraproject.org/tests/316444
ID: 316459 Test: arm Minimal-raw_xz-raw.xz install_arm_image_deployment_upload
URL: https://openqa.fedoraproject.org/tests/316459
ID: 316510 Test: x86_64 universal upgrade_kde_64bit
URL: https://openqa.fedoraproject.org/tests/316510
ID: 316511 Test: x86_64 universal upgrade_desktop_encrypted_64bit
URL: https://openqa.fedoraproject.org/tests/316511
ID: 316515 Test: x86_64 universal upgrade_minimal_64bit
URL: https://openqa.fedoraproject.org/tests/316515
ID: 316516 Test: x86_64 universal upgrade_desktop_64bit
URL: https://openqa.fedoraproject.org/tests/316516
ID: 316517 Test: x86_64 universal upgrade_server_64bit
URL: https://openqa.fedoraproject.org/tests/316517
ID: 316518 Test: x86_64 universal upgrade_server_domain_controller
URL: https://openqa.fedoraproject.org/tests/316518
ID: 316519 Test: x86_64 universal upgrade_realmd_client
URL: https://openqa.fedoraproject.org/tests/316519
ID: 316525 Test: x86_64 universal install_shrink_ext4
URL: https://openqa.fedoraproject.org/tests/316525
ID: 316526 Test: x86_64 universal install_shrink_ntfs
URL: https://openqa.fedoraproject.org/tests/316526
ID: 316527 Test: x86_64 universal install_european_language
URL: https://openqa.fedoraproject.org/tests/316527
ID: 316528 Test: x86_64 universal install_cyrillic_language
URL: https://openqa.fedoraproject.org/tests/316528
ID: 316529 Test: x86_64 universal install_arabic_language
URL: https://openqa.fedoraproject.org/tests/316529
ID: 316530 Test: x86_64 universal install_asian_language
URL: https://openqa.fedoraproject.org/tests/316530
ID: 316539 Test: i386 universal upgrade_desktop_32bit
URL: https://openqa.fedoraproject.org/tests/316539

Soft failed openQA tests: 3/131 (x86_64), 2/23 (i386)
(Tests completed, but using a workaround for a known bug)

New soft failures (same test not soft failed in Rawhide-20181205.n.0):

ID: 316427 Test: x86_64 Workstation-live-iso install_default_upload
URL: https://openqa.fedoraproject.org/tests/316427
ID: 316428 Test: x86_64 Workstation-live-iso ***@uefi
URL: https://openqa.fedoraproject.org/tests/316428
ID: 316447 Test: x86_64 KDE-live-iso install_no_user
URL: https://openqa.fedoraproject.org/tests/316447

Old soft failures (same test soft failed in Rawhide-20181205.n.0):

ID: 316422 Test: i386 Server-boot-iso install_default
URL: https://openqa.fedoraproject.org/tests/316422
ID: 316423 Test: i386 Server-dvd-iso install_default
URL: https://openqa.fedoraproject.org/tests/316423

Passed openQA tests: 100/131 (x86_64), 18/23 (i386)

New passes (same test not passed in Rawhide-20181205.n.0):

ID: 316437 Test: x86_64 Workstation-live-iso desktop_notifications_live
URL: https://openqa.fedoraproject.org/tests/316437
ID: 316446 Test: x86_64 KDE-live-iso ***@uefi
URL: https://openqa.fedoraproject.org/tests/316446
ID: 316533 Test: x86_64 universal ***@uefi
URL: https://openqa.fedoraproject.org/tests/316533

Skipped non-gating openQA tests: 1 of 156

Installed system changes in test x86_64 Server-boot-iso ***@uefi:
Used mem changed from 170 MiB to 199 MiB
System load changed from 1.58 to 1.14
Previous test data: https://openqa.fedoraproject.org/tests/316161#downloads
Current test data: https://openqa.fedoraproject.org/tests/316395#downloads

Installed system changes in test x86_64 Server-dvd-iso install_default_upload:
System load changed from 1.28 to 1.66
Previous test data: https://openqa.fedoraproject.org/tests/316163#downloads
Current test data: https://openqa.fedoraproject.org/tests/316397#downloads

Installed system changes in test x86_64 Server-dvd-iso ***@uefi:
System load changed from 1.31 to 1.05
Previous test data: https://openqa.fedoraproject.org/tests/316164#downloads
Current test data: https://openqa.fedoraproject.org/tests/316398#downloads

Installed system changes in test i386 Server-boot-iso install_default:
Used mem changed from 122 MiB to 135 MiB
Previous test data: https://openqa.fedoraproject.org/tests/316188#downloads
Current test data: https://openqa.fedoraproject.org/tests/316422#downloads

Installed system changes in test i386 Everything-boot-iso install_default:
Used mem changed from 90 MiB to 102 MiB
System load changed from 0.39 to 0.25
Previous test data: https://openqa.fedoraproject.org/tests/316192#downloads
Current test data: https://openqa.fedoraproject.org/tests/316426#downloads

Installed system changes in test x86_64 Workstation-live-iso install_default_upload:
1 packages(s) added since previous compose: NetworkManager-config-connectivity-fedora
1 packages(s) removed since previous compose: boost-regex
Previous test data: https://openqa.fedoraproject.org/tests/316193#downloads
Current test data: https://openqa.fedoraproject.org/tests/316427#downloads

Installed system changes in test x86_64 Workstation-live-iso ***@uefi:
Used mem changed from 1027 MiB to 1244 MiB
Used Swap grew from 0 to 11 MiB
1 packages(s) added since previous compose: NetworkManager-config-connectivity-fedora
1 packages(s) removed since previous compose: boost-regex
System load changed from 1.71 to 2.28
Average CPU usage changed from 3.54285714 to 33.66666667
Previous test data: https://openqa.fedoraproject.org/tests/316194#downloads
Current test data: https://openqa.fedoraproject.org/tests/316428#downloads

Installed system changes in test x86_64 Workstation-boot-iso ***@uefi:
System load changed from 1.55 to 1.67
Previous test data: https://openqa.fedoraproject.org/tests/316205#downloads
Current test data: https://openqa.fedoraproject.org/tests/316439#downloads

Installed system changes in test x86_64 Workstation-boot-iso install_default:
System load changed from 1.85 to 2.20
Average CPU usage changed from 5.36190476 to 31.66666667
Previous test data: https://openqa.fedoraproject.org/tests/316208#downloads
Current test data: https://openqa.fedoraproject.org/tests/316442#downloads

Installed system changes in test x86_64 KDE-live-iso ***@uefi:
System load changed from 1.74 to 1.90
Previous test data: https://openqa.fedoraproject.org/tests/316213#downloads
Current test data: https://openqa.fedoraproject.org/tests/316446#downloads

Installed system changes in test x86_64 universal install_package_set_kde:
System load changed from 1.85 to 2.09
Average CPU usage changed from 15.56190476 to 39.02380952
Previous test data: https://openqa.fedoraproject.org/tests/316265#downloads
Current test data: https://openqa.fedoraproject.org/tests/316498#downloads

Installed system changes in test i386 universal install_package_set_minimal:
System load changed from 0.39 to 0.24
Previous test data: https://openqa.fedoraproject.org/tests/316309#downloads
Current test data: https://openqa.fedoraproject.org/tests/316542#downloads

Installed system changes in test i386 universal install_package_set_kde:
System load changed from 0.51 to 0.78
Previous test data: https://openqa.fedoraproject.org/tests/316317#downloads
Current test data: https://openqa.fedoraproject.org/tests/316550#downloads
--
Mail generated by check-compose:
https://pagure.io/fedora-qa/check-compose
_______________________________________________
devel mailing list -- ***@lists.fedoraproject.org
To unsubscribe send an email to devel-***@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/
Adam Williamson
2018-12-06 21:14:03 UTC
Permalink
Post by Fedora compose checker
No missing expected images.
Compose FAILS proposed Rawhide gating check!
5 of 47 required tests failed
openQA tests matching unsatisfied gating requirements shown with **GATING** below
So - this is a new feature of check-compose I wrote yesterday :)

As part of the 'NoMoreAlpha' change from a few releases back:

https://fedoraproject.org/wiki/Changes/NoMoreAlpha

we planned to start gating Rawhide composes - only syncing them out to
become the current public state of the 'Rawhide' tree if they pass some
subset of the automated compose tests. However, this has not yet been
implemented.

An initial gating policy was actually committed to the Fedora Greenwave
config some months back by Ralph Bean, and since then it's been
possible to ask Greenwave whether a given compose passes or fails the
policy - but nothing was hooked up beyond that; no-one's been doing
anything with that information.

Ultimately the idea is that the Greenwave decision should be hooked
into the compose sync process, but I thought before we go that far,
it'd be useful to know just how often composes actually *do* meet the
requirements. So I enhanced check-compose to request the decision from
Greenwave and include it in the output, like this. This should help us
get an idea just how often we'd be refusing to sync composes if we
turned gating on.

The failures that fail the gating check today are down to
https://bugzilla.redhat.com/show_bug.cgi?id=1654537 and the Everything
netinst tests for both x86_64 and UEFI failing because of the network
not being up in the guest for some reason. The FreeIPA bug I'm hopeful
we can get fixed soon, I'm not sure what's going on with the netinst
failure, I'll have to look into that. (It's a bit tricky because, when
the network in the guest doesn't work, we don't get any logs from the
test...)

Eagle-eyed readers may not a slight bug in the new feature: Greenwave
reports *5* failed requirements, but the details below show only *4*
tests with **GATING**. This is because the other failed test - the
FreeIPA server test - doesn't show up in the check-compose output for
some reason. If you re-run check-compose now, it *does* show up, so
this is likely some kind of ordering issue to do with exactly what
state that job is in when check-compose runs (my working theory is that
it's in 'uploading' state - that could cause it to fall between some
code cracks). I'll see if I can fix that.

Thanks folks!
--
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net
_______________________________________________
devel mailing list -- ***@lists.fedoraproject.org
To unsubscribe send an email to devel-***@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/

Loading...