From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 39E88158043 for ; Tue, 16 Apr 2024 01:40:29 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 61954E29ED; Tue, 16 Apr 2024 01:40:28 +0000 (UTC) Received: from smtp.gentoo.org (woodpecker.gentoo.org [140.211.166.183]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 3B130E29ED for ; Tue, 16 Apr 2024 01:40:28 +0000 (UTC) Received: from oystercatcher.gentoo.org (oystercatcher.gentoo.org [148.251.78.52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp.gentoo.org (Postfix) with ESMTPS id 2E632343157 for ; Tue, 16 Apr 2024 01:40:27 +0000 (UTC) Received: from localhost.localdomain (localhost [IPv6:::1]) by oystercatcher.gentoo.org (Postfix) with ESMTP id 8BE951674 for ; Tue, 16 Apr 2024 01:40:25 +0000 (UTC) From: "Sam James" To: gentoo-commits@lists.gentoo.org Content-Transfer-Encoding: 8bit Content-type: text/plain; charset=UTF-8 Reply-To: gentoo-dev@lists.gentoo.org, "Sam James" Message-ID: <1713231528.b91c99d07e33c296a23e3b18b2658b81815b6b31.sam@gentoo> Subject: [gentoo-commits] repo/gentoo:master commit in: eclass/ X-VCS-Repository: repo/gentoo X-VCS-Files: eclass/toolchain.eclass X-VCS-Directories: eclass/ X-VCS-Committer: sam X-VCS-Committer-Name: Sam James X-VCS-Revision: b91c99d07e33c296a23e3b18b2658b81815b6b31 X-VCS-Branch: master Date: Tue, 16 Apr 2024 01:40:25 +0000 (UTC) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-commits@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply X-Archives-Salt: 41f3cf41-76bf-4b51-9aff-34f6ff356627 X-Archives-Hash: da0a50952eda31d658d53f4877c69eb2 commit: b91c99d07e33c296a23e3b18b2658b81815b6b31 Author: Gabi Falk gmx com> AuthorDate: Mon Apr 15 08:00:00 2024 +0000 Commit: Sam James gentoo org> CommitDate: Tue Apr 16 01:38:48 2024 +0000 URL: https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=b91c99d0 toolchain.eclass: always generate a new test-suite baseline manifest Previously, a new baseline was generated only in cases of test suite success or when GCC_TESTS_IGNORE_NO_BASELINE was enabled. After this change, if there is a test suite regression, users will have the option to copy the new baseline file to the cache if they choose to tolerate the regression. Additionally, the toolchain_pkg_preinst() function will update the baseline automatically if the package is built with the FEATURES=test-fail-continue setting. Signed-off-by: Gabi Falk gmx.com> Signed-off-by: Sam James gentoo.org> eclass/toolchain.eclass | 16 +++++++++------- 1 file changed, 9 insertions(+), 7 deletions(-) diff --git a/eclass/toolchain.eclass b/eclass/toolchain.eclass index 37a806e1c800..786d65da2d9a 100644 --- a/eclass/toolchain.eclass +++ b/eclass/toolchain.eclass @@ -1908,6 +1908,15 @@ toolchain_src_test() { # the exit code of targets other than 'check' may be unreliable. nonfatal emake -C "${WORKDIR}"/build -k "${GCC_TESTS_CHECK_TARGET}" RUNTESTFLAGS="${GCC_TESTS_RUNTESTFLAGS}" + # Produce an updated failure manifest. + einfo "Generating a new failure manifest ${T}/${CHOST}.xfail" + rm -f "${T}"/${CHOST}.xfail + edo "${T}"/validate_failures.py \ + --srcpath="${S}" \ + --build_dir="${WORKDIR}"/build \ + --manifest="${T}"/${CHOST}.xfail \ + --produce_manifest &> /dev/null + if [[ -f "${GCC_TESTS_COMPARISON_DIR}/${GCC_TESTS_COMPARISON_SLOT}/${CHOST}.xfail" ]] ; then # TODO: Distribute some baseline results in e.g. gcc-patches.git? # validate_failures.py manifest files support include directives. @@ -1936,13 +1945,6 @@ toolchain_src_test() { die "Tests failed (failures occurred with no reference data)" fi fi - - # Produce an updated set of expected results - edo "${T}"/validate_failures.py \ - --srcpath="${S}" \ - --build_dir="${WORKDIR}"/build \ - --manifest="${T}"/${CHOST}.xfail \ - --produce_manifest &> /dev/null } #---->> src_install <<----