From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id DC4461395E2 for ; Wed, 7 Dec 2016 02:10:29 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 2BE3FE0D49; Wed, 7 Dec 2016 02:10:29 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 0BD66E0D49 for ; Wed, 7 Dec 2016 02:10:29 +0000 (UTC) Received: from oystercatcher.gentoo.org (oystercatcher.gentoo.org [148.251.78.52]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.gentoo.org (Postfix) with ESMTPS id 618B0335DEF for ; Wed, 7 Dec 2016 02:10:26 +0000 (UTC) Received: from localhost.localdomain (localhost [127.0.0.1]) by oystercatcher.gentoo.org (Postfix) with ESMTP id C0F4724B6 for ; Wed, 7 Dec 2016 02:10:24 +0000 (UTC) From: "Mart Raudsepp" To: gentoo-commits@lists.gentoo.org Content-Transfer-Encoding: 8bit Content-type: text/plain; charset=UTF-8 Reply-To: gentoo-dev@lists.gentoo.org, "Mart Raudsepp" Message-ID: <1481076483.32483c9459bcfc4f7e3848b3c0e3dc6c1c41829d.leio@gentoo> Subject: [gentoo-commits] proj/grumpy:master commit in: backend/lib/ X-VCS-Repository: proj/grumpy X-VCS-Files: backend/lib/sync.py X-VCS-Directories: backend/lib/ X-VCS-Committer: leio X-VCS-Committer-Name: Mart Raudsepp X-VCS-Revision: 32483c9459bcfc4f7e3848b3c0e3dc6c1c41829d X-VCS-Branch: master Date: Wed, 7 Dec 2016 02:10:24 +0000 (UTC) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-commits@lists.gentoo.org X-Archives-Salt: d1abdb0c-1e37-480e-a738-55e3d5db51a2 X-Archives-Hash: e5bf0bf2a7d680b2302d8ad1e5b74f97 commit: 32483c9459bcfc4f7e3848b3c0e3dc6c1c41829d Author: Mart Raudsepp gentoo org> AuthorDate: Wed Dec 7 02:08:03 2016 +0000 Commit: Mart Raudsepp gentoo org> CommitDate: Wed Dec 7 02:08:03 2016 +0000 URL: https://gitweb.gentoo.org/proj/grumpy.git/commit/?id=32483c94 sync: Order package details syncing based on how old the last sync was This way if we got stuck and re-run much later (or it has exceeded the buffer time constant), we'll at least sync the oldest ones first, so we always end up being less out of date with the oldest sync ts. backend/lib/sync.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/backend/lib/sync.py b/backend/lib/sync.py index 567da2d..0250fba 100644 --- a/backend/lib/sync.py +++ b/backend/lib/sync.py @@ -154,7 +154,7 @@ def sync_versions(): for maintainer in Maintainer.query.all(): existing_maintainers[maintainer.email] = maintainer - for package in Package.query.filter(Package.last_sync_ts < ts).all(): + for package in Package.query.filter(Package.last_sync_ts < ts).order_by(Package.last_sync_ts).all(): cnt += 1 data = http_session.get(pkg_url_base + "packages/" + package.full_name + ".json") if not data: