From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_INVALID,DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C8170C43381 for ; Wed, 6 Mar 2019 20:52:17 +0000 (UTC) Received: from shelob.surriel.com (shelob.surriel.com [96.67.55.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 75BDE20657 for ; Wed, 6 Mar 2019 20:52:17 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (2048-bit key) header.d=google.com header.i=@google.com header.b="XbjG8B3U" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 75BDE20657 Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=fail smtp.mailfrom=kernelnewbies-bounces@kernelnewbies.org Received: from localhost ([::1] helo=shelob.surriel.com) by shelob.surriel.com with esmtp (Exim 4.91) (envelope-from ) id 1h1dVp-0006uS-Mb; Wed, 06 Mar 2019 15:51:37 -0500 Received: from mail-wm1-x341.google.com ([2a00:1450:4864:20::341]) by shelob.surriel.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.91) (envelope-from ) id 1h1dVn-0006uK-7N for kernelnewbies@kernelnewbies.org; Wed, 06 Mar 2019 15:51:35 -0500 Received: by mail-wm1-x341.google.com with SMTP id o10so5269243wmc.1 for ; Wed, 06 Mar 2019 12:51:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ZJLEOsPog/CIrY5jxHmA3PBNZAKQvPaY63wWVeaCr78=; b=XbjG8B3UMdMo14CwI0R7gZM2BBEIav3ka3QHWKRCIlVntZSe6o1oLEN2OHIDiFKlBY h6bCubMJDU9RlekzmAwaDp74gfRPfBXRz38UzZYMWlguJCkUAG/hhFWhxD5NxDHoA9aW D0agUo4i1IzSKHjcQvnGus9FKuYw9xAI92bMBrFBFeR2O3gGecHiKVOQDefI1+1IYZXs zliIZtrbP8ArqXtFaxqveAVufl7EwRIdvtvYaE8REmuyJnqkWXvYLLaw1qmnVYdrfOML KVIDBI6oWcZG4kgiAFsSnogOSAV8Uo2sxDxg7K0ApWF8R3z8m/qdfH0MdK7ptNH+4Ve+ BpPQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ZJLEOsPog/CIrY5jxHmA3PBNZAKQvPaY63wWVeaCr78=; b=FQiJ2/gofV9Lhh0x7dPVydXxYUmSVkxtYhE2i+z0zFxKTi/HxPjnHASK8m++mBEopW k46Z7f41lyVCCphQXnu7r6BsEfWOWakbtjh05n9ORzBBk53wYRmQ37NBKny2nq5XZtZA 4cySkVtIvyKtdbscTOl09nRTUv2zOGTGr5NAoqr/OphDWyERhjdhzHK7xZoLvPwHwyxU NrWe9+YPCjweDktlvjxiNfoG6DS9V+HzIufWDy3h8RdNha2QmuEjIsaO2MI9RxgfGTTu /Q/hskRGRUrO4iO2ImuNpIMBima7NVCCoYjF4Os24krH8vmFENDv8ANlEidtALjICcF0 d0JQ== X-Gm-Message-State: APjAAAWQUdrVgSjh8WZJdGRzeAyssB7H4TshZVJ5pcuLmOydsjeBcnG8 HfaldvIvZp31qUTQ8u+H3U2WPngQ8l8ZJ2msTm8z X-Google-Smtp-Source: APXvYqybbzWBS81xnSwlNXEwyNoxy3K2Up1jLn3v6fJC8BI0hjp41q4IvU3jklfaBzyaGcprBe/kcHESrxFXBrtbHqY= X-Received: by 2002:a1c:6409:: with SMTP id y9mr3745974wmb.68.1551905433124; Wed, 06 Mar 2019 12:50:33 -0800 (PST) MIME-Version: 1.0 References: <20181216190639.6safwjqwdphkce67@gmail.com> <20181216194649.GA7732@pure.paranoia.local> <20181216195343.idnt2y5y5wjky5gu@gmail.com> <20190104013522.stng6gwauwnr6wbi@starla> <20190305232600.GA12110@dcvr> In-Reply-To: <20190305232600.GA12110@dcvr> From: Bjorn Helgaas Date: Wed, 6 Mar 2019 14:50:20 -0600 Message-ID: Subject: Re: [RFC] LKML Archive in Maildir Format To: Eric Wong Cc: Jasper Spaans , kernelnewbies@kernelnewbies.org, Greg Kroah-Hartman , Linux Kernel Mailing List , Eric Biederman , Joey Pabalinas , Linus Torvalds , Konstantin Ryabitsev X-BeenThere: kernelnewbies@kernelnewbies.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Learn about the Linux kernel List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: kernelnewbies-bounces@kernelnewbies.org On Tue, Mar 5, 2019 at 5:26 PM Eric Wong wrote: > Bjorn Helgaas wrote: > > Any pointers? I guess there's no mutt backend that can read a > > public-inbox archive directly? > > There's mutt patches to support reading over NNTP, so that > works: > > mutt -f news://$INBOX_HOST/$INBOX_NEWSGROUP Neomutt includes NNTP support, so I tried this: neomutt -f news://nntp.lore.kernel.org/org.kernel.vger.linux-kernel which worked OK but (1) I only see the most recent 1000 messages and (2) obviously isn't reading a *local* archive. Neomutt took about 45 seconds to start up over my wimpy ISP. I assume I could probably have a local archive and run a local NNTP server and point neomutt at that local server. But I don't know how full-archive searching would work there. > I don't think mutt handles mboxrd 100% correctly, but it's close > enough that you can can download the gzipped mboxrd of a search > query and open it via "mutt -f /path/to/downloaded/mbox.gz" > > curl -XPOST -OJ "$INBOX_URL/?q=$SEARCH_QUERY&x=m" I got nothing at all with -XPOST, but this: curl -OJ "https://lore.kernel.org/linux-pci/?q=d:20190301..&x=m" got me the HTML source. Nothing that looks like mboxrd. I assume this is stupid user error on my part, but even with that resolved, it wouldn't have the nice git fetch properties of the git archive, i.e., incremental updates of only new stuff, would it? I think my ideal solution would be a mutt that could read the git archive directly, plus a notmuch index. But AFAIK, mutt can't do that, and notmuch only works with one message per file, not with the git archive. Something that might work would be to use Konstantin's "git archive to maildir" hint but shard into a bunch of smaller maildirs instead of one big one, then have notmuch index those, and use mutt or vim with notmuch queries instead of having it read in a maildir. But I feel like I must be missing the solution that's obvious to everybody but me. Bjorn _______________________________________________ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies