From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS31976 209.132.180.0/23 X-Spam-Status: No, score=-2.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,RCVD_IN_DNSWL_HI,T_RP_MATCHES_RCVD shortcircuit=no autolearn=no autolearn_force=no version=3.4.0 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by dcvr.yhbt.net (Postfix) with ESMTP id 2CFFF1FAE2 for ; Thu, 8 Mar 2018 11:42:59 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S935812AbeCHLm5 (ORCPT ); Thu, 8 Mar 2018 06:42:57 -0500 Received: from mail-pl0-f65.google.com ([209.85.160.65]:45880 "EHLO mail-pl0-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S935780AbeCHLm4 (ORCPT ); Thu, 8 Mar 2018 06:42:56 -0500 Received: by mail-pl0-f65.google.com with SMTP id v9-v6so3151276plp.12 for ; Thu, 08 Mar 2018 03:42:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=zWMj61A9qySFACbkw/4soAwTFTD7sL9i+gifmTS8WTk=; b=aFpZmRL+2WorPtEdKFeIVH7sZc9lR4mwVhPQkZj4uze8PWPUn6PhbCEC0/YVEfblL/ fAi2zM1LtaM2Gr+XgpVMm2EDQiHGnM03s4+SwyZdXPyKLRaPgQ9UD71986xDCxBT5f/Y 8zbastIHo4y19RzSegTAKCFL5kl9KXdIqFfHfkU+YUZ4AHDQW7uJP1qT+oPSW1rw3tBE keXgKhhsNCcZedvyARauy5Kqqmyi3bY+vHBfaqyIGKGsj7vgWFRxom5lcgRJ8mdkH3tY INSrce8sJXYg8oHOFNWPsg4F4zY69UpIe88vP4TcIVPvy97Af7+qkubfFZ5dArbuVBtc 2EOg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=zWMj61A9qySFACbkw/4soAwTFTD7sL9i+gifmTS8WTk=; b=GAez2hBGNff81Mk+FIsJe6v0Kumi6rXyjl7xjJADjvKas+aNnDGqE5CTARRLQfK4Un lOsPm4AQ7sezOhBhENd5BAS7g7hPqrAKAJlxzaFdg5vCpCZMCLXbJW2yCUuqmVpEkeSc +FW//x8rtt+VSUbeHaBcneof/gy9GD+hYqBDDbNiWBXSeh+Uk0grcz5CKM4gAWuS3Cgc 4rJP7CVr6WhI7kM4Q/DO0ppmUuyzwVoRLz4/MtFTMHdDWy6denRGT1huPnjisOOvOEN0 1y/ob46JwljzFxNtFC3K9osK30oesQx1eVMBpn+VczMAL6JeeisS89deylC1Jf8svVHr ixxw== X-Gm-Message-State: APf1xPAIKe9u1mhFBBSDbdiUeJnaS+CA6VOWQ4obnUmisLWlHnb2URIC FQ1B9b1LVJN/yBgu65gyACA= X-Google-Smtp-Source: AG47ELukFKUzXC5gJ328g78lDpwBaq+EVZ3PjIB08yzEeolh4SV6hHZO67PZAsD5ad9VeoGjbHALyA== X-Received: by 2002:a17:902:a610:: with SMTP id u16-v6mr22752082plq.293.1520509376031; Thu, 08 Mar 2018 03:42:56 -0800 (PST) Received: from ash ([27.78.177.129]) by smtp.gmail.com with ESMTPSA id d70sm39895564pfl.119.2018.03.08.03.42.52 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 08 Mar 2018 03:42:55 -0800 (PST) Received: by ash (sSMTP sendmail emulation); Thu, 08 Mar 2018 18:42:51 +0700 From: =?UTF-8?q?Nguy=E1=BB=85n=20Th=C3=A1i=20Ng=E1=BB=8Dc=20Duy?= To: pclouds@gmail.com Cc: avarab@gmail.com, e@80x24.org, git@vger.kernel.org, gitster@pobox.com, peff@peff.net Subject: [PATCH/RFC v3 02/12] pack-objects: turn type and in_pack_type to bitfields Date: Thu, 8 Mar 2018 18:42:22 +0700 Message-Id: <20180308114232.10508-3-pclouds@gmail.com> X-Mailer: git-send-email 2.16.2.873.g32ff258c87 In-Reply-To: <20180308114232.10508-1-pclouds@gmail.com> References: <20180303024706.31465-1-pclouds@gmail.com> <20180308114232.10508-1-pclouds@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Sender: git-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org This saves 8 bytes in sizeof(struct object_entry). On a large repository like linux-2.6.git (6.5M objects), this saves us 52MB memory. Signed-off-by: Nguyễn Thái Ngọc Duy --- builtin/pack-objects.c | 14 ++++++++++++-- cache.h | 2 ++ object.h | 1 - pack-objects.h | 8 ++++---- 4 files changed, 18 insertions(+), 7 deletions(-) diff --git a/builtin/pack-objects.c b/builtin/pack-objects.c index 5c674b2843..fd217cb51f 100644 --- a/builtin/pack-objects.c +++ b/builtin/pack-objects.c @@ -1407,6 +1407,7 @@ static void check_object(struct object_entry *entry) unsigned long avail; off_t ofs; unsigned char *buf, c; + enum object_type type; buf = use_pack(p, &w_curs, entry->in_pack_offset, &avail); @@ -1415,11 +1416,15 @@ static void check_object(struct object_entry *entry) * since non-delta representations could still be reused. */ used = unpack_object_header_buffer(buf, avail, - &entry->in_pack_type, + &type, &entry->size); if (used == 0) goto give_up; + if (type < 0) + die("BUG: invalid type %d", type); + entry->in_pack_type = type; + /* * Determine if this is a delta and if so whether we can * reuse it or not. Otherwise let's find out as cheaply as @@ -1559,6 +1564,7 @@ static void drop_reused_delta(struct object_entry *entry) { struct object_entry **p = &entry->delta->delta_child; struct object_info oi = OBJECT_INFO_INIT; + enum object_type type; while (*p) { if (*p == entry) @@ -1570,7 +1576,7 @@ static void drop_reused_delta(struct object_entry *entry) entry->depth = 0; oi.sizep = &entry->size; - oi.typep = &entry->type; + oi.typep = &type; if (packed_object_info(entry->in_pack, entry->in_pack_offset, &oi) < 0) { /* * We failed to get the info from this pack for some reason; @@ -1580,6 +1586,10 @@ static void drop_reused_delta(struct object_entry *entry) */ entry->type = sha1_object_info(entry->idx.oid.hash, &entry->size); + } else { + if (type < 0) + die("BUG: invalid type %d", type); + entry->type = type; } } diff --git a/cache.h b/cache.h index 21fbcc2414..862bdff83a 100644 --- a/cache.h +++ b/cache.h @@ -373,6 +373,8 @@ extern void free_name_hash(struct index_state *istate); #define read_blob_data_from_cache(path, sz) read_blob_data_from_index(&the_index, (path), (sz)) #endif +#define TYPE_BITS 3 + enum object_type { OBJ_BAD = -1, OBJ_NONE = 0, diff --git a/object.h b/object.h index 87563d9056..8ce294d6ec 100644 --- a/object.h +++ b/object.h @@ -25,7 +25,6 @@ struct object_array { #define OBJECT_ARRAY_INIT { 0, 0, NULL } -#define TYPE_BITS 3 /* * object flag allocation: * revision.h: 0---------10 26 diff --git a/pack-objects.h b/pack-objects.h index f834ead541..85b01b66da 100644 --- a/pack-objects.h +++ b/pack-objects.h @@ -60,11 +60,11 @@ struct object_entry { void *delta_data; /* cached delta (uncompressed) */ unsigned long delta_size; /* delta data size (uncompressed) */ unsigned long z_delta_size; /* delta data size (compressed) */ - enum object_type type; - enum object_type in_pack_type; /* could be delta */ uint32_t hash; /* name hint hash */ unsigned int in_pack_pos; unsigned char in_pack_header_size; + unsigned type:TYPE_BITS; + unsigned in_pack_type:TYPE_BITS; /* could be delta */ unsigned preferred_base:1; /* * we do not pack this, but is available * to be used as the base object to delta @@ -74,7 +74,7 @@ struct object_entry { unsigned tagged:1; /* near the very tip of refs */ unsigned filled:1; /* assigned write-order */ - /* XXX 28 bits hole, try to pack */ + /* XXX 22 bits hole, try to pack */ /* * State flags for depth-first search used for analyzing delta cycles. * @@ -87,7 +87,7 @@ struct object_entry { DFS_DONE } dfs_state; int depth; - /* size: 136, padding: 4 */ + /* size: 128, padding: 4 */ }; struct packing_data { -- 2.16.2.873.g32ff258c87