All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Zbigniew Kempczyński" <zbigniew.kempczynski@intel.com>
To: igt-dev@lists.freedesktop.org
Cc: Chris Wilson <chris@chris-wilson.co.uk>
Subject: [igt-dev] [PATCH i-g-t v12 30/31] lib/intel_allocator: Separate allocator multiprocess start
Date: Tue,  5 Jan 2021 09:10:47 +0100	[thread overview]
Message-ID: <20210105081048.14389-31-zbigniew.kempczynski@intel.com> (raw)
In-Reply-To: <20210105081048.14389-1-zbigniew.kempczynski@intel.com>

Validating allocator code (leaks and memory overwriting) can be done
with address sanitizer. When allocator is not working in multiprocess
mode it is easy, problems start when fork is in the game. In this
situation we need to separate preparation and starting allocator thread.

Signed-off-by: Zbigniew Kempczyński <zbigniew.kempczynski@intel.com>
Reported-by: Andrzej Turko <andrzej.turko@linux.intel.com>
Cc: Andrzej Turko <andrzej.turko@linux.intel.com>
Cc: Dominik Grzegorzek <dominik.grzegorzek@intel.com>
Cc: Chris Wilson <chris@chris-wilson.co.uk>
---
 lib/intel_allocator.c | 42 +++++++++++++++++++++++++++++++++++-------
 lib/intel_allocator.h |  2 ++
 2 files changed, 37 insertions(+), 7 deletions(-)

diff --git a/lib/intel_allocator.c b/lib/intel_allocator.c
index dd7fa5e19..90735b38b 100644
--- a/lib/intel_allocator.c
+++ b/lib/intel_allocator.c
@@ -503,6 +503,39 @@ static void *allocator_thread_loop(void *data)
 	return NULL;
 }
 
+
+/**
+ * __intel_allocator_multiprocess_prepare:
+ *
+ * Prepares allocator infrastructure to work in multiprocess mode.
+ *
+ * Some description is required why prepare/start steps are separated.
+ * When we write the code and we don't use address sanitizer simple
+ * intel_allocator_multiprocess_start() call is enough. With address
+ * sanitizer and using forking we can encounter situation where one
+ * forked child called allocator alloc() (so parent has some poisoned
+ * memory in shadow map), then second fork occurs. Second child will
+ * get poisoned shadow map from parent (there allocator thread reside).
+ * Checking shadow map in this child will report memory leak.
+ *
+ * How to separate initialization steps take a look into api_intel_allocator.c
+ * fork_simple_stress() function.
+ */
+void __intel_allocator_multiprocess_prepare(void)
+{
+	intel_allocator_init();
+
+	multiprocess = true;
+	channel->init(channel);
+}
+
+void __intel_allocator_multiprocess_start(void)
+{
+
+	pthread_create(&allocator_thread, NULL,
+		       allocator_thread_loop, NULL);
+}
+
 /**
  * intel_allocator_multiprocess_start:
  *
@@ -522,13 +555,8 @@ void intel_allocator_multiprocess_start(void)
 {
 	alloc_info("allocator multiprocess start\n");
 
-	intel_allocator_init();
-
-	multiprocess = true;
-	channel->init(channel);
-
-	pthread_create(&allocator_thread, NULL,
-		       allocator_thread_loop, NULL);
+	__intel_allocator_multiprocess_prepare();
+	__intel_allocator_multiprocess_start();
 }
 
 /**
diff --git a/lib/intel_allocator.h b/lib/intel_allocator.h
index 0654b3b84..7863566ec 100644
--- a/lib/intel_allocator.h
+++ b/lib/intel_allocator.h
@@ -97,6 +97,8 @@ struct intel_allocator {
 };
 
 void intel_allocator_init(void);
+void __intel_allocator_multiprocess_prepare(void);
+void __intel_allocator_multiprocess_start(void);
 void intel_allocator_multiprocess_start(void);
 void intel_allocator_multiprocess_stop(void);
 
-- 
2.26.0

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

  parent reply	other threads:[~2021-01-05  8:11 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-01-05  8:10 [igt-dev] [PATCH i-g-t v12 00/31] Introduce IGT allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 01/31] lib/igt_list: igt_hlist implementation Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 02/31] lib/igt_map: Introduce igt_map Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 03/31] lib/igt_core: Track child process pid and tid Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 04/31] lib/intel_allocator_simple: Add simple allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 05/31] lib/intel_allocator_random: Add random allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 06/31] lib/intel_allocator: Add intel_allocator core Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 07/31] lib/intel_allocator: Try to stop smoothly instead of deinit Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 08/31] lib/intel_allocator_msgchannel: Scale to 4k of parallel clients Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 09/31] lib/intel_bufops: Removes handle from allocator, change size Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 10/31] lib/intel_bufops: Add init with handle and size function Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 11/31] lib/intel_batchbuffer: Integrate intel_bb with allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 12/31] lib/intel_batchbuffer: Add tracking intel_buf to intel_bb Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 13/31] lib/intel_aux_pgtable: Get addresses for aux table from an allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 14/31] lib/igt_fb: Initialize intel_buf with same size as fb Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 15/31] tests/api_intel_bb: Modify test to verify intel_bb with allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 16/31] tests/api_intel_bb: Add compressed->compressed copy Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 17/31] tests/api_intel_allocator: Simple allocator test suite Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 18/31] tests/gem|kms: Remove intel_bb from fixture Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 19/31] tests/gem_mmap_offset: Use intel_buf wrapper code instead direct Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 20/31] tests/gem_ppgtt: Adopt test to use intel_bb with allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 21/31] tests/gem_render_copy_redux: Adopt to use with intel_bb and allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 22/31] tests/perf.c: Remove buffer from batch Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 23/31] tests/gem_linear_blits: Use intel allocator Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 24/31] lib/ioctl_wrappers: Add gem_has_relocations() check Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 25/31] lib/intel_batchbuffer: Use relocations in intel-bb up to gen12 Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 26/31] tests/api_intel_*: Adopt to use relocations as default " Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 27/31] tests/gem_ppgtt: Migrate memory check out of render blits Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 28/31] tests/api_intel_bb: Remove check-canonical test Zbigniew Kempczyński
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 29/31] tests/api_intel_bb: Use allocator in delta-check test Zbigniew Kempczyński
2021-01-05  8:10 ` Zbigniew Kempczyński [this message]
2021-01-05  8:10 ` [igt-dev] [PATCH i-g-t v12 31/31] tests/api_intel_allocator: Prepare to run with sanitizer Zbigniew Kempczyński
2021-01-05  9:10 ` [igt-dev] ✓ Fi.CI.BAT: success for Introduce IGT allocator (rev13) Patchwork
2021-01-05 10:10 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20210105081048.14389-31-zbigniew.kempczynski@intel.com \
    --to=zbigniew.kempczynski@intel.com \
    --cc=chris@chris-wilson.co.uk \
    --cc=igt-dev@lists.freedesktop.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.