All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Zbigniew Kempczyński" <zbigniew.kempczynski@intel.com>
To: igt-dev@lists.freedesktop.org
Subject: [igt-dev] [PATCH i-g-t v30 11/39] lib/intel_allocator: Separate allocator multiprocess start
Date: Fri,  2 Apr 2021 11:38:16 +0200	[thread overview]
Message-ID: <20210402093844.39637-12-zbigniew.kempczynski@intel.com> (raw)
In-Reply-To: <20210402093844.39637-1-zbigniew.kempczynski@intel.com>

Validating allocator code (leaks and memory overwriting) can be done
with address sanitizer. When allocator is not working in multiprocess
mode it is easy, problems start when fork is in the game. In this
situation we need to separate preparation and starting allocator thread.

Signed-off-by: Zbigniew Kempczyński <zbigniew.kempczynski@intel.com>
Reported-by: Andrzej Turko <andrzej.turko@linux.intel.com>
Cc: Andrzej Turko <andrzej.turko@linux.intel.com>
Cc: Dominik Grzegorzek <dominik.grzegorzek@intel.com>
Cc: Chris Wilson <chris@chris-wilson.co.uk>
Acked-by: Daniel Vetter <daniel.vetter@ffwll.ch>
---
 lib/intel_allocator.c | 41 ++++++++++++++++++++++++++++++++++-------
 lib/intel_allocator.h |  2 ++
 2 files changed, 36 insertions(+), 7 deletions(-)

diff --git a/lib/intel_allocator.c b/lib/intel_allocator.c
index 930cd9dc2..6298a5a20 100644
--- a/lib/intel_allocator.c
+++ b/lib/intel_allocator.c
@@ -776,6 +776,38 @@ static void *allocator_thread_loop(void *data)
 	return NULL;
 }
 
+
+/**
+ * __intel_allocator_multiprocess_prepare:
+ *
+ * Prepares allocator infrastructure to work in multiprocess mode.
+ *
+ * Some description is required why prepare/start steps are separated.
+ * When we write the code and we don't use address sanitizer simple
+ * intel_allocator_multiprocess_start() call is enough. With address
+ * sanitizer and using forking we can encounter situation where one
+ * forked child called allocator alloc() (so parent has some poisoned
+ * memory in shadow map), then second fork occurs. Second child will
+ * get poisoned shadow map from parent (there allocator thread reside).
+ * Checking shadow map in this child will report memory leak.
+ *
+ * How to separate initialization steps take a look into api_intel_allocator.c
+ * fork_simple_stress() function.
+ */
+void __intel_allocator_multiprocess_prepare(void)
+{
+	intel_allocator_init();
+
+	multiprocess = true;
+	channel->init(channel);
+}
+
+void __intel_allocator_multiprocess_start(void)
+{
+	pthread_create(&allocator_thread, NULL,
+		       allocator_thread_loop, NULL);
+}
+
 /**
  * intel_allocator_multiprocess_start:
  *
@@ -797,13 +829,8 @@ void intel_allocator_multiprocess_start(void)
 
 	igt_assert_f(child_pid == -1,
 		     "Allocator thread can be spawned only in main IGT process\n");
-	intel_allocator_init();
-
-	multiprocess = true;
-	channel->init(channel);
-
-	pthread_create(&allocator_thread, NULL,
-		       allocator_thread_loop, NULL);
+	__intel_allocator_multiprocess_prepare();
+	__intel_allocator_multiprocess_start();
 }
 
 /**
diff --git a/lib/intel_allocator.h b/lib/intel_allocator.h
index 440c5992d..9b7bd0908 100644
--- a/lib/intel_allocator.h
+++ b/lib/intel_allocator.h
@@ -160,6 +160,8 @@ struct intel_allocator {
 };
 
 void intel_allocator_init(void);
+void __intel_allocator_multiprocess_prepare(void);
+void __intel_allocator_multiprocess_start(void);
 void intel_allocator_multiprocess_start(void);
 void intel_allocator_multiprocess_stop(void);
 
-- 
2.26.0

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

  parent reply	other threads:[~2021-04-02  9:39 UTC|newest]

Thread overview: 43+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-04-02  9:38 [igt-dev] [PATCH i-g-t v30 00/39] Introduce IGT allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 01/39] lib/igt_list: Add igt_list_del_init() Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 02/39] lib/igt_list: Add igt_list_for_each_entry_safe_reverse Zbigniew Kempczyński
2021-04-08  7:44   ` Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 03/39] lib/igt_map: Adopt Mesa hash table Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 04/39] lib/igt_core: Track child process pid and tid Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 05/39] lib/intel_allocator_simple: Add simple allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 06/39] lib/intel_allocator_reloc: Add reloc allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 07/39] lib/intel_allocator_random: Add random allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 08/39] lib/intel_allocator: Add intel_allocator core Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 09/39] lib/intel_allocator: Try to stop smoothly instead of deinit Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 10/39] lib/intel_allocator_msgchannel: Scale to 4k of parallel clients Zbigniew Kempczyński
2021-04-02  9:38 ` Zbigniew Kempczyński [this message]
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 12/39] lib/intel_bufops: Change size from 32->64 bit Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 13/39] lib/intel_bufops: Add init with handle and size function Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 14/39] lib/intel_batchbuffer: Integrate intel_bb with allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 15/39] lib/intel_batchbuffer: Use relocations in intel-bb up to gen12 Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 16/39] lib/intel_batchbuffer: Create bb with strategy / vm ranges Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 17/39] lib/intel_batchbuffer: Add tracking intel_buf to intel_bb Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 18/39] lib/intel_batchbuffer: Don't collect relocations for newer gens Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 19/39] lib/igt_fb: Initialize intel_buf with same size as fb Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 20/39] tests/api_intel_bb: Remove check-canonical test Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 21/39] tests/api_intel_bb: Modify test to verify intel_bb with allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 22/39] tests/api_intel_bb: Add compressed->compressed copy Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 23/39] tests/api_intel_bb: Add purge-bb test Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 24/39] tests/api_intel_bb: Add simple intel-bb which uses allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 25/39] tests/api_intel_bb: Use allocator in delta-check test Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 26/39] tests/api_intel_bb: Check switching vm in intel-bb Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 27/39] tests/api_intel_allocator: Simple allocator test suite Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 28/39] tests/api_intel_allocator: Add execbuf with allocator example Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 29/39] tests/api_intel_allocator: Verify child can use its standalone allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 30/39] tests/gem_softpin: Verify allocator and execbuf pair work together Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 31/39] tests/gem|kms: Remove intel_bb from fixture Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 32/39] tests/gem_mmap_offset: Use intel_buf wrapper code instead direct Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 33/39] tests/gem_ppgtt: Adopt test to use intel_bb with allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 34/39] tests/gem_render_copy_redux: Adopt to use with intel_bb and allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 35/39] tests/perf.c: Remove buffer from batch Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 36/39] tests/gem_linear_blits: Use intel allocator Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 37/39] lib/intel_allocator: drop kill_children() Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 38/39] lib/intel_allocator: Add alloc function which allows passing strategy argument Zbigniew Kempczyński
2021-04-02  9:38 ` [igt-dev] [PATCH i-g-t v30 39/39] tests/api_intel_allocator: Check alloc with strategy API Zbigniew Kempczyński
2021-04-02 10:16 ` [igt-dev] ✓ Fi.CI.BAT: success for Introduce IGT allocator (rev33) Patchwork
2021-04-02 11:13 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20210402093844.39637-12-zbigniew.kempczynski@intel.com \
    --to=zbigniew.kempczynski@intel.com \
    --cc=igt-dev@lists.freedesktop.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.