From mboxrd@z Thu Jan 1 00:00:00 1970 From: tglx at linutronix.de (Thomas Gleixner) Date: Thu, 27 Sep 2018 23:30:09 +0200 (CEST) Subject: [RFC 00/20] ns: Introduce Time Namespace In-Reply-To: <87zhw4rwiq.fsf@xmission.com> References: <20180919205037.9574-1-dima@arista.com> <874lej6nny.fsf@xmission.com> <20180924205119.GA14833@outlook.office365.com> <874leezh8n.fsf@xmission.com> <20180925014150.GA6302@outlook.office365.com> <87zhw4rwiq.fsf@xmission.com> Message-ID: On Wed, 26 Sep 2018, Eric W. Biederman wrote: > Reading the code the calling sequence there is: > tick_sched_do_timer > tick_do_update_jiffies64 > update_wall_time > timekeeping_advance > timekeepging_update > > If I read that properly under the right nohz circumstances that update > can be delayed indefinitely. > > So I think we could prototype a time namespace that was per > timekeeping_update and just had update_wall_time iterate through > all of the time namespaces. Please don't go there. timekeeping_update() is already heavy and walking through a gazillion of namespaces will just make it horrible, > I don't think the naive version would scale to very many time > namespaces. :) > At the same time using the techniques from the nohz work and a little > smarts I expect we could get the code to scale. You'd need to invoke the update when the namespace is switched in and hasn't been updated since the last tick happened. That might be doable, but you also need to take the wraparound constraints of the underlying clocksources into account, which again can cause walking all name spaces when they are all idle long enough. >>From there it becomes hairy, because it's not only timekeeping, i.e. reading time, this is also affecting all timers which are armed from a namespace. That gets really ugly because when you do settimeofday() or adjtimex() for a particular namespace, then you have to search for all armed timers of that namespace and adjust them. The original posix timer code had the same issue because it mapped the clock realtime timers to the timer wheel so any setting of the clock caused a full walk of all armed timers, disarming, adjusting and requeing them. That's horrible not only performance wise, it's also a locking nightmare of all sorts. Add time skew via NTP/PTP into the picture and you might have to adjust timers as well, because you need to guarantee that they are not expiring early. I haven't looked through Dimitry's patches yet, but I don't see how this can work at all without introducing subtle issues all over the place. Thanks, tglx From mboxrd@z Thu Jan 1 00:00:00 1970 From: tglx@linutronix.de (Thomas Gleixner) Date: Thu, 27 Sep 2018 23:30:09 +0200 (CEST) Subject: [RFC 00/20] ns: Introduce Time Namespace In-Reply-To: <87zhw4rwiq.fsf@xmission.com> References: <20180919205037.9574-1-dima@arista.com> <874lej6nny.fsf@xmission.com> <20180924205119.GA14833@outlook.office365.com> <874leezh8n.fsf@xmission.com> <20180925014150.GA6302@outlook.office365.com> <87zhw4rwiq.fsf@xmission.com> Message-ID: Content-Type: text/plain; charset="UTF-8" Message-ID: <20180927213009.AbrvKX3VTHSF66Roqq9N64QIbj6UsmtuBa0W9900gH0@z> On Wed, 26 Sep 2018, Eric W. Biederman wrote: > Reading the code the calling sequence there is: > tick_sched_do_timer > tick_do_update_jiffies64 > update_wall_time > timekeeping_advance > timekeepging_update > > If I read that properly under the right nohz circumstances that update > can be delayed indefinitely. > > So I think we could prototype a time namespace that was per > timekeeping_update and just had update_wall_time iterate through > all of the time namespaces. Please don't go there. timekeeping_update() is already heavy and walking through a gazillion of namespaces will just make it horrible, > I don't think the naive version would scale to very many time > namespaces. :) > At the same time using the techniques from the nohz work and a little > smarts I expect we could get the code to scale. You'd need to invoke the update when the namespace is switched in and hasn't been updated since the last tick happened. That might be doable, but you also need to take the wraparound constraints of the underlying clocksources into account, which again can cause walking all name spaces when they are all idle long enough. >>From there it becomes hairy, because it's not only timekeeping, i.e. reading time, this is also affecting all timers which are armed from a namespace. That gets really ugly because when you do settimeofday() or adjtimex() for a particular namespace, then you have to search for all armed timers of that namespace and adjust them. The original posix timer code had the same issue because it mapped the clock realtime timers to the timer wheel so any setting of the clock caused a full walk of all armed timers, disarming, adjusting and requeing them. That's horrible not only performance wise, it's also a locking nightmare of all sorts. Add time skew via NTP/PTP into the picture and you might have to adjust timers as well, because you need to guarantee that they are not expiring early. I haven't looked through Dimitry's patches yet, but I don't see how this can work at all without introducing subtle issues all over the place. Thanks, tglx