From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.3 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_PASS,USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5EB4FC43142 for ; Thu, 28 Jun 2018 13:08:28 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 1ED7B273C7 for ; Thu, 28 Jun 2018 13:08:28 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1ED7B273C7 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=linuxfoundation.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S965871AbeF1NI0 (ORCPT ); Thu, 28 Jun 2018 09:08:26 -0400 Received: from mail.linuxfoundation.org ([140.211.169.12]:57966 "EHLO mail.linuxfoundation.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S965825AbeF1NIW (ORCPT ); Thu, 28 Jun 2018 09:08:22 -0400 Received: from localhost (unknown [104.153.224.166]) by mail.linuxfoundation.org (Postfix) with ESMTPSA id EC7EF4A3; Thu, 28 Jun 2018 13:08:05 +0000 (UTC) Date: Thu, 28 Jun 2018 21:38:03 +0900 From: Greg Kroah-Hartman To: Nicolas Pitre Cc: Dave Mielke , Samuel Thibault , Adam Borowski , Alan Cox , linux-kernel@vger.kernel.org, linux-console@vger.kernel.org Subject: Re: [PATCH v3 0/3] have the vt console preserve unicode characters Message-ID: <20180628123803.GA22045@kroah.com> References: <20180627035642.8561-1-nicolas.pitre@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180627035642.8561-1-nicolas.pitre@linaro.org> User-Agent: Mutt/1.10.0 (2018-05-17) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Jun 26, 2018 at 11:56:39PM -0400, Nicolas Pitre wrote: > The vt code translates UTF-8 strings into glyph index values and stores > those glyph values in the screen buffer. Because there can only be at > most 512 glyphs at the moment, it is impossible to represent most > unicode characters, in which case a default glyph (often '?') is > displayed instead. The original unicode value is then lost. > > The 512-glyph limitation is inherent to text-mode VGA displays after > which the core console code was modelled. This also means that the > /dev/vcs* devices only provide user space with glyph index values, and > then user applications must get hold of the unicode-to-glyph table the > kernel is using in order to back-translate those into actual characters. > It is not possible to get back the original unicode value when multiple > unicode characters map to the same glyph, especially for the vast > majority that maps to the default replacement glyph. > > Users of /dev/vcs* shouldn't have to be restricted to a narrow unicode > space from lossy screen content because of that. This is especially true > for accessibility applications such as BRLTTY that rely on /dev/vcs to > render screen content onto braille terminals. > > It was also argued that the VGA-centric glyph buffer should eventually > go entirely. The current design made sense when hardware was slow and > managing the screen directly into the VGA memory made a difference (i.e. > 25 years ago). Modern console display drivers no longer have to be > limited to 512 glyphs. > Quoting Alan Cox: > > |The only driver that it suits is the VGA text mode driver, which at > |2GHz+ is going to be fast enough whatever format you convert from. We > |have the memory, the processor power and the fact almost all our > |displays are bitmapped (or more complex still) all in favour of > |throwing away that limit. > > This patch series introduces unicode screen support to the core console > code with /dev/vcs* as a first user. Memory is allocated, and possible > CPU overhead introduced, only if /dev/vcsu is read at least once. For > now both the glyph and unicode buffers are maintained in parallel to > allow for a smooth transition. > > I'm a prime user of this new /dev/vcsu interface, as well as the BRLTTY > maintainer Dave Mielke who implemented support for this in BRLTTY. There > is therefore a vested interest in maintaining this feature as necessary. > And this received extensive testing as well at this point. > > This is also available on top of v4.18-rc2 here: > > git://git.linaro.org/people/nicolas.pitre/linux vt-unicode > > Changes from v2: > > - Dropped patch #4 as it was useful only for initial debugging and it > attracted all the review comments so far -- actually more than the > patch is worth. If you want this "feature" back, I'll be glad to take it, as odds are it will help when any future person wants to test any changes in the code. So feel free to resend it, I have no objection to it as-is. And I've queued the other 3 up now, nice job. greg k-h