From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 29800C32750 for ; Tue, 13 Aug 2019 13:50:08 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id F065020679 for ; Tue, 13 Aug 2019 13:50:07 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org F065020679 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:52544 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hxXBf-000729-77 for qemu-devel@archiver.kernel.org; Tue, 13 Aug 2019 09:50:07 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34441) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hxXBB-0006Hn-89 for qemu-devel@nongnu.org; Tue, 13 Aug 2019 09:49:38 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hxXBA-0005rT-1N for qemu-devel@nongnu.org; Tue, 13 Aug 2019 09:49:37 -0400 Received: from mx1.redhat.com ([209.132.183.28]:38674) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1hxXB9-0005r3-SY for qemu-devel@nongnu.org; Tue, 13 Aug 2019 09:49:35 -0400 Received: from smtp.corp.redhat.com (int-mx07.intmail.prod.int.phx2.redhat.com [10.5.11.22]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id D925DC059B7A; Tue, 13 Aug 2019 13:49:34 +0000 (UTC) Received: from x1w.redhat.com (unknown [10.40.205.129]) by smtp.corp.redhat.com (Postfix) with ESMTPS id C54F81000321; Tue, 13 Aug 2019 13:49:24 +0000 (UTC) From: =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= To: qemu-devel@nongnu.org Date: Tue, 13 Aug 2019 15:49:18 +0200 Message-Id: <20190813134921.30602-1-philmd@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 X-Scanned-By: MIMEDefang 2.84 on 10.5.11.22 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.32]); Tue, 13 Aug 2019 13:49:34 +0000 (UTC) Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH v3 0/3] tests/acceptance: Add test of NeXTcube framebuffer using OCR X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Fam Zheng , Thomas Huth , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , Wainer dos Santos Moschetta , Gerd Hoffmann , Cleber Rosa , =?UTF-8?q?Alex=20Benn=C3=A9e?= Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Hi, I was looking at Thomas' last series [*] where he adds the NeXTcube machine, thinking about enforcing a new rule "new machines must have tests". Then I realized the UART is not emitting characters, so our current sample tests are not helpful. Since the framebuffer is working, I gave a try at dumping the screen content via the HMP 'screendump' command, then parsing the screenshot with an OCR tool. The default ROM dump the bootlog to a console. Using the old good tesseract tool we can recover some useful words to be sure the guest is sane, its framebuffer is definitively working. This test takes less than 6s on Travis-CI: https://travis-ci.org/philmd/qemu/builds/552174983#L1836 AVOCADO tests/acceptance (3/9) /home/travis/build/philmd/qemu/tests/acceptance/machine_m68k_nextc= ube.py:NextCubeMachine.test_bootrom_framebuffer: PASS (5.69 s) Since v2: https://lists.gnu.org/archive/html/qemu-devel/2019-07/msg00249.= html - addressed Thomas and Cleber review comments (detailed in each patch) - add RFC to interract sending VNC keys Since v1: https://lists.gnu.org/archive/html/qemu-devel/2019-06/msg06514.= html - use the English dictionary (Thomas) - support tesseract v3 and v4 (much better results with v4, but not all distros provide it) - add a test of the framebuffer width/height Regards, Phil. Based-on: 20190709073222.26370-1-huth@tuxfamily.org [*] "m68k: Add basic support for the NeXTcube machine" https://lists.gnu.org/archive/html/qemu-devel/2019-07/msg02152.html Philippe Mathieu-Daud=C3=A9 (3): tests/acceptance: Add test of NeXTcube framebuffer using OCR tests/acceptance: Run commands sending VNC keys .travis.yml: Let the avocado job run the NeXTcube tests .travis.yml | 7 +- tests/acceptance/machine_m68k_nextcube.py | 170 ++++++++++++++++++++++ tests/requirements.txt | 1 + 3 files changed, 177 insertions(+), 1 deletion(-) create mode 100644 tests/acceptance/machine_m68k_nextcube.py --=20 2.20.1