All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Bird, Tim" <Tim.Bird@sony.com>
To: qiutt <qiutt@cn.fujitsu.com>,
	"fuego@lists.linuxfoundation.org"
	<fuego@lists.linuxfoundation.org>
Subject: Re: [Fuego] [PATCH 01/12] add network testcase to spec
Date: Wed, 8 Jul 2020 21:00:46 +0000	[thread overview]
Message-ID: <CY4PR13MB117523490C628E46B626A9C7FD670@CY4PR13MB1175.namprd13.prod.outlook.com> (raw)
In-Reply-To: <1594203985-58247-1-git-send-email-qiutt@cn.fujitsu.com>



> -----Original Message-----
> From: Fuego <fuego-bounces@lists.linuxfoundation.org> On Behalf Of qiutt
> 
> include
>  net.features net.ipv6 net.ipv6_lib net.multicast
>  net.nfs net.rpc net.rpc_tests net.sctp
>  net_stress.appl net_stress.broken_ip net_stress.interface
>  net_stress.ipsec_dccp net_stress.ipsec_icmp net_stress.ipsec_sctp
>  net_stress.ipsec_tcp net_stress.ipsec_udp net_stress.multicast
>  net_stress.route net.tcp_cmds net.tirpc_tests network_commands smack
> 
> Signed-off-by: qiutt <qiutt@cn.fujitsu.com>
> ---
>  tests/Functional.LTP/spec.json | 111 +++++++++++++++++++++++++++++++++++++++++
>  1 file changed, 111 insertions(+)
> 
> diff --git a/tests/Functional.LTP/spec.json b/tests/Functional.LTP/spec.json
> index d23edc1..8da77b0 100644
> --- a/tests/Functional.LTP/spec.json
> +++ b/tests/Functional.LTP/spec.json
> @@ -73,6 +73,117 @@
>              "tests": "cve",
>              "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
>              "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.ipv6": {
> +            "tests": "net.ipv6",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.rpc_tests": {
> +            "tests": "net.rpc_tests",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.features": {
> +            "tests": "net.features",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.ipv6_lib": {
> +            "tests": "net.ipv6_lib",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "BOARD_NAME": "m3ulcb"
> +        },
> +        "net.multicast": {
> +            "tests": "net.multicast",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.nfs": {
> +            "tests": "net.nfs",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.rpc": {
> +            "tests": "net.rpc",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.sctp": {
> +            "tests": "net.sctp",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.appl": {
> +            "tests": "net_stress.appl",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.broken_ip": {
> +            "tests": "net_stress.broken_ip",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.interface": {
> +            "tests": "net_stress.interface",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.ipsec_dccp": {
> +            "tests": "net_stress.ipsec_dccp",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.ipsec_icmp": {
> +            "tests": "net_stress.ipsec_icmp",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.ipsec_sctp": {
> +            "tests": "net_stress.ipsec_sctp",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.ipsec_tcp": {
> +            "tests": "net_stress.ipsec_tcp",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.ipsec_udp": {
> +            "tests": "net_stress.ipsec_udp",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.multicast": {
> +            "tests": "net_stress.multicast",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net_stress.route": {
> +            "tests": "net_stress.route",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },

Is there a reason all these individual stress tests are broken out into their
own specs?

> +        "net.tcp_cmds": {
> +            "tests": "net.tcp_cmds ",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "net.tirpc_tests": {
> +            "tests": "net.tirpc_tests",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "network_commands": {
> +            "tests": "network_commands",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
> +        },
> +        "smack": {
> +            "tests": "smack",
> +            "extra_success_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"},
> +            "extra_fail_links": {"xlsx": "results.xlsx", "skiplist": "skiplist.txt"}
>          }
>      }
>  }
> --
> 2.11.0

This seems like a lot of new specs.  Do you actually run the networking
tests separately, or are they usually run together?

Thanks,
 -- Tim



  parent reply	other threads:[~2020-07-08 21:00 UTC|newest]

Thread overview: 35+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-07-08 10:26 [Fuego] [PATCH 01/12] add network testcase to spec qiutt
2020-07-08 10:26 ` [Fuego] [PATCH 02/12] skip cases missing ftp cmd qiutt
2020-07-08 21:51   ` Bird, Tim
2020-07-08 10:26 ` [Fuego] [PATCH 03/12] skip cases missing rsh cmd qiutt
2020-07-08 21:57   ` Bird, Tim
2020-07-08 10:26 ` [Fuego] [PATCH 04/12] skip cases missing host cmd qiutt
2020-07-08 10:26 ` [Fuego] [PATCH 05/12] skip cases missing rcp cmd qiutt
2020-07-08 21:59   ` Bird, Tim
2020-07-08 10:26 ` [Fuego] [PATCH 06/12] skip some cases because ONFIG_XFRM_USER is not set qiutt
2020-07-08 22:13   ` Bird, Tim
2020-07-30  5:49     ` Qiu, Tingting
2020-07-30  7:06       ` Qiu, Tingting
2020-08-07  0:02         ` Bird, Tim
2020-09-14  9:24           ` Qiu, Tingting
2020-09-17 20:02             ` Bird, Tim
2020-09-21  2:30               ` Qiu, Tingting
2020-08-05 20:13       ` Bird, Tim
2020-08-06 22:44       ` Bird, Tim
2020-07-08 10:26 ` [Fuego] [PATCH 07/12] skip cases because 'netstat -s' not support qiutt
2020-07-08 22:19   ` Bird, Tim
2020-07-30  6:56     ` Qiu, Tingting
2020-08-06 23:28       ` Bird, Tim
2020-08-07  1:41         ` Qiu, Tingting
2020-10-01  0:07           ` daniel.sangorrin
2020-10-01 22:35             ` Bird, Tim
2020-10-09  1:47               ` Qiu, Tingting
2020-07-08 10:26 ` [Fuego] [PATCH 08/12] skip cases because MULTIPORT and LIMIT not set qiutt
2020-07-08 10:26 ` [Fuego] [PATCH 09/12] skip cases because label rule does not support qiutt
2020-07-08 22:22   ` Bird, Tim
2020-07-30  7:08     ` Qiu, Tingting
2020-07-08 10:26 ` [Fuego] [PATCH 10/12] add smackfsdir for smack cases qiutt
2020-07-08 10:26 ` [Fuego] [PATCH 11/12] skip cases when LHOST_IFACES not defined qiutt
2020-07-08 10:26 ` [Fuego] [PATCH 12/12] add hostname and ip to /etc/hosts qiutt
2020-07-08 21:00 ` Bird, Tim [this message]
2020-07-14  5:16   ` [Fuego] [PATCH 01/12] add network testcase to spec Qiu, Tingting

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CY4PR13MB117523490C628E46B626A9C7FD670@CY4PR13MB1175.namprd13.prod.outlook.com \
    --to=tim.bird@sony.com \
    --cc=fuego@lists.linuxfoundation.org \
    --cc=qiutt@cn.fujitsu.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.