[SPDK] DPDK Submodules Git Clone Problem

[SPDK] DPDK Submodules Git Clone Problem

[Gruher, Joseph R]

[-- Attachment #1: Type: text/plain, Size: 1824 bytes --]

Hi folks-

Trying to set up SPDK for my first time.  I don't seem able to clone the DPDK submodule.  Any ideas?  Am I doing something wrong?

I cloned the SPDK git without issue:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/spdk.git
Cloning into 'spdk'...
remote: Counting objects: 47636, done.
remote: Compressing objects: 100% (142/142), done.
remote: Total 47636 (delta 141), reused 89 (delta 76), pack-reused 47418
Receiving objects: 100% (47636/47636), 15.67 MiB | 34.00 MiB/s, done.
Resolving deltas: 100% (36457/36457), done.

Then I went into the directory and checked out the 18.04 release branch:

rsa(a)tppjoe08:~$ cd spdk/
rsa(a)tppjoe08:~/spdk$ git checkout v18.04
Note: checking out 'v18.04'.
HEAD is now at 9eb54cae SPDK 18.04

Then the init submodules step is failing.  I'd think maybe a network problem, but my initial SPDK git clone worked just fine, so I think my network is OK.  Maybe someone else could try this quickly and see if it is a problem at the github end?

rsa(a)tppjoe08:~/spdk$ git submodule update --init
Submodule 'dpdk' (https://github.com/spdk/dpdk.git) registered for path 'dpdk'
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk'. Retry scheduled
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk' a second time, aborting

Trying to just directly clone the DPDK submodule git also fails:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/dpdk.git
Cloning into 'dpdk'...
fatal: The remote end hung up unexpectedly

Thanks,
Joe

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 7123 bytes --]

Re: [SPDK] DPDK Submodules Git Clone Problem

[Gruher, Joseph R]

[-- Attachment #1: Type: text/plain, Size: 4471 bytes --]

I'm now pretty sure this is some kind of issue local to the system.  I've found I can't clone various other gits as well.  Why the SPDK one works while the others fail remains a mystery.  I think it is all somehow related to Ubuntu 18.04 as I don't see the problem with 16.04/14.04 on the same hardware and network infrastructure and same proxy settings.

I was able to work around the problem (with help from James Harris) by downloading the DPDK as a zip and extracting and now have built successfully.  Anyway, sorry to trouble the list with what turned out to be a non-SPDK issue. :)

-Joe

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Luse, Paul E
Sent: Wednesday, May 9, 2018 4:58 PM
To: Storage Performance Development Kit <spdk(a)lists.01.org>
Subject: Re: [SPDK] DPDK Submodules Git Clone Problem

Mm, I'm not sure.  Below are your exact steps on my system and they worked fine. I just tried right this minute though which is a few hours from when you did.  Maybe try again?  Are you behind a firewall? Although I see no reason at all why that would make a difference if you have a system at home you can try it only takes a few seconds... (I'm not behind a firewall)

Thx
Paul

[peluse(a)pels3-64 ~]$ git clone https://github.com/spdk/spdk.git spdk2
Cloning into 'spdk2'...
remote: Counting objects: 47668, done.
remote: Compressing objects: 100% (145/145), done.
remote: Total 47668 (delta 141), reused 82 (delta 76), pack-reused 47447
Receiving objects: 100% (47668/47668), 15.69 MiB | 24.30 MiB/s, done.
Resolving deltas: 100% (36478/36478), done.
[peluse(a)pels3-64 ~]$ cd spdk2
[peluse(a)pels3-64 spdk2]$ git checkout v18.04
Note: checking out 'v18.04'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at 9eb54cae... SPDK 18.04
[peluse(a)pels3-64 spdk2]$ git submodule update --init
Submodule 'dpdk' (https://github.com/spdk/dpdk.git) registered for path 'dpdk'
Cloning into '/home/peluse/spdk2/dpdk'...
Submodule path 'dpdk': checked out 'cfaddaa2fe1e7fa126b913ff6be68bb7dfa76ed6'

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Gruher, Joseph R
Sent: Wednesday, May 9, 2018 1:04 PM
To: spdk(a)lists.01.org<mailto:spdk(a)lists.01.org>
Subject: [SPDK] DPDK Submodules Git Clone Problem

Hi folks-

Trying to set up SPDK for my first time.  I don't seem able to clone the DPDK submodule.  Any ideas?  Am I doing something wrong?

I cloned the SPDK git without issue:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/spdk.git
Cloning into 'spdk'...
remote: Counting objects: 47636, done.
remote: Compressing objects: 100% (142/142), done.
remote: Total 47636 (delta 141), reused 89 (delta 76), pack-reused 47418
Receiving objects: 100% (47636/47636), 15.67 MiB | 34.00 MiB/s, done.
Resolving deltas: 100% (36457/36457), done.

Then I went into the directory and checked out the 18.04 release branch:

rsa(a)tppjoe08:~$ cd spdk/
rsa(a)tppjoe08:~/spdk$ git checkout v18.04
Note: checking out 'v18.04'.
HEAD is now at 9eb54cae SPDK 18.04

Then the init submodules step is failing.  I'd think maybe a network problem, but my initial SPDK git clone worked just fine, so I think my network is OK.  Maybe someone else could try this quickly and see if it is a problem at the github end?

rsa(a)tppjoe08:~/spdk$ git submodule update --init
Submodule 'dpdk' (https://github.com/spdk/dpdk.git) registered for path 'dpdk'
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk'. Retry scheduled
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk' a second time, aborting

Trying to just directly clone the DPDK submodule git also fails:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/dpdk.git
Cloning into 'dpdk'...
fatal: The remote end hung up unexpectedly

Thanks,
Joe

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 13255 bytes --]

Re: [SPDK] DPDK Submodules Git Clone Problem

[Luse, Paul E]

[-- Attachment #1: Type: text/plain, Size: 3609 bytes --]

Mm, I'm not sure.  Below are your exact steps on my system and they worked fine. I just tried right this minute though which is a few hours from when you did.  Maybe try again?  Are you behind a firewall? Although I see no reason at all why that would make a difference if you have a system at home you can try it only takes a few seconds... (I'm not behind a firewall)

Thx
Paul

[peluse(a)pels3-64 ~]$ git clone https://github.com/spdk/spdk.git spdk2
Cloning into 'spdk2'...
remote: Counting objects: 47668, done.
remote: Compressing objects: 100% (145/145), done.
remote: Total 47668 (delta 141), reused 82 (delta 76), pack-reused 47447
Receiving objects: 100% (47668/47668), 15.69 MiB | 24.30 MiB/s, done.
Resolving deltas: 100% (36478/36478), done.
[peluse(a)pels3-64 ~]$ cd spdk2
[peluse(a)pels3-64 spdk2]$ git checkout v18.04
Note: checking out 'v18.04'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at 9eb54cae... SPDK 18.04
[peluse(a)pels3-64 spdk2]$ git submodule update --init
Submodule 'dpdk' (https://github.com/spdk/dpdk.git) registered for path 'dpdk'
Cloning into '/home/peluse/spdk2/dpdk'...
Submodule path 'dpdk': checked out 'cfaddaa2fe1e7fa126b913ff6be68bb7dfa76ed6'

From: SPDK [mailto:spdk-bounces(a)lists.01.org] On Behalf Of Gruher, Joseph R
Sent: Wednesday, May 9, 2018 1:04 PM
To: spdk(a)lists.01.org
Subject: [SPDK] DPDK Submodules Git Clone Problem

Hi folks-

Trying to set up SPDK for my first time.  I don't seem able to clone the DPDK submodule.  Any ideas?  Am I doing something wrong?

I cloned the SPDK git without issue:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/spdk.git
Cloning into 'spdk'...
remote: Counting objects: 47636, done.
remote: Compressing objects: 100% (142/142), done.
remote: Total 47636 (delta 141), reused 89 (delta 76), pack-reused 47418
Receiving objects: 100% (47636/47636), 15.67 MiB | 34.00 MiB/s, done.
Resolving deltas: 100% (36457/36457), done.

Then I went into the directory and checked out the 18.04 release branch:

rsa(a)tppjoe08:~$ cd spdk/
rsa(a)tppjoe08:~/spdk$ git checkout v18.04
Note: checking out 'v18.04'.
HEAD is now at 9eb54cae SPDK 18.04

Then the init submodules step is failing.  I'd think maybe a network problem, but my initial SPDK git clone worked just fine, so I think my network is OK.  Maybe someone else could try this quickly and see if it is a problem at the github end?

rsa(a)tppjoe08:~/spdk$ git submodule update --init
Submodule 'dpdk' (https://github.com/spdk/dpdk.git) registered for path 'dpdk'
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk'. Retry scheduled
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk' a second time, aborting

Trying to just directly clone the DPDK submodule git also fails:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/dpdk.git
Cloning into 'dpdk'...
fatal: The remote end hung up unexpectedly

Thanks,
Joe

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 11339 bytes --]

Re: [SPDK] DPDK Submodules Git Clone Problem

[Harris, James R]

[-- Attachment #1: Type: text/plain, Size: 2304 bytes --]

Hi Joe,

I just tried this on my dev system and didn’t see any problems.  Both the submodule and an explicit DPDK clone worked with no issues.

-Jim


From: SPDK <spdk-bounces(a)lists.01.org> on behalf of "Gruher, Joseph R" <joseph.r.gruher(a)intel.com>
Reply-To: Storage Performance Development Kit <spdk(a)lists.01.org>
Date: Wednesday, May 9, 2018 at 1:04 PM
To: "spdk(a)lists.01.org" <spdk(a)lists.01.org>
Subject: [SPDK] DPDK Submodules Git Clone Problem

Hi folks-

Trying to set up SPDK for my first time.  I don’t seem able to clone the DPDK submodule.  Any ideas?  Am I doing something wrong?

I cloned the SPDK git without issue:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/spdk.git
Cloning into 'spdk'...
remote: Counting objects: 47636, done.
remote: Compressing objects: 100% (142/142), done.
remote: Total 47636 (delta 141), reused 89 (delta 76), pack-reused 47418
Receiving objects: 100% (47636/47636), 15.67 MiB | 34.00 MiB/s, done.
Resolving deltas: 100% (36457/36457), done.

Then I went into the directory and checked out the 18.04 release branch:

rsa(a)tppjoe08:~$ cd spdk/
rsa(a)tppjoe08:~/spdk$ git checkout v18.04
Note: checking out 'v18.04'.
HEAD is now at 9eb54cae SPDK 18.04

Then the init submodules step is failing.  I’d think maybe a network problem, but my initial SPDK git clone worked just fine, so I think my network is OK.  Maybe someone else could try this quickly and see if it is a problem at the github end?

rsa(a)tppjoe08:~/spdk$ git submodule update --init
Submodule 'dpdk' (https://github.com/spdk/dpdk.git) registered for path 'dpdk'
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk'. Retry scheduled
Cloning into '/home/rsa/spdk/dpdk'...
fatal: The remote end hung up unexpectedly
fatal: clone of 'https://github.com/spdk/dpdk.git' into submodule path '/home/rsa/spdk/dpdk' failed
Failed to clone 'dpdk' a second time, aborting

Trying to just directly clone the DPDK submodule git also fails:

rsa(a)tppjoe08:~$ git clone https://github.com/spdk/dpdk.git
Cloning into 'dpdk'...
fatal: The remote end hung up unexpectedly

Thanks,
Joe

[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 9413 bytes --]