All of lore.kernel.org
 help / color / mirror / Atom feed
* ib_srpt and mellanox mthca device
@ 2012-04-10 14:52 Alexey Shvetsov
       [not found] ` <5f95768153388b91a2ffa0cd118d7ad8-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-10 14:52 UTC (permalink / raw)
  To: linux-rdma-u79uwXL29TY76Z2rM5mHXA

Hi all!

I'm  trying to use ib_srpt from mainline kernel (3.3.x and 3.4-rcX)
But right after loading ib_srpt i always get error in dmesg


srpt_add_one(mthca0) failed.

so ib_srpt cannot be used as target

-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found] ` <5f95768153388b91a2ffa0cd118d7ad8-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
@ 2012-04-10 23:09   ` Roland Dreier
       [not found]     ` <CAL1RGDWNqMdQGrXbh2gj==_KvVRF1mUQw2D3NqEhjvuq2q2+6Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Roland Dreier @ 2012-04-10 23:09 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

On Tue, Apr 10, 2012 at 7:52 AM, Alexey Shvetsov <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> wrote:
> I'm  trying to use ib_srpt from mainline kernel (3.3.x and 3.4-rcX)
> But right after loading ib_srpt i always get error in dmesg
>
> srpt_add_one(mthca0) failed.

I would suggest the following: make sure ib_mthca is NOT loaded, and load
the srpt module.  Then enable ftrace -- config options

    CONFIG_FUNCTION_TRACER
    CONFIG_DYNAMIC_FTRACE
    CONFIG_FUNCTION_GRAPH_TRACER

and use the function graph tracer to see what srpt_add_one() calls:

# cd /sys/kernel/debug/trace
# echo srpt_add_one > set_graph_function
# echo function_graph > current_tracer
# modprobe ib_mthca
# cat trace

and send the output of that "cat trace" command to the list.  Then we can
see what step of initialization fails and debug from there.

(cf the section "the function_graph tracer" in https://lwn.net/Articles/370423/)

Thanks!
 - R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]     ` <CAL1RGDWNqMdQGrXbh2gj==_KvVRF1mUQw2D3NqEhjvuq2q2+6Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-11  9:21       ` Alexey Shvetsov
       [not found]         ` <97cccba5ba7ddc74e87b0791050fa755-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-11  9:21 UTC (permalink / raw)
  To: Roland Dreier; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

[-- Attachment #1: Type: text/plain, Size: 1445 bytes --]

Hi Roland!

I made tracing for srpt_add_one function. Trace log attached to mail

Roland Dreier писал 2012-04-11 02:09:
> On Tue, Apr 10, 2012 at 7:52 AM, Alexey Shvetsov <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> 
> wrote:
>> I'm  trying to use ib_srpt from mainline kernel (3.3.x and 3.4-rcX)
>> But right after loading ib_srpt i always get error in dmesg
>>
>> srpt_add_one(mthca0) failed.
>
> I would suggest the following: make sure ib_mthca is NOT loaded, and 
> load
> the srpt module.  Then enable ftrace -- config options
>
>     CONFIG_FUNCTION_TRACER
>     CONFIG_DYNAMIC_FTRACE
>     CONFIG_FUNCTION_GRAPH_TRACER
>
> and use the function graph tracer to see what srpt_add_one() calls:
>
> # cd /sys/kernel/debug/trace
> # echo srpt_add_one > set_graph_function
> # echo function_graph > current_tracer
> # modprobe ib_mthca
> # cat trace
>
> and send the output of that "cat trace" command to the list.  Then we 
> can
> see what step of initialization fails and debug from there.
>
> (cf the section "the function_graph tracer" in
> https://lwn.net/Articles/370423/)
>
> Thanks!
>  - R.

-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org

[-- Attachment #2: trace --]
[-- Type: text/plain, Size: 24381 bytes --]

# tracer: function_graph
#
# CPU  DURATION                  FUNCTION CALLS
# |     |   |                     |   |   |   |
 0)               |  srpt_add_one() {
 0)   3.219 us    |    kmem_cache_alloc_trace();
 0)   0.135 us    |    __init_waitqueue_head();
 0)               |    ib_query_device() {
 0)   0.214 us    |      kmem_cache_alloc_trace();
 0)   0.176 us    |      kmem_cache_alloc_trace();
 0)   0.175 us    |      kmem_cache_alloc_trace();
 0)               |      dma_pool_alloc() {
 0)   0.256 us    |        _raw_spin_lock_irqsave();
 0)   0.158 us    |        _raw_spin_unlock_irqrestore();
 0)   2.247 us    |      }
 0)   0.167 us    |      kmem_cache_alloc_trace();
 0)               |      dma_pool_alloc() {
 0)   0.180 us    |        _raw_spin_lock_irqsave();
 0)   0.157 us    |        _raw_spin_unlock_irqrestore();
 0)   2.358 us    |      }
 0)               |      down() {
 0)   0.176 us    |        _raw_spin_lock_irqsave();
 0)   0.151 us    |        _raw_spin_unlock_irqrestore();
 0)   2.080 us    |      }
 0)   0.150 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.373 us    |        __mutex_lock_slowpath();
 0)   1.295 us    |      }
 0)               |      mutex_unlock() {
 0)   0.191 us    |        __mutex_unlock_slowpath();
 0)   1.117 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.244 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.140 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)   0.260 us    |              _raw_spin_lock_irqsave();
 0)   1.159 us    |            }
 0)   0.136 us    |            idle_cpu();
 0)   0.145 us    |            internal_add_timer();
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.322 us    |                rcu_note_context_switch();
 0)   0.164 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.534 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.198 us    |                          cpuacct_charge();
 0)   1.407 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.137 us    |                        update_cfs_load();
 0)   0.191 us    |                        update_cfs_shares();
 0)   5.495 us    |                      }
 0)   0.136 us    |                      hrtick_update();
 0)   7.381 us    |                    }
 0)   9.681 us    |                  }
 0) + 11.686 us   |                }
 0)   0.146 us    |                idle_balance();
 0)   0.144 us    |                put_prev_task_fair();
 0)   0.157 us    |                pick_next_task_fair();
 0)   0.196 us    |                pick_next_task_stop();
 0)   0.222 us    |                pick_next_task_rt();
 0)   0.158 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.141 us    |                  calc_load_account_idle();
 0)   1.112 us    |                }
 0)   0.254 us    |                finish_task_switch();
 0) + 95.055 us   |              }
 0) + 96.075 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.160 us    |                  _raw_spin_lock_irqsave();
 0)   1.169 us    |                }
 0)   0.150 us    |                _raw_spin_unlock_irqrestore();
 0)   3.040 us    |              }
 0)   3.964 us    |            }
 0) ! 107.618 us  |          }
 0)   0.153 us    |          _raw_spin_lock_irq();
 0) ! 110.742 us  |        }
 0) ! 111.653 us  |      }
 0)   0.170 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   1.986 us    |      }
 0)               |      dma_pool_free() {
 0)   0.162 us    |        _raw_spin_lock_irqsave();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   1.968 us    |      }
 0)               |      kfree() {
 0)   0.149 us    |        __phys_addr();
 0)   1.209 us    |      }
 0)               |      dma_pool_free() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   2.016 us    |      }
 0)               |      kfree() {
 0)   0.137 us    |        __phys_addr();
 0)   1.115 us    |      }
 0)               |      kfree() {
 0)   0.141 us    |        __phys_addr();
 0)   1.104 us    |      }
 0)               |      kfree() {
 0)   0.136 us    |        __phys_addr();
 0)   1.063 us    |      }
 0) ! 151.080 us  |    }
 0)               |    ib_alloc_pd() {
 0)   0.223 us    |      kmem_cache_alloc_trace();
 0)   0.180 us    |      _raw_spin_lock_irqsave();
 0)   0.144 us    |      _raw_spin_unlock_irqrestore();
 0)   0.159 us    |      _raw_spin_lock_irqsave();
 0)   0.148 us    |      _raw_spin_unlock_irqrestore();
 0)   0.162 us    |      kmem_cache_alloc_trace();
 0)               |      dma_pool_alloc() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   1.943 us    |      }
 0)               |      down() {
 0)   0.161 us    |        _raw_spin_lock_irqsave();
 0)   0.147 us    |        _raw_spin_unlock_irqrestore();
 0)   1.958 us    |      }
 0)   0.149 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.373 us    |        __mutex_lock_slowpath();
 0)   1.354 us    |      }
 0)               |      mutex_unlock() {
 0)   0.205 us    |        __mutex_unlock_slowpath();
 0)   1.100 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.158 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.140 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)   0.160 us    |              _raw_spin_lock_irqsave();
 0)   1.065 us    |            }
 0)   0.140 us    |            idle_cpu();
 0)   0.182 us    |            internal_add_timer();
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.321 us    |                rcu_note_context_switch();
 0)   0.160 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.406 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.175 us    |                          cpuacct_charge();
 0)   1.336 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.175 us    |                        update_cfs_shares();
 0)   5.072 us    |                      }
 0)   0.134 us    |                      hrtick_update();
 0)   7.063 us    |                    }
 0)   9.485 us    |                  }
 0) + 10.460 us   |                }
 0)   0.141 us    |                idle_balance();
 0)   0.140 us    |                put_prev_task_fair();
 0)   0.154 us    |                pick_next_task_fair();
 0)   0.137 us    |                pick_next_task_stop();
 0)   0.199 us    |                pick_next_task_rt();
 0)   0.153 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.151 us    |                  calc_load_account_idle();
 0)   1.751 us    |                }
 0)   0.248 us    |                finish_task_switch();
 0) + 31.935 us   |              }
 0) + 32.899 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.159 us    |                  _raw_spin_lock_irqsave();
 0)   1.083 us    |                }
 0)   0.143 us    |                _raw_spin_unlock_irqrestore();
 0)   2.910 us    |              }
 0)   3.836 us    |            }
 0) + 43.888 us   |          }
 0)   0.266 us    |          _raw_spin_lock_irq();
 0) + 46.750 us   |        }
 0) + 47.629 us   |      }
 0)   0.151 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.162 us    |        _raw_spin_lock_irqsave();
 0)   0.147 us    |        _raw_spin_unlock_irqrestore();
 0)   1.944 us    |      }
 0)               |      dma_pool_free() {
 0)   0.171 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.962 us    |      }
 0)               |      kfree() {
 0)   0.137 us    |        __phys_addr();
 0)   1.074 us    |      }
 0) + 76.640 us   |    }
 0)               |    ib_get_dma_mr() {
 0)   0.179 us    |      kmem_cache_alloc_trace();
 0)   0.187 us    |      _raw_spin_lock_irqsave();
 0)   0.145 us    |      _raw_spin_unlock_irqrestore();
 0)   0.160 us    |      kmem_cache_alloc_trace();
 0)               |      dma_pool_alloc() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.947 us    |      }
 0)               |      down() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   1.977 us    |      }
 0)   0.153 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.377 us    |        __mutex_lock_slowpath();
 0)   1.260 us    |      }
 0)               |      mutex_unlock() {
 0)   0.210 us    |        __mutex_unlock_slowpath();
 0)   1.106 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.171 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.140 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)   0.160 us    |              _raw_spin_lock_irqsave();
 0)   1.039 us    |            }
 0)   0.138 us    |            idle_cpu();
 0)   0.148 us    |            internal_add_timer();
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.146 us    |                rcu_note_context_switch();
 0)   0.159 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.471 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.168 us    |                          cpuacct_charge();
 0)   1.305 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.137 us    |                        update_cfs_load();
 0)   0.173 us    |                        update_cfs_shares();
 0)   5.052 us    |                      }
 0)   0.135 us    |                      hrtick_update();
 0)   6.941 us    |                    }
 0)   9.390 us    |                  }
 0) + 10.303 us   |                }
 0)   0.140 us    |                idle_balance();
 0)   0.141 us    |                put_prev_task_fair();
 0)   0.137 us    |                pick_next_task_fair();
 0)   0.136 us    |                pick_next_task_stop();
 0)   0.218 us    |                pick_next_task_rt();
 0)   0.137 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.134 us    |                  calc_load_account_idle();
 0)   1.025 us    |                }
 0)   0.248 us    |                finish_task_switch();
 0) + 29.669 us   |              }
 0) + 30.600 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.158 us    |                  _raw_spin_lock_irqsave();
 0)   1.046 us    |                }
 0)   0.148 us    |                _raw_spin_unlock_irqrestore();
 0)   2.876 us    |              }
 0)   3.772 us    |            }
 0) + 42.243 us   |          }
 0)   0.279 us    |          _raw_spin_lock_irq();
 0) + 45.244 us   |        }
 0) + 50.200 us   |      }
 0)   0.150 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   1.995 us    |      }
 0)               |      dma_pool_free() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.980 us    |      }
 0)               |      kfree() {
 0)   0.137 us    |        __phys_addr();
 0)   1.189 us    |      }
 0) + 76.919 us   |    }
 0)   0.288 us    |    ib_create_srq();
 0)               |    ib_dereg_mr() {
 0)               |      down() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   2.057 us    |      }
 0)   0.150 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.385 us    |        __mutex_lock_slowpath();
 0)   1.275 us    |      }
 0)               |      mutex_unlock() {
 0)   0.191 us    |        __mutex_unlock_slowpath();
 0)   1.067 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.155 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.155 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)   0.166 us    |              _raw_spin_lock_irqsave();
 0)   1.079 us    |            }
 0)   0.147 us    |            idle_cpu();
 0)   0.146 us    |            internal_add_timer();
 0)   0.146 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.142 us    |                rcu_note_context_switch();
 0)   0.173 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.415 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.182 us    |                          cpuacct_charge();
 0)   1.239 us    |                        }
 0)   0.139 us    |                        clear_buddies();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.181 us    |                        update_cfs_shares();
 0)   4.969 us    |                      }
 0)   0.143 us    |                      hrtick_update();
 0)   6.772 us    |                    }
 0)   8.866 us    |                  }
 0)   9.797 us    |                }
 0)   0.151 us    |                idle_balance();
 0)   0.141 us    |                put_prev_task_fair();
 0)   0.137 us    |                pick_next_task_fair();
 0)   0.143 us    |                pick_next_task_stop();
 0)   0.200 us    |                pick_next_task_rt();
 0)   0.138 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.134 us    |                  calc_load_account_idle();
 0)   1.013 us    |                }
 0)   0.248 us    |                finish_task_switch();
 0) + 32.126 us   |              }
 0) + 33.167 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.160 us    |                  _raw_spin_lock_irqsave();
 0)   1.045 us    |                }
 0)   0.144 us    |                _raw_spin_unlock_irqrestore();
 0)   2.946 us    |              }
 0)   3.860 us    |            }
 0) + 44.368 us   |          }
 0)   0.157 us    |          _raw_spin_lock_irq();
 0) + 47.295 us   |        }
 0) + 48.185 us   |      }
 0)   0.151 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   1.954 us    |      }
 0)   0.257 us    |      _raw_spin_lock_irqsave();
 0)   0.149 us    |      _raw_spin_unlock_irqrestore();
 0)               |      kfree() {
 0)   0.136 us    |        __phys_addr();
 0)   1.079 us    |      }
 0) + 68.258 us   |    }
 0)               |    ib_dealloc_pd() {
 0)               |      down() {
 0)   0.162 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   1.966 us    |      }
 0)   0.162 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.372 us    |        __mutex_lock_slowpath();
 0)   1.271 us    |      }
 0)               |      mutex_unlock() {
 0)   0.191 us    |        __mutex_unlock_slowpath();
 0)   1.103 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.153 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.139 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)   0.174 us    |              _raw_spin_lock_irqsave();
 0)   1.141 us    |            }
 0)   0.137 us    |            idle_cpu();
 0)   0.147 us    |            internal_add_timer();
 0)   0.146 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.142 us    |                rcu_note_context_switch();
 0)   0.160 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.464 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.206 us    |                          cpuacct_charge();
 0)   1.917 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.188 us    |                        update_cfs_shares();
 0)   5.753 us    |                      }
 0)   0.135 us    |                      hrtick_update();
 0)   7.640 us    |                    }
 0)   9.792 us    |                  }
 0) + 10.729 us   |                }
 0)   0.140 us    |                idle_balance();
 0)   0.139 us    |                put_prev_task_fair();
 0)   0.138 us    |                pick_next_task_fair();
 0)   0.136 us    |                pick_next_task_stop();
 0)   0.211 us    |                pick_next_task_rt();
 0)   0.155 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.133 us    |                  calc_load_account_idle();
 0)   1.030 us    |                }
 0)   0.254 us    |                finish_task_switch();
 0) + 35.498 us   |              }
 0) + 36.438 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.161 us    |                  _raw_spin_lock_irqsave();
 0)   1.088 us    |                }
 0)   0.143 us    |                _raw_spin_unlock_irqrestore();
 0)   2.890 us    |              }
 0)   3.802 us    |            }
 0) + 47.628 us   |          }
 0)   0.275 us    |          _raw_spin_lock_irq();
 0) + 50.627 us   |        }
 0) + 51.515 us   |      }
 0)   0.149 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.975 us    |      }
 0)   0.161 us    |      _raw_spin_lock_irqsave();
 0)   0.150 us    |      _raw_spin_unlock_irqrestore();
 0)   0.158 us    |      _raw_spin_lock_irqsave();
 0)   0.144 us    |      _raw_spin_unlock_irqrestore();
 0)               |      kfree() {
 0)   0.136 us    |        __phys_addr();
 0)   1.075 us    |      }
 0) + 72.605 us   |    }
 0)               |    kfree() {
 0)   0.137 us    |      __phys_addr();
 0)   1.106 us    |    }
 0)               |    printk() {
 0)               |      vprintk() {
 0)   0.273 us    |        _raw_spin_lock();
 0)   0.346 us    |        log_prefix();
 0)   0.269 us    |        emit_log_char();
 0)   0.173 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.147 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.150 us    |        emit_log_char();
 0)   0.146 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.160 us    |        emit_log_char();
 0)   0.178 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.146 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.150 us    |        emit_log_char();
 0)               |        console_trylock() {
 0)               |          down_trylock() {
 0)   0.228 us    |            _raw_spin_lock_irqsave();
 0)   0.151 us    |            _raw_spin_unlock_irqrestore();
 0)   2.053 us    |          }
 0)   3.154 us    |        }
 0)               |        console_unlock() {
 0)   0.260 us    |          _raw_spin_lock_irqsave();
 0)   0.163 us    |          log_prefix();
 0)   0.173 us    |          _call_console_drivers();
 0)   0.171 us    |          _call_console_drivers();
 0)   0.171 us    |          _raw_spin_lock_irqsave();
 0)               |          up() {
 0)   0.158 us    |            _raw_spin_lock_irqsave();
 0)   0.147 us    |            _raw_spin_unlock_irqrestore();
 0)   2.578 us    |          }
 0)   0.150 us    |          _raw_spin_lock();
 0)   0.154 us    |          _raw_spin_unlock_irqrestore();
 0) + 10.567 us   |        }
 0) + 50.298 us   |      }
 0) + 51.389 us   |    }
 0)               |    ib_set_client_data() {
 0)   0.178 us    |      _raw_spin_lock_irqsave();
 0)   0.155 us    |      _raw_spin_unlock_irqrestore();
 0)   2.163 us    |    }
 0) ! 514.352 us  |  }

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]         ` <97cccba5ba7ddc74e87b0791050fa755-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
@ 2012-04-11 20:06           ` Roland Dreier
       [not found]             ` <CAL1RGDVbqOQP+AH4f9cs+mEngXVTOy7r7gRjJ=SU_rMmvCg3Qg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Roland Dreier @ 2012-04-11 20:06 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

On Wed, Apr 11, 2012 at 2:21 AM, Alexey Shvetsov <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> wrote:
> I made tracing for srpt_add_one function. Trace log attached to mail

It looks like the call to ib_create_srq() is failing.

What specific HCA type do you have?  Do you have up-to-date firmware?
I thought all mthca hardware is SRQ-capable, but you may need new enough
firmware.

What does "ibv_devinfo -v" show with ib_mthca and ib_uverbs loaded?

 - R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]             ` <CAL1RGDVbqOQP+AH4f9cs+mEngXVTOy7r7gRjJ=SU_rMmvCg3Qg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-11 20:13               ` Alexey Shvetsov
       [not found]                 ` <fa3a67e9423946c0bbd23abb3f60921a-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-11 20:13 UTC (permalink / raw)
  To: Roland Dreier; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

Hi Roland!

Actual IB HBA is
store ~ # lspci -v  -s 4b:00.0
4b:00.0 InfiniBand: Mellanox Technologies MT25208 InfiniHost III Ex 
(Tavor compatibility mode) (rev 20)
         Subsystem: Mellanox Technologies MT25208 InfiniHost III Ex 
(Tavor compatibility mode)
         Physical Slot: 2-1
         Flags: bus master, fast devsel, latency 0, IRQ 16
         Memory at fdf00000 (64-bit, non-prefetchable) [size=1M]
         Memory at f7800000 (64-bit, prefetchable) [size=8M]
         Memory at e8000000 (64-bit, prefetchable) [size=128M]
         Capabilities: [40] Power Management version 2
         Capabilities: [48] Vital Product Data
         Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
         Capabilities: [84] MSI-X: Enable+ Count=32 Masked-
         Capabilities: [60] Express Endpoint, MSI 00
         Kernel driver in use: ib_mthca

It have  latest available firmware image

store tmp # ibv_devinfo -v
hca_id: mthca0
         transport:                      InfiniBand (0)
         fw_ver:                         4.8.930
         node_guid:                      001e:0bff:ff4c:0d30
         sys_image_guid:                 001e:0bff:ff4c:0d33
         vendor_id:                      0x1708
         vendor_part_id:                 25208
         hw_ver:                         0x20
         board_id:                       HP_0060000001
         phys_port_cnt:                  2
         max_mr_size:                    0xffffffffffffffff
         page_size_cap:                  0xfffff000
         max_qp:                         64512
         max_qp_wr:                      65535
         device_cap_flags:               0x00001c76
         max_sge:                        59
         max_sge_rd:                     0
         max_cq:                         65408
         max_cqe:                        131071
         max_mr:                         131056
         max_pd:                         32768
         max_qp_rd_atom:                 4
         max_ee_rd_atom:                 0
         max_res_rd_atom:                258048
         max_qp_init_rd_atom:            128
         max_ee_init_rd_atom:            0
         atomic_cap:                     ATOMIC_HCA (1)
         max_ee:                         0
         max_rdd:                        0
         max_mw:                         0
         max_raw_ipv6_qp:                0
         max_raw_ethy_qp:                0
         max_mcast_grp:                  8192
         max_mcast_qp_attach:            56
         max_total_mcast_qp_attach:      458752
         max_ah:                         0
         max_fmr:                        0
         max_srq:                        960
         max_srq_wr:                     65535
         max_srq_sge:                    31
         max_pkeys:                      64
         local_ca_ack_delay:             15
                 port:   1
                         state:                  PORT_INIT (2)
                         max_mtu:                2048 (4)
                         active_mtu:             512 (2)
                         sm_lid:                 0
                         port_lid:               0
                         port_lmc:               0x00
                         link_layer:             IB
                         max_msg_sz:             0x80000000
                         port_cap_flags:         0x02510a68
                         max_vl_num:             8 (4)
                         bad_pkey_cntr:          0x0
                         qkey_viol_cntr:         0x0
                         sm_sl:                  0
                         pkey_tbl_len:           64
                         gid_tbl_len:            32
                         subnet_timeout:         0
                         init_type_reply:        0
                         active_width:           4X (2)
                         active_speed:           5.0 Gbps (2)
                         phys_state:             LINK_UP (5)
                         GID[  0]:               
fe80:0000:0000:0000:001e:0bff:ff4c:0d31

                 port:   2
                         state:                  PORT_DOWN (1)
                         max_mtu:                2048 (4)
                         active_mtu:             512 (2)
                         sm_lid:                 0
                         port_lid:               0
                         port_lmc:               0x00
                         link_layer:             IB
                         max_msg_sz:             0x80000000
                         port_cap_flags:         0x02510a68
                         max_vl_num:             8 (4)
                         bad_pkey_cntr:          0x0
                         qkey_viol_cntr:         0x0
                         sm_sl:                  0
                         pkey_tbl_len:           64
                         gid_tbl_len:            32
                         subnet_timeout:         0
                         init_type_reply:        0
                         active_width:           4X (2)
                         active_speed:           2.5 Gbps (1)
                         phys_state:             POLLING (2)
                         GID[  0]:               
fe80:0000:0000:0000:001e:0bff:ff4c:0d32


Roland Dreier писал 2012-04-11 23:06:
> On Wed, Apr 11, 2012 at 2:21 AM, Alexey Shvetsov <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> 
> wrote:
>> I made tracing for srpt_add_one function. Trace log attached to mail
>
> It looks like the call to ib_create_srq() is failing.
>
> What specific HCA type do you have?  Do you have up-to-date firmware?
> I thought all mthca hardware is SRQ-capable, but you may need new 
> enough
> firmware.
>
> What does "ibv_devinfo -v" show with ib_mthca and ib_uverbs loaded?
>
>  - R.

-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                 ` <fa3a67e9423946c0bbd23abb3f60921a-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
@ 2012-04-11 22:15                   ` Roland Dreier
       [not found]                     ` <CAL1RGDVn1Roo-KaZW_r_WAQudbEZ2+mXD2RqNS68Rg=UBTRe7Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Roland Dreier @ 2012-04-11 22:15 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

Oh, I may see.  Can you try the following?  (maybe whitespace damaged, I'm
pasting into a web form, but should be easy to apply by hand)

 drivers/infiniband/ulp/srpt/ib_srpt.c |    1 +
 1 file changed, 1 insertion(+)

diff --git a/drivers/infiniband/ulp/srpt/ib_srpt.c
b/drivers/infiniband/ulp/srpt/ib_srpt.c
index 69e2ad0..daf21b8 100644
--- a/drivers/infiniband/ulp/srpt/ib_srpt.c
+++ b/drivers/infiniband/ulp/srpt/ib_srpt.c
@@ -3232,6 +3232,7 @@ static void srpt_add_one(struct ib_device *device)
        srq_attr.attr.max_wr = sdev->srq_size;
        srq_attr.attr.max_sge = 1;
        srq_attr.attr.srq_limit = 0;
+       srq_attr.srq_type = IB_SRQT_BASIC;

        sdev->srq = ib_create_srq(sdev->pd, &srq_attr);
        if (IS_ERR(sdev->srq))
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply related	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                     ` <CAL1RGDVn1Roo-KaZW_r_WAQudbEZ2+mXD2RqNS68Rg=UBTRe7Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-11 23:21                       ` Alexey Shvetsov
       [not found]                         ` <806c99edea592c69d0aa9073bae2a3b9-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-11 23:21 UTC (permalink / raw)
  To: Roland Dreier; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

[-- Attachment #1: Type: text/plain, Size: 1447 bytes --]

Hi Roland!

I tryed this patch but it doesnt work i still get
ib_mthca: Initializing 0000:4b:00.0
ib_mthca 0000:4b:00.0: irq 49 for MSI/MSI-X
ib_mthca 0000:4b:00.0: irq 50 for MSI/MSI-X
ib_mthca 0000:4b:00.0: irq 51 for MSI/MSI-X
srpt_add_one(mthca0) failed.

New trace attached

Roland Dreier писал 2012-04-12 01:15:
> Oh, I may see.  Can you try the following?  (maybe whitespace 
> damaged, I'm
> pasting into a web form, but should be easy to apply by hand)
>
>  drivers/infiniband/ulp/srpt/ib_srpt.c |    1 +
>  1 file changed, 1 insertion(+)
>
> diff --git a/drivers/infiniband/ulp/srpt/ib_srpt.c
> b/drivers/infiniband/ulp/srpt/ib_srpt.c
> index 69e2ad0..daf21b8 100644
> --- a/drivers/infiniband/ulp/srpt/ib_srpt.c
> +++ b/drivers/infiniband/ulp/srpt/ib_srpt.c
> @@ -3232,6 +3232,7 @@ static void srpt_add_one(struct ib_device 
> *device)
>         srq_attr.attr.max_wr = sdev->srq_size;
>         srq_attr.attr.max_sge = 1;
>         srq_attr.attr.srq_limit = 0;
> +       srq_attr.srq_type = IB_SRQT_BASIC;
>
>         sdev->srq = ib_create_srq(sdev->pd, &srq_attr);
>         if (IS_ERR(sdev->srq))
-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org

[-- Attachment #2: trace-1 --]
[-- Type: text/plain, Size: 38918 bytes --]

# tracer: function_graph
#
# CPU  DURATION                  FUNCTION CALLS
# |     |   |                     |   |   |   |
 0)               |  () {
 0)   3.219 us    |    kmem_cache_alloc_trace();
 0)   0.135 us    |    __init_waitqueue_head();
 0)               |    ib_query_device() {
 0)   0.135 us    |    } /* __init_waitqueue_head */
 0)               |    ib_query_device() {
 0)   0.214 us    |      kmem_cache_alloc_trace();
 0)   0.176 us    |      kmem_cache_alloc_trace();
 0)   0.175 us    |      kmem_cache_alloc_trace();
 0)   0.176 us    |      } /* kmem_cache_alloc_trace */
 0)   0.175 us    |      kmem_cache_alloc_trace();
 0)   0.175 us    |      } /* kmem_cache_alloc_trace */
 0)               |      dma_pool_alloc() {
 0)   0.256 us    |        _raw_spin_lock_irqsave();
 0)   0.256 us    |        } /* _raw_spin_lock_irqsave */
 0)   0.158 us    |        _raw_spin_unlock_irqrestore();
 0)   0.158 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   2.247 us    |      }
 0)   0.167 us    |      kmem_cache_alloc_trace();
 0)   0.167 us    |      } /* kmem_cache_alloc_trace */
 0)               |      dma_pool_alloc() {
 0)   0.180 us    |        _raw_spin_lock_irqsave();
 0)   0.157 us    |        _raw_spin_unlock_irqrestore();
 0)   2.358 us    |      }
 0)   0.157 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   2.358 us    |      } /* dma_pool_alloc */
 0)               |      down() {
 0)   0.176 us    |        _raw_spin_lock_irqsave();
 0)   0.151 us    |        _raw_spin_unlock_irqrestore();
 0)   0.151 us    |        _raw_spin_unlock_irqrestore();
 0)   2.080 us    |      }
 0)   0.150 us    |      _raw_spin_lock();
 0)   0.150 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.136 us    |      } /* __init_waitqueue_head */
 0)               |      mutex_lock() {
 0)   0.373 us    |        __mutex_lock_slowpath();
 0)   0.373 us    |        } /* __mutex_lock_slowpath */
 0)   1.295 us    |      }
 0)               |      mutex_unlock() {
 0)   0.191 us    |        __mutex_unlock_slowpath();
 0)   1.117 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.244 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.140 us    |            init_timer_key();
 0)   0.140 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)               |            lock_timer_base.clone.24() {
 0)   0.260 us    |              _raw_spin_lock_irqsave();
 0)   0.260 us    |              } /* _raw_spin_lock_irqsave */
 0)   1.159 us    |            }
 0)   0.136 us    |            idle_cpu();
 0)   0.136 us    |            } /* idle_cpu */
 0)   0.145 us    |            internal_add_timer();
 0)   0.145 us    |            } /* internal_add_timer */
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.322 us    |                rcu_note_context_switch();
 0)   0.164 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)   0.164 us    |                } /* _raw_spin_lock_irq */
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.534 us    |                    update_rq_clock();
 0)   0.534 us    |                    } /* update_rq_clock */
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.198 us    |                          cpuacct_charge();
 0)   1.407 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.137 us    |                        clear_buddies();
 0)   0.137 us    |                        update_cfs_load();
 0)   0.137 us    |                        update_cfs_load();
 0)   0.191 us    |                        update_cfs_shares();
 0)   0.191 us    |                        update_cfs_shares();
 0)   5.495 us    |                      }
 0)   5.495 us    |                      } /* dequeue_entity */
 0)   0.136 us    |                      hrtick_update();
 0)   0.136 us    |                      } /* hrtick_update */
 0)   7.381 us    |                    }
 0)   9.681 us    |                  }
 0) + 11.686 us   |                }
 0)   0.146 us    |                idle_balance();
 0)   0.144 us    |                put_prev_task_fair();
 0)   0.144 us    |                put_prev_task_fair();
 0)   0.157 us    |                pick_next_task_fair();
 0)   0.157 us    |                pick_next_task_fair();
 0)   0.196 us    |                pick_next_task_stop();
 0)   0.196 us    |                pick_next_task_stop();
 0)   0.222 us    |                pick_next_task_rt();
 0)   0.222 us    |                pick_next_task_rt();
 0)   0.158 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.158 us    |                } /* pick_next_task_fair */
 0)               |                pick_next_task_idle() {
 0)   0.141 us    |                  calc_load_account_idle();
 0)   1.112 us    |                }
 0)   1.112 us    |                } /* pick_next_task_idle */
 0)   0.254 us    |                finish_task_switch();
 0)   0.254 us    |                } /* finish_task_switch */
 0) + 95.055 us   |              }
 0) + 96.075 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.160 us    |                  _raw_spin_lock_irqsave();
 0)   1.169 us    |                }
 0)   1.169 us    |                } /* lock_timer_base.clone.24 */
 0)   0.150 us    |                _raw_spin_unlock_irqrestore();
 0)   0.150 us    |                } /* _raw_spin_unlock_irqrestore */
 0)   3.040 us    |              }
 0)   3.964 us    |            }
 0) ! 107.618 us  |          }
 0)   0.153 us    |          _raw_spin_lock_irq();
 0) ! 110.742 us  |        }
 0) ! 110.742 us  |        } /* wait_for_common */
 0) ! 111.653 us  |      }
 0)   0.170 us    |      _raw_spin_lock();
 0)   0.170 us    |      } /* _raw_spin_lock */
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.160 us    |        } /* _raw_spin_lock_irqsave */
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   0.146 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   1.986 us    |      }
 0)               |      dma_pool_free() {
 0)   0.162 us    |        _raw_spin_lock_irqsave();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   1.968 us    |      }
 0)               |      kfree() {
 0)   0.149 us    |        __phys_addr();
 0)   0.149 us    |        __phys_addr();
 0)   1.209 us    |      }
 0)               |      dma_pool_free() {
 0)               |      dma_pool_free() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   2.016 us    |      }
 0)   2.016 us    |      } /* dma_pool_free */
 0)               |      kfree() {
 0)   0.137 us    |        __phys_addr();
 0)   1.115 us    |      }
 0)   1.115 us    |      } /* kfree */
 0)               |      kfree() {
 0)   0.141 us    |        __phys_addr();
 0)   0.141 us    |        } /* __phys_addr */
 0)   1.104 us    |      }
 0)               |      kfree() {
 0)   0.136 us    |        __phys_addr();
 0)   0.136 us    |        } /* __phys_addr */
 0)   1.063 us    |      }
 0) ! 151.080 us  |    }
 0)               |    ib_alloc_pd() {
 0)   0.223 us    |      kmem_cache_alloc_trace();
 0)   0.180 us    |      _raw_spin_lock_irqsave();
 0)   0.180 us    |      _raw_spin_lock_irqsave();
 0)   0.144 us    |      _raw_spin_unlock_irqrestore();
 0)   0.159 us    |      _raw_spin_lock_irqsave();
 0)   0.144 us    |      } /* _raw_spin_unlock_irqrestore */
 0)   0.159 us    |      _raw_spin_lock_irqsave();
 0)   0.159 us    |      } /* _raw_spin_lock_irqsave */
 0)   0.148 us    |      _raw_spin_unlock_irqrestore();
 0)   0.148 us    |      } /* _raw_spin_unlock_irqrestore */
 0)   0.162 us    |      kmem_cache_alloc_trace();
 0)   0.162 us    |      } /* kmem_cache_alloc_trace */
 0)               |      dma_pool_alloc() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.160 us    |        } /* _raw_spin_lock_irqsave */
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   0.144 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   1.943 us    |      }
 0)               |      down() {
 0)   0.161 us    |        _raw_spin_lock_irqsave();
 0)   0.147 us    |        _raw_spin_unlock_irqrestore();
 0)   1.958 us    |      }
 0)   0.147 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   1.958 us    |      } /* down */
 0)   0.149 us    |      _raw_spin_lock();
 0)   0.149 us    |      } /* _raw_spin_lock */
 0)   0.136 us    |      __init_waitqueue_head();
 0)   0.136 us    |      } /* __init_waitqueue_head */
 0)               |      mutex_lock() {
 0)   0.373 us    |        __mutex_lock_slowpath();
 0)   0.373 us    |        } /* __mutex_lock_slowpath */
 0)   1.354 us    |      }
 0)               |      mutex_unlock() {
 0)   0.205 us    |        __mutex_unlock_slowpath();
 0)   1.100 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.158 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)   0.140 us    |            init_timer_key();
 0)   0.140 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)               |            lock_timer_base.clone.24() {
 0)   0.160 us    |              _raw_spin_lock_irqsave();
 0)   0.160 us    |              } /* _raw_spin_lock_irqsave */
 0)   1.065 us    |            }
 0)   0.140 us    |            idle_cpu();
 0)   0.140 us    |            } /* idle_cpu */
 0)   0.182 us    |            internal_add_timer();
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)               |            schedule() {
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.321 us    |                rcu_note_context_switch();
 0)   0.321 us    |                } /* rcu_note_context_switch */
 0)   0.160 us    |                _raw_spin_lock_irq();
 0)   0.160 us    |                } /* _raw_spin_lock_irq */
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.406 us    |                    update_rq_clock();
 0)   0.406 us    |                    } /* update_rq_clock */
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.175 us    |                          cpuacct_charge();
 0)   1.336 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.137 us    |                        clear_buddies();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.175 us    |                        update_cfs_shares();
 0)   0.175 us    |                        update_cfs_shares();
 0)   5.072 us    |                      }
 0)   5.072 us    |                      } /* dequeue_entity */
 0)   0.134 us    |                      hrtick_update();
 0)   0.134 us    |                      } /* hrtick_update */
 0)   7.063 us    |                    }
 0)   9.485 us    |                  }
 0) + 10.460 us   |                }
 0)   0.141 us    |                idle_balance();
 0)   0.140 us    |                put_prev_task_fair();
 0)   0.140 us    |                put_prev_task_fair();
 0)   0.154 us    |                pick_next_task_fair();
 0)   0.154 us    |                pick_next_task_fair();
 0)   0.137 us    |                pick_next_task_stop();
 0)   0.137 us    |                pick_next_task_stop();
 0)   0.199 us    |                pick_next_task_rt();
 0)   0.199 us    |                pick_next_task_rt();
 0)   0.153 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)   0.153 us    |                } /* pick_next_task_fair */
 0)               |                pick_next_task_idle() {
 0)   0.151 us    |                  calc_load_account_idle();
 0)   1.751 us    |                }
 0)   1.751 us    |                } /* pick_next_task_idle */
 0)   0.248 us    |                finish_task_switch();
 0)   0.248 us    |                } /* finish_task_switch */
 0) + 31.935 us   |              }
 0) + 32.899 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.159 us    |                  _raw_spin_lock_irqsave();
 0)   1.083 us    |                }
 0)   1.083 us    |                } /* lock_timer_base.clone.24 */
 0)   0.143 us    |                _raw_spin_unlock_irqrestore();
 0)   0.143 us    |                } /* _raw_spin_unlock_irqrestore */
 0)   2.910 us    |              }
 0)   3.836 us    |            }
 0) + 43.888 us   |          }
 0)   0.266 us    |          _raw_spin_lock_irq();
 0)   0.266 us    |          } /* _raw_spin_lock_irq */
 0) + 46.750 us   |        }
 0) + 47.629 us   |      }
 0)   0.151 us    |      _raw_spin_lock();
 0)   0.151 us    |      } /* _raw_spin_lock */
 0)               |      up() {
 0)   0.162 us    |        _raw_spin_lock_irqsave();
 0)   0.162 us    |        } /* _raw_spin_lock_irqsave */
 0)   0.147 us    |        _raw_spin_unlock_irqrestore();
 0)   0.147 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   1.944 us    |      }
 0)               |      dma_pool_free() {
 0)   0.171 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.962 us    |      }
 0)               |      kfree() {
 0)               |      kfree() {
 0)   0.137 us    |        __phys_addr();
 0)   1.074 us    |      }
 0) + 76.640 us   |    }
 0) + 76.640 us   |    } /* ib_alloc_pd */
 0)               |    ib_get_dma_mr() {
 0)   0.179 us    |      kmem_cache_alloc_trace();
 0)   0.179 us    |      } /* kmem_cache_alloc_trace */
 0)   0.187 us    |      _raw_spin_lock_irqsave();
 0)   0.145 us    |      _raw_spin_unlock_irqrestore();
 0)   0.145 us    |      _raw_spin_unlock_irqrestore();
 0)   0.160 us    |      kmem_cache_alloc_trace();
 0)   0.160 us    |      kmem_cache_alloc_trace();
 0)               |      dma_pool_alloc() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.947 us    |      }
 0)               |      down() {
 0)               |      down() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   1.977 us    |      }
 0)   0.153 us    |      _raw_spin_lock();
 0)   0.153 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.136 us    |      } /* __init_waitqueue_head */
 0)               |      mutex_lock() {
 0)   0.377 us    |        __mutex_lock_slowpath();
 0)   1.260 us    |      }
 0)               |      mutex_unlock() {
 0)   0.210 us    |        __mutex_unlock_slowpath();
 0)   0.210 us    |        __mutex_unlock_slowpath();
 0)   1.106 us    |      }
 0)   1.106 us    |      } /* mutex_unlock */
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.171 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)               |          schedule_timeout() {
 0)   0.140 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)               |            lock_timer_base.clone.24() {
 0)   0.160 us    |              _raw_spin_lock_irqsave();
 0)   0.160 us    |              } /* _raw_spin_lock_irqsave */
 0)   1.039 us    |            }
 0)   0.138 us    |            idle_cpu();
 0)   0.138 us    |            } /* idle_cpu */
 0)   0.148 us    |            internal_add_timer();
 0)   0.148 us    |            } /* internal_add_timer */
 0)   0.144 us    |            _raw_spin_unlock_irqrestore();
 0)   0.144 us    |            } /* _raw_spin_unlock_irqrestore */
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.146 us    |                rcu_note_context_switch();
 0)   0.159 us    |                _raw_spin_lock_irq();
 0)   0.159 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.471 us    |                    update_rq_clock();
 0)   0.471 us    |                    } /* update_rq_clock */
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.168 us    |                          cpuacct_charge();
 0)   1.305 us    |                        }
 0)   1.305 us    |                        } /* update_curr */
 0)   0.137 us    |                        clear_buddies();
 0)   0.137 us    |                        } /* clear_buddies */
 0)   0.137 us    |                        update_cfs_load();
 0)   0.137 us    |                        } /* update_cfs_load */
 0)   0.173 us    |                        update_cfs_shares();
 0)   0.173 us    |                        } /* update_cfs_shares */
 0)   5.052 us    |                      }
 0)   0.135 us    |                      hrtick_update();
 0)   0.135 us    |                      } /* hrtick_update */
 0)   6.941 us    |                    }
 0)   9.390 us    |                  }
 0) + 10.303 us   |                }
 0)   0.140 us    |                idle_balance();
 0)   0.140 us    |                } /* idle_balance */
 0)   0.141 us    |                put_prev_task_fair();
 0)   0.141 us    |                } /* put_prev_task_fair */
 0)   0.137 us    |                pick_next_task_fair();
 0)   0.137 us    |                } /* pick_next_task_fair */
 0)   0.136 us    |                pick_next_task_stop();
 0)   0.218 us    |                pick_next_task_rt();
 0)   0.218 us    |                pick_next_task_rt();
 0)   0.137 us    |                pick_next_task_fair();
 0)   0.137 us    |                pick_next_task_fair();
 0)               |                pick_next_task_idle() {
 0)               |                pick_next_task_idle() {
 0)   0.134 us    |                  calc_load_account_idle();
 0)   0.134 us    |                  } /* calc_load_account_idle */
 0)   1.025 us    |                }
 0)   0.248 us    |                finish_task_switch();
 0)   0.248 us    |                } /* finish_task_switch */
 0) + 29.669 us   |              }
 0) + 30.600 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.158 us    |                  _raw_spin_lock_irqsave();
 0)   0.158 us    |                  } /* _raw_spin_lock_irqsave */
 0)   1.046 us    |                }
 0)   0.148 us    |                _raw_spin_unlock_irqrestore();
 0)   2.876 us    |              }
 0)   3.772 us    |            }
 0)   3.772 us    |            } /* del_timer_sync */
 0) + 42.243 us   |          }
 0)   0.279 us    |          _raw_spin_lock_irq();
 0)   0.279 us    |          } /* _raw_spin_lock_irq */
 0) + 45.244 us   |        }
 0) + 50.200 us   |      }
 0)   0.150 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   1.995 us    |      }
 0)   0.144 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   1.995 us    |      } /* up */
 0)               |      dma_pool_free() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.980 us    |      }
 0)               |      kfree() {
 0)               |      kfree() {
 0)   0.137 us    |        __phys_addr();
 0)   1.189 us    |      }
 0) + 76.919 us   |    }
 0) + 76.919 us   |    } /* ib_get_dma_mr */
 0)   0.288 us    |    ib_create_srq();
 0)               |    ib_dereg_mr() {
 0)               |    ib_dereg_mr() {
 0)               |      down() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.160 us    |        } /* _raw_spin_lock_irqsave */
 0)   0.146 us    |        _raw_spin_unlock_irqrestore();
 0)   2.057 us    |      }
 0)   2.057 us    |      } /* down */
 0)   0.150 us    |      _raw_spin_lock();
 0)   0.136 us    |      __init_waitqueue_head();
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)   0.385 us    |        __mutex_lock_slowpath();
 0)   0.385 us    |        __mutex_lock_slowpath();
 0)   1.275 us    |      }
 0)               |      mutex_unlock() {
 0)               |      mutex_unlock() {
 0)   0.191 us    |        __mutex_unlock_slowpath();
 0)   1.067 us    |      }
 0)   1.067 us    |      } /* mutex_unlock */
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.155 us    |          _raw_spin_lock_irq();
 0)               |          schedule_timeout() {
 0)               |          schedule_timeout() {
 0)   0.155 us    |            init_timer_key();
 0)               |            lock_timer_base.clone.24() {
 0)               |            lock_timer_base.clone.24() {
 0)   0.166 us    |              _raw_spin_lock_irqsave();
 0)   0.166 us    |              } /* _raw_spin_lock_irqsave */
 0)   1.079 us    |            }
 0)   0.147 us    |            idle_cpu();
 0)   0.146 us    |            internal_add_timer();
 0)   0.146 us    |            _raw_spin_unlock_irqrestore();
 0)   0.146 us    |            } /* internal_add_timer */
 0)   0.146 us    |            _raw_spin_unlock_irqrestore();
 0)   0.146 us    |            } /* _raw_spin_unlock_irqrestore */
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.142 us    |                rcu_note_context_switch();
 0)   0.173 us    |                _raw_spin_lock_irq();
 0)   0.173 us    |                _raw_spin_lock_irq();
 0)               |                deactivate_task() {
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.415 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.182 us    |                          cpuacct_charge();
 0)   1.239 us    |                        }
 0)   1.239 us    |                        } /* update_curr */
 0)   0.139 us    |                        clear_buddies();
 0)   0.139 us    |                        } /* clear_buddies */
 0)   0.136 us    |                        update_cfs_load();
 0)   0.136 us    |                        } /* update_cfs_load */
 0)   0.181 us    |                        update_cfs_shares();
 0)   0.181 us    |                        } /* update_cfs_shares */
 0)   4.969 us    |                      }
 0)   0.143 us    |                      hrtick_update();
 0)   6.772 us    |                    }
 0)   8.866 us    |                  }
 0)   8.866 us    |                  } /* dequeue_task */
 0)   9.797 us    |                }
 0)   0.151 us    |                idle_balance();
 0)   0.141 us    |                put_prev_task_fair();
 0)   0.137 us    |                pick_next_task_fair();
 0)   0.141 us    |                } /* put_prev_task_fair */
 0)   0.137 us    |                pick_next_task_fair();
 0)   0.137 us    |                } /* pick_next_task_fair */
 0)   0.143 us    |                pick_next_task_stop();
 0)   0.143 us    |                } /* pick_next_task_stop */
 0)   0.200 us    |                pick_next_task_rt();
 0)   0.200 us    |                } /* pick_next_task_rt */
 0)   0.138 us    |                pick_next_task_fair();
 0)   0.138 us    |                } /* pick_next_task_fair */
 0)               |                pick_next_task_idle() {
 0)   0.134 us    |                  calc_load_account_idle();
 0)   1.013 us    |                }
 0)   0.248 us    |                finish_task_switch();
 0)   0.248 us    |                finish_task_switch();
 0) + 32.126 us   |              }
 0) + 33.167 us   |            }
 0) + 33.167 us   |            } /* schedule */
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.160 us    |                  _raw_spin_lock_irqsave();
 0)   0.160 us    |                  } /* _raw_spin_lock_irqsave */
 0)   1.045 us    |                }
 0)   0.144 us    |                _raw_spin_unlock_irqrestore();
 0)   2.946 us    |              }
 0)   2.946 us    |              } /* try_to_del_timer_sync */
 0)   3.860 us    |            }
 0) + 44.368 us   |          }
 0)   0.157 us    |          _raw_spin_lock_irq();
 0) + 47.295 us   |        }
 0) + 48.185 us   |      }
 0)   0.151 us    |      _raw_spin_lock();
 0)   0.151 us    |      _raw_spin_lock();
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   1.954 us    |      }
 0)   0.257 us    |      _raw_spin_lock_irqsave();
 0)   0.257 us    |      _raw_spin_lock_irqsave();
 0)   0.149 us    |      _raw_spin_unlock_irqrestore();
 0)               |      kfree() {
 0)   0.149 us    |      } /* _raw_spin_unlock_irqrestore */
 0)               |      kfree() {
 0)   0.136 us    |        __phys_addr();
 0)   0.136 us    |        } /* __phys_addr */
 0)   1.079 us    |      }
 0) + 68.258 us   |    }
 0)               |    ib_dealloc_pd() {
 0)               |      down() {
 0)   0.162 us    |        _raw_spin_lock_irqsave();
 0)   0.162 us    |        } /* _raw_spin_lock_irqsave */
 0)   0.144 us    |        _raw_spin_unlock_irqrestore();
 0)   0.144 us    |        } /* _raw_spin_unlock_irqrestore */
 0)   1.966 us    |      }
 0)   0.162 us    |      _raw_spin_lock();
 0)   0.162 us    |      } /* _raw_spin_lock */
 0)   0.136 us    |      __init_waitqueue_head();
 0)               |      mutex_lock() {
 0)               |      mutex_lock() {
 0)   0.372 us    |        __mutex_lock_slowpath();
 0)   1.271 us    |      }
 0)   1.271 us    |      } /* mutex_lock */
 0)               |      mutex_unlock() {
 0)   0.191 us    |        __mutex_unlock_slowpath();
 0)   0.191 us    |        } /* __mutex_unlock_slowpath */
 0)   1.103 us    |      }
 0)               |      wait_for_completion_timeout() {
 0)               |        wait_for_common() {
 0)   0.153 us    |          _raw_spin_lock_irq();
 0)   0.153 us    |          } /* _raw_spin_lock_irq */
 0)               |          schedule_timeout() {
 0)   0.139 us    |            init_timer_key();
 0)   0.139 us    |            } /* init_timer_key */
 0)               |            lock_timer_base.clone.24() {
 0)   0.174 us    |              _raw_spin_lock_irqsave();
 0)   1.141 us    |            }
 0)   0.137 us    |            idle_cpu();
 0)   0.137 us    |            idle_cpu();
 0)   0.147 us    |            internal_add_timer();
 0)   0.146 us    |            _raw_spin_unlock_irqrestore();
 0)   0.147 us    |            } /* internal_add_timer */
 0)   0.146 us    |            _raw_spin_unlock_irqrestore();
 0)   0.146 us    |            } /* _raw_spin_unlock_irqrestore */
 0)               |            schedule() {
 0)               |              __schedule() {
 0)   0.142 us    |                rcu_note_context_switch();
 0)   0.142 us    |                } /* rcu_note_context_switch */
 0)   0.160 us    |                _raw_spin_lock_irq();
 0)   0.160 us    |                } /* _raw_spin_lock_irq */
 0)               |                deactivate_task() {
 0)               |                  dequeue_task() {
 0)   0.464 us    |                    update_rq_clock();
 0)               |                    dequeue_task_fair() {
 0)               |                    dequeue_task_fair() {
 0)               |                      dequeue_entity() {
 0)               |                        update_curr() {
 0)   0.206 us    |                          cpuacct_charge();
 0)   0.206 us    |                          } /* cpuacct_charge */
 0)   1.917 us    |                        }
 0)   0.137 us    |                        clear_buddies();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.136 us    |                        update_cfs_load();
 0)   0.188 us    |                        update_cfs_shares();
 0)   0.188 us    |                        update_cfs_shares();
 0)   5.753 us    |                      }
 0)   0.135 us    |                      hrtick_update();
 0)   0.135 us    |                      hrtick_update();
 0)   7.640 us    |                    }
 0)   7.640 us    |                    } /* dequeue_task_fair */
 0)   9.792 us    |                  }
 0) + 10.729 us   |                }
 0)   0.140 us    |                idle_balance();
 0)   0.139 us    |                put_prev_task_fair();
 0)   0.139 us    |                put_prev_task_fair();
 0)   0.138 us    |                pick_next_task_fair();
 0)   0.136 us    |                pick_next_task_stop();
 0)   0.138 us    |                } /* pick_next_task_fair */
 0)   0.136 us    |                pick_next_task_stop();
 0)   0.136 us    |                } /* pick_next_task_stop */
 0)   0.211 us    |                pick_next_task_rt();
 0)   0.211 us    |                } /* pick_next_task_rt */
 0)   0.155 us    |                pick_next_task_fair();
 0)   0.155 us    |                } /* pick_next_task_fair */
 0)               |                pick_next_task_idle() {
 0)   0.133 us    |                  calc_load_account_idle();
 0)   1.030 us    |                }
 0)   0.254 us    |                finish_task_switch();
 0)   0.254 us    |                finish_task_switch();
 0) + 35.498 us   |              }
 0) + 35.498 us   |              } /* __schedule */
 0) + 36.438 us   |            }
 0)               |            del_timer_sync() {
 0)               |              try_to_del_timer_sync() {
 0)               |                lock_timer_base.clone.24() {
 0)   0.161 us    |                  _raw_spin_lock_irqsave();
 0)   1.088 us    |                }
 0)   0.143 us    |                _raw_spin_unlock_irqrestore();
 0)   0.143 us    |                _raw_spin_unlock_irqrestore();
 0)   2.890 us    |              }
 0)   2.890 us    |              } /* try_to_del_timer_sync */
 0)   3.802 us    |            }
 0) + 47.628 us   |          }
 0)   0.275 us    |          _raw_spin_lock_irq();
 0) + 50.627 us   |        }
 0) + 51.515 us   |      }
 0) + 51.515 us   |      } /* wait_for_completion_timeout */
 0)   0.149 us    |      _raw_spin_lock();
 0)               |      up() {
 0)               |      up() {
 0)   0.160 us    |        _raw_spin_lock_irqsave();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   0.145 us    |        _raw_spin_unlock_irqrestore();
 0)   1.975 us    |      }
 0)   0.161 us    |      _raw_spin_lock_irqsave();
 0)   0.161 us    |      _raw_spin_lock_irqsave();
 0)   0.150 us    |      _raw_spin_unlock_irqrestore();
 0)   0.150 us    |      _raw_spin_unlock_irqrestore();
 0)   0.158 us    |      _raw_spin_lock_irqsave();
 0)   0.144 us    |      _raw_spin_unlock_irqrestore();
 0)   0.158 us    |      } /* _raw_spin_lock_irqsave */
 0)   0.144 us    |      _raw_spin_unlock_irqrestore();
 0)   0.144 us    |      } /* _raw_spin_unlock_irqrestore */
 0)               |      kfree() {
 0)   0.136 us    |        __phys_addr();
 0)   1.075 us    |      }
 0) + 72.605 us   |    }
 0)               |    kfree() {
 0)   0.137 us    |      __phys_addr();
 0)   0.137 us    |      __phys_addr();
 0)   1.106 us    |    }
 0)               |    printk() {
 0)               |    printk() {
 0)               |      vprintk() {
 0)   0.273 us    |        _raw_spin_lock();
 0)   0.346 us    |        log_prefix();
 0)   0.346 us    |        log_prefix();
 0)   0.269 us    |        emit_log_char();
 0)   0.173 us    |        emit_log_char();
 0)   0.269 us    |        } /* emit_log_char */
 0)   0.173 us    |        emit_log_char();
 0)   0.173 us    |        } /* emit_log_char */
 0)   0.144 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.147 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.147 us    |        } /* emit_log_char */
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        } /* emit_log_char */
 0)   0.145 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.150 us    |        emit_log_char();
 0)   0.150 us    |        emit_log_char();
 0)   0.146 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.146 us    |        } /* emit_log_char */
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        } /* emit_log_char */
 0)   0.145 us    |        emit_log_char();
 0)   0.160 us    |        emit_log_char();
 0)   0.160 us    |        emit_log_char();
 0)   0.178 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.178 us    |        } /* emit_log_char */
 0)   0.144 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        } /* emit_log_char */
 0)   0.143 us    |        emit_log_char();
 0)   0.143 us    |        } /* emit_log_char */
 0)   0.143 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.145 us    |        emit_log_char();
 0)   0.143 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.143 us    |        } /* emit_log_char */
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.146 us    |        emit_log_char();
 0)   0.144 us    |        } /* emit_log_char */
 0)   0.146 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.144 us    |        emit_log_char();
 0)   0.150 us    |        emit_log_char();
 0)               |        console_trylock() {
 0)   0.150 us    |        } /* emit_log_char */
 0)               |        console_trylock() {
 0)               |          down_trylock() {
 0)   0.228 us    |            _raw_spin_lock_irqsave();
 0)   0.151 us    |            _raw_spin_unlock_irqrestore();
 0)   0.151 us    |            _raw_spin_unlock_irqrestore();
 0)   2.053 us    |          }
 0)   3.154 us    |        }
 0)   3.154 us    |        } /* console_trylock */
 0)               |        console_unlock() {
 0)   0.260 us    |          _raw_spin_lock_irqsave();
 0)   0.260 us    |          } /* _raw_spin_lock_irqsave */
 0)   0.163 us    |          log_prefix();
 0)   0.163 us    |          } /* log_prefix */
 0)   0.173 us    |          _call_console_drivers();
 0)   0.171 us    |          _call_console_drivers();
 0)   0.171 us    |          _call_console_drivers();
 0)   0.171 us    |          _raw_spin_lock_irqsave();
 0)   0.171 us    |          _raw_spin_lock_irqsave();
 0)               |          up() {
 0)   0.158 us    |            _raw_spin_lock_irqsave();
 0)   0.158 us    |            _raw_spin_lock_irqsave();
 0)   0.147 us    |            _raw_spin_unlock_irqrestore();
 0)   0.147 us    |            _raw_spin_unlock_irqrestore();
 0)   2.578 us    |          }
 0)   0.150 us    |          _raw_spin_lock();
 0)   0.150 us    |          _raw_spin_lock();
 0)   0.154 us    |          _raw_spin_unlock_irqrestore();
 0)   0.154 us    |          _raw_spin_unlock_irqrestore();
 0) + 10.567 us   |        }
 0) + 50.298 us   |      }
 0) + 50.298 us   |      } /* vprintk */
 0) + 51.389 us   |    }
 0)               |    ib_set_client_data() {
 0)   0.178 us    |      _raw_spin_lock_irqsave();
 0)   0.178 us    |      } /* _raw_spin_lock_irqsave */
 0)   0.155 us    |      _raw_spin_unlock_irqrestore();
 0)   0.155 us    |      } /* _raw_spin_unlock_irqrestore */
 0)   2.163 us    |    }
 0) ! 514.352 us  |  }

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                         ` <806c99edea592c69d0aa9073bae2a3b9-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
@ 2012-04-12  1:24                           ` Roland Dreier
       [not found]                             ` <CAL1RGDXT1gshgxA+c9M==zxarKnjKZtcy4dROtOnKVmc9+u9HQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Roland Dreier @ 2012-04-12  1:24 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

> I tryed this patch but it doesnt work i still get
> ib_mthca: Initializing 0000:4b:00.0
> ib_mthca 0000:4b:00.0: irq 49 for MSI/MSI-X
> ib_mthca 0000:4b:00.0: irq 50 for MSI/MSI-X
> ib_mthca 0000:4b:00.0: irq 51 for MSI/MSI-X
> srpt_add_one(mthca0) failed.

Hmm, in srpt_add_one(), where it says

	sdev->srq = ib_create_srq(sdev->pd, &srq_attr);
	if (IS_ERR(sdev->srq))
		goto err_mr;

can you change that to

	sdev->srq = ib_create_srq(sdev->pd, &srq_attr);
	if (IS_ERR(sdev->srq)) {
                pr_err("ib_create_srq failed: %d\n", PTR_ERR(sdev->srq));
		goto err_mr;
        }

and report what that prints?

Also, does the userspace test program ibv_srq_pingpong from libibverbs
work on this system?

Thanks,
 - R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                             ` <CAL1RGDXT1gshgxA+c9M==zxarKnjKZtcy4dROtOnKVmc9+u9HQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-12  5:52                               ` Alexey Shvetsov
       [not found]                                 ` <2f4564980ae4cdafdc456a8e41b4ab04-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-12  5:52 UTC (permalink / raw)
  To: Roland Dreier; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

Hi Roland!

Seems like this card doesnt support srq
store linux # ibv_srq_pingpong
Couldn't get local LID

PS on nodes with mlx4 devices ibv_srq_pingpong works

also with yout change it doesnt report anything new
Loading kernel module for a network device with CAP_SYS_MODULE 
(deprecated).  Use CAP_NET_ADMIN and alias netdev-ib0 instead.
ib_mthca: Mellanox InfiniBand HCA driver v1.0 (April 4, 2008)
ib_mthca: Initializing 0000:4b:00.0
ib_mthca 0000:4b:00.0: irq 49 for MSI/MSI-X
ib_mthca 0000:4b:00.0: irq 50 for MSI/MSI-X
ib_mthca 0000:4b:00.0: irq 51 for MSI/MSI-X
srpt_add_one(mthca0) failed.

Roland Dreier писал 2012-04-12 04:24:
>> I tryed this patch but it doesnt work i still get
>> ib_mthca: Initializing 0000:4b:00.0
>> ib_mthca 0000:4b:00.0: irq 49 for MSI/MSI-X
>> ib_mthca 0000:4b:00.0: irq 50 for MSI/MSI-X
>> ib_mthca 0000:4b:00.0: irq 51 for MSI/MSI-X
>> srpt_add_one(mthca0) failed.
>
> Hmm, in srpt_add_one(), where it says
>
> 	sdev->srq = ib_create_srq(sdev->pd, &srq_attr);
> 	if (IS_ERR(sdev->srq))
> 		goto err_mr;
>
> can you change that to
>
> 	sdev->srq = ib_create_srq(sdev->pd, &srq_attr);
> 	if (IS_ERR(sdev->srq)) {
>                 pr_err("ib_create_srq failed: %d\n", 
> PTR_ERR(sdev->srq));
> 		goto err_mr;
>         }
>
> and report what that prints?
>
> Also, does the userspace test program ibv_srq_pingpong from 
> libibverbs
> work on this system?
>
> Thanks,
>  - R.

-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                 ` <2f4564980ae4cdafdc456a8e41b4ab04-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
@ 2012-04-12  9:09                                   ` Roland Dreier
       [not found]                                     ` <CAL1RGDVh=n5rEB5GqmPaDvuNAKRkoVEro9LYr785zQpz7xR0vg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Roland Dreier @ 2012-04-12  9:09 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

On Wed, Apr 11, 2012 at 10:52 PM, Alexey Shvetsov <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> wrote:
> Seems like this card doesnt support srq
> store linux # ibv_srq_pingpong
> Couldn't get local LID

Actually that message comes later ... it looks like ibv_create_srq() did work.

> PS on nodes with mlx4 devices ibv_srq_pingpong works
>
> also with yout change it doesnt report anything new

Are you sure you're actually loading the patched module?
I don't see how it could fail to print something if ib_create_srq()
fails.  You could try adding a printk() to the very beginning of
srpt_add_one() and making sure that shows up.

(That would explain why my first patch didn't fix things for you)

 - R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                     ` <CAL1RGDVh=n5rEB5GqmPaDvuNAKRkoVEro9LYr785zQpz7xR0vg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-12 14:46                                       ` Roland Dreier
       [not found]                                         ` <CAL1RGDXFVTD88ZF9rWoaDpOU7PuzdPcF7PSP4Ac6icgD=FPQLQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Roland Dreier @ 2012-04-12 14:46 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

On Thu, Apr 12, 2012 at 2:09 AM, Roland Dreier <roland-BHEL68pLQRGGvPXPguhicg@public.gmane.org> wrote:
> Are you sure you're actually loading the patched module?
> I don't see how it could fail to print something if ib_create_srq()
> fails.  You could try adding a printk() to the very beginning of
> srpt_add_one() and making sure that shows up.
>
> (That would explain why my first patch didn't fix things for you)

Indeed, I just replicated your problem on my system and confirmed
that the patch adding "srq_attr.srq_type = IB_SRQT_BASIC" does
let mthca devices get through srpt_add_one().  I'll get ready to send
that fix upstream.

It seems quite likely you forgot to install the patched ib_srpt module
or something similar.

Thanks,
  Roland
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                         ` <CAL1RGDXFVTD88ZF9rWoaDpOU7PuzdPcF7PSP4Ac6icgD=FPQLQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-12 18:58                                           ` Alexey Shvetsov
  2012-04-12 19:02                                           ` Alexey Shvetsov
  1 sibling, 0 replies; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-12 18:58 UTC (permalink / raw)
  To: Roland Dreier; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

Roland Dreier писал 2012-04-12 17:46:
> On Thu, Apr 12, 2012 at 2:09 AM, Roland Dreier
> <roland-BHEL68pLQRGGvPXPguhicg@public.gmane.org> wrote:
>> Are you sure you're actually loading the patched module?
>> I don't see how it could fail to print something if ib_create_srq()
>> fails.  You could try adding a printk() to the very beginning of
>> srpt_add_one() and making sure that shows up.
>>
>> (That would explain why my first patch didn't fix things for you)
>
> Indeed, I just replicated your problem on my system and confirmed
> that the patch adding "srq_attr.srq_type = IB_SRQT_BASIC" does
> let mthca devices get through srpt_add_one().  I'll get ready to send
> that fix upstream.
>
> It seems quite likely you forgot to install the patched ib_srpt 
> module
> or something similar.
>
> Thanks,
>   Roland

Yep patch seems work with 3.3 kernel. But i still cannot create target 
=\
-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                         ` <CAL1RGDXFVTD88ZF9rWoaDpOU7PuzdPcF7PSP4Ac6icgD=FPQLQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  2012-04-12 18:58                                           ` Alexey Shvetsov
@ 2012-04-12 19:02                                           ` Alexey Shvetsov
  2012-04-12 19:17                                             ` Roland Dreier
       [not found]                                             ` <CAL1RGDVjhpzSDUvkpdkG8u2YPwAWmt_szUw=wb3j3=gsb-iW-g@mail.gmai l.com>
  1 sibling, 2 replies; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-12 19:02 UTC (permalink / raw)
  To: Roland Dreier; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA

Hi Roland!

Also another question. I still cannot create target with targetcli nor 
with configfs. It alays said that wwn is invalid and seems cannot 
register ib device. Can it be related to order of module loading. I have 
this problems both with mlx4 and mthca device. Or may it be related to 
firmware version. Its branded HP devices. Can I use non OEM firmware for 
them?

Roland Dreier писал 2012-04-12 17:46:
> On Thu, Apr 12, 2012 at 2:09 AM, Roland Dreier
> <roland-BHEL68pLQRGGvPXPguhicg@public.gmane.org> wrote:
>> Are you sure you're actually loading the patched module?
>> I don't see how it could fail to print something if ib_create_srq()
>> fails.  You could try adding a printk() to the very beginning of
>> srpt_add_one() and making sure that shows up.
>>
>> (That would explain why my first patch didn't fix things for you)
>
> Indeed, I just replicated your problem on my system and confirmed
> that the patch adding "srq_attr.srq_type = IB_SRQT_BASIC" does
> let mthca devices get through srpt_add_one().  I'll get ready to send
> that fix upstream.
>
> It seems quite likely you forgot to install the patched ib_srpt 
> module
> or something similar.
>
> Thanks,
>   Roland

-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
  2012-04-12 19:02                                           ` Alexey Shvetsov
@ 2012-04-12 19:17                                             ` Roland Dreier
       [not found]                                             ` <CAL1RGDVjhpzSDUvkpdkG8u2YPwAWmt_szUw=wb3j3=gsb-iW-g@mail.gmai l.com>
  1 sibling, 0 replies; 20+ messages in thread
From: Roland Dreier @ 2012-04-12 19:17 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: linux-rdma, target-devel

On Thu, Apr 12, 2012 at 12:02 PM, Alexey Shvetsov <alexxy@gentoo.org> wrote:

> Also another question. I still cannot create target with targetcli nor with
> configfs. It alays said that wwn is invalid and seems cannot register ib
> device. Can it be related to order of module loading. I have this problems
> both with mlx4 and mthca device. Or may it be related to firmware version.
> Its branded HP devices. Can I use non OEM firmware for them?

The HCA / firmware shouldn't matter, nor should the module load order.

I actually don't really have any experience setting up targets with srpt,
so I don't know the sequence of configfs / targetcli stuff, or which wwn
it might be talking about.

Perhaps someone on target-devel (cc'ed) can help...

 - R.

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                               ` <CAL1RGDVjhpzSDUvkpdkG8u2YPwAWmt_szUw=wb3j3=gsb-iW-g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-04-12 20:59                                                 ` Andy Grover
       [not found]                                                   ` <4F87423D.8010104-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Andy Grover @ 2012-04-12 20:59 UTC (permalink / raw)
  To: Roland Dreier
  Cc: Alexey Shvetsov, linux-rdma-u79uwXL29TY76Z2rM5mHXA, target-devel

On 04/12/2012 12:17 PM, Roland Dreier wrote:
> On Thu, Apr 12, 2012 at 12:02 PM, Alexey Shvetsov <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> wrote:
> 
>> Also another question. I still cannot create target with targetcli nor with
>> configfs. It alays said that wwn is invalid and seems cannot register ib
>> device. Can it be related to order of module loading. I have this problems
>> both with mlx4 and mthca device. Or may it be related to firmware version.
>> Its branded HP devices. Can I use non OEM firmware for them?
> 
> The HCA / firmware shouldn't matter, nor should the module load order.
> 
> I actually don't really have any experience setting up targets with srpt,
> so I don't know the sequence of configfs / targetcli stuff, or which wwn
> it might be talking about.
> 
> Perhaps someone on target-devel (cc'ed) can help...

I also have no experience as yet using srpt, but see this post, it may
help use targetcli with it? Although if you also are having trouble via
configfs directly, then perhaps not.

http://permalink.gmane.org/gmane.linux.scsi.target.devel/1513

HTH -- Regards -- Andy
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                                   ` <4F87423D.8010104-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
@ 2012-04-12 21:18                                                     ` Alexey Shvetsov
  2012-04-12 22:01                                                       ` Andy Grover
  2012-04-13  4:00                                                       ` Nicholas A. Bellinger
  0 siblings, 2 replies; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-12 21:18 UTC (permalink / raw)
  To: Andy Grover
  Cc: Roland Dreier, linux-rdma-u79uwXL29TY76Z2rM5mHXA, target-devel

Hi Andy!

Well this were exactly this issue. Can someone commit fix to rtslib 
git?

PS i have patch with gentoo init.d for lio-utils

Andy Grover писал 2012-04-12 23:59:
> On 04/12/2012 12:17 PM, Roland Dreier wrote:
>> On Thu, Apr 12, 2012 at 12:02 PM, Alexey Shvetsov 
>> <alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org> wrote:
>>
>>> Also another question. I still cannot create target with targetcli 
>>> nor with
>>> configfs. It alays said that wwn is invalid and seems cannot 
>>> register ib
>>> device. Can it be related to order of module loading. I have this 
>>> problems
>>> both with mlx4 and mthca device. Or may it be related to firmware 
>>> version.
>>> Its branded HP devices. Can I use non OEM firmware for them?
>>
>> The HCA / firmware shouldn't matter, nor should the module load 
>> order.
>>
>> I actually don't really have any experience setting up targets with 
>> srpt,
>> so I don't know the sequence of configfs / targetcli stuff, or which 
>> wwn
>> it might be talking about.
>>
>> Perhaps someone on target-devel (cc'ed) can help...
>
> I also have no experience as yet using srpt, but see this post, it 
> may
> help use targetcli with it? Although if you also are having trouble 
> via
> configfs directly, then perhaps not.
>
> http://permalink.gmane.org/gmane.linux.scsi.target.devel/1513
>
> HTH -- Regards -- Andy


-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
  2012-04-12 21:18                                                     ` Alexey Shvetsov
@ 2012-04-12 22:01                                                       ` Andy Grover
  2012-04-13  4:00                                                       ` Nicholas A. Bellinger
  1 sibling, 0 replies; 20+ messages in thread
From: Andy Grover @ 2012-04-12 22:01 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: Roland Dreier, linux-rdma, target-devel

On 04/12/2012 02:18 PM, Alexey Shvetsov wrote:
>>>> Also another question. I still cannot create target with targetcli
>>>> nor with
>>>> configfs. It alays said that wwn is invalid and seems cannot

>> I also have no experience as yet using srpt, but see this post, it may
>> help use targetcli with it? Although if you also are having trouble via
>> configfs directly, then perhaps not.
>>
>> http://permalink.gmane.org/gmane.linux.scsi.target.devel/1513

> Well this were exactly this issue. Can someone commit fix to rtslib
> git?

I've applied this fix to rtslib-fb[1] but haven't seen it picked up
upstream yet.

> PS i have patch with gentoo init.d for lio-utils

rtslib-fb doesn't need lio-utils, to me this is a major selling point :)

Regards -- Andy

[1] https://github.com/agrover/rtslib-fb

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
  2012-04-12 21:18                                                     ` Alexey Shvetsov
  2012-04-12 22:01                                                       ` Andy Grover
@ 2012-04-13  4:00                                                       ` Nicholas A. Bellinger
       [not found]                                                         ` <1334289638.3137.4938.camel-Y1+j5t8j3WgjMeEPmliV8E/sVC8ogwMJ@public.gmane.org>
  1 sibling, 1 reply; 20+ messages in thread
From: Nicholas A. Bellinger @ 2012-04-13  4:00 UTC (permalink / raw)
  To: Alexey Shvetsov; +Cc: Andy Grover, Roland Dreier, linux-rdma, target-devel

On Fri, 2012-04-13 at 00:18 +0300, Alexey Shvetsov wrote:
> Hi Andy!
> 
> Well this were exactly this issue. Can someone commit fix to rtslib 
> git?
> 

Hi Alexey,

Thanks for the heads up here..  Pushed this patch into rtslib.git.

> PS i have patch with gentoo init.d for lio-utils
> 

Sure, please feel free to post your init.d patch.  :)

Btw, we've been updating the TargetCLI wiki entries to point to the
downstream distro packages + installation instructions for end users of
LIO here:

http://linux-iscsi.org/wiki/Targetcli#Download

If you mind taking a moment, and please let me know what information for
Gentoo should be added and will get it added into the wiki.

Thanks!

--nab

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                                         ` <1334289638.3137.4938.camel-Y1+j5t8j3WgjMeEPmliV8E/sVC8ogwMJ@public.gmane.org>
@ 2012-04-13  8:47                                                           ` Alexey Shvetsov
       [not found]                                                             ` <273131eb997f295f6b1f3d103a7013d4-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
  0 siblings, 1 reply; 20+ messages in thread
From: Alexey Shvetsov @ 2012-04-13  8:47 UTC (permalink / raw)
  To: Nicholas A. Bellinger
  Cc: Andy Grover, Roland Dreier, linux-rdma-u79uwXL29TY76Z2rM5mHXA,
	target-devel

Hi Nicholas!

Sure i'll post init.d for gentoo. Also there is question about lio* and 
related libs tarballs. Where i can find them?


Nicholas A. Bellinger писал 2012-04-13 07:00:
> On Fri, 2012-04-13 at 00:18 +0300, Alexey Shvetsov wrote:
>> Hi Andy!
>>
>> Well this were exactly this issue. Can someone commit fix to rtslib
>> git?
>>
>
> Hi Alexey,
>
> Thanks for the heads up here..  Pushed this patch into rtslib.git.
>
>> PS i have patch with gentoo init.d for lio-utils
>>
>
> Sure, please feel free to post your init.d patch.  :)
>
> Btw, we've been updating the TargetCLI wiki entries to point to the
> downstream distro packages + installation instructions for end users 
> of
> LIO here:
>
> http://linux-iscsi.org/wiki/Targetcli#Download
>
> If you mind taking a moment, and please let me know what information 
> for
> Gentoo should be added and will get it added into the wiki.
>
> Thanks!
>
> --nab

-- 
Best Regards,
Alexey 'Alexxy' Shvetsov
Petersburg Nuclear Physics Institute, Russia
Department of Molecular and Radiation Biophysics
Gentoo Team Ru
Gentoo Linux Dev
mailto:alexxyum-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
mailto:alexxy-aBrp7R+bbdUdnm+yROfE0A@public.gmane.org
mailto:alexxy-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: ib_srpt and mellanox mthca device
       [not found]                                                             ` <273131eb997f295f6b1f3d103a7013d4-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
@ 2012-04-14  1:27                                                               ` Nicholas A. Bellinger
  0 siblings, 0 replies; 20+ messages in thread
From: Nicholas A. Bellinger @ 2012-04-14  1:27 UTC (permalink / raw)
  To: Alexey Shvetsov
  Cc: Andy Grover, Roland Dreier, linux-rdma-u79uwXL29TY76Z2rM5mHXA,
	target-devel

On Fri, 2012-04-13 at 11:47 +0300, Alexey Shvetsov wrote:
> Hi Nicholas!
> 
> Sure i'll post init.d for gentoo.

Thanks, I'll look for your patch.  :)

>  Also there is question about lio* and 
> related libs tarballs. Where i can find them?
> 

configshell/rtslib/targetcli will generate a release tarball from doing
'make release' with the respective git trees.

The lio-utils.git tarball is generated while making a rpm or deb
package, but currently does not have a method for 'make release'.

As Andy has done with this tree, we will end up merging the necessary
init.d/python pieces from lio-utils.git directly into the targetcli.git
tree in the near future and deprecate lio-utils.

--nab


--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 20+ messages in thread

end of thread, other threads:[~2012-04-14  1:27 UTC | newest]

Thread overview: 20+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-04-10 14:52 ib_srpt and mellanox mthca device Alexey Shvetsov
     [not found] ` <5f95768153388b91a2ffa0cd118d7ad8-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
2012-04-10 23:09   ` Roland Dreier
     [not found]     ` <CAL1RGDWNqMdQGrXbh2gj==_KvVRF1mUQw2D3NqEhjvuq2q2+6Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-11  9:21       ` Alexey Shvetsov
     [not found]         ` <97cccba5ba7ddc74e87b0791050fa755-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
2012-04-11 20:06           ` Roland Dreier
     [not found]             ` <CAL1RGDVbqOQP+AH4f9cs+mEngXVTOy7r7gRjJ=SU_rMmvCg3Qg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-11 20:13               ` Alexey Shvetsov
     [not found]                 ` <fa3a67e9423946c0bbd23abb3f60921a-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
2012-04-11 22:15                   ` Roland Dreier
     [not found]                     ` <CAL1RGDVn1Roo-KaZW_r_WAQudbEZ2+mXD2RqNS68Rg=UBTRe7Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-11 23:21                       ` Alexey Shvetsov
     [not found]                         ` <806c99edea592c69d0aa9073bae2a3b9-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
2012-04-12  1:24                           ` Roland Dreier
     [not found]                             ` <CAL1RGDXT1gshgxA+c9M==zxarKnjKZtcy4dROtOnKVmc9+u9HQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-12  5:52                               ` Alexey Shvetsov
     [not found]                                 ` <2f4564980ae4cdafdc456a8e41b4ab04-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
2012-04-12  9:09                                   ` Roland Dreier
     [not found]                                     ` <CAL1RGDVh=n5rEB5GqmPaDvuNAKRkoVEro9LYr785zQpz7xR0vg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-12 14:46                                       ` Roland Dreier
     [not found]                                         ` <CAL1RGDXFVTD88ZF9rWoaDpOU7PuzdPcF7PSP4Ac6icgD=FPQLQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-12 18:58                                           ` Alexey Shvetsov
2012-04-12 19:02                                           ` Alexey Shvetsov
2012-04-12 19:17                                             ` Roland Dreier
     [not found]                                             ` <CAL1RGDVjhpzSDUvkpdkG8u2YPwAWmt_szUw=wb3j3=gsb-iW-g@mail.gmai l.com>
     [not found]                                               ` <CAL1RGDVjhpzSDUvkpdkG8u2YPwAWmt_szUw=wb3j3=gsb-iW-g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-04-12 20:59                                                 ` Andy Grover
     [not found]                                                   ` <4F87423D.8010104-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
2012-04-12 21:18                                                     ` Alexey Shvetsov
2012-04-12 22:01                                                       ` Andy Grover
2012-04-13  4:00                                                       ` Nicholas A. Bellinger
     [not found]                                                         ` <1334289638.3137.4938.camel-Y1+j5t8j3WgjMeEPmliV8E/sVC8ogwMJ@public.gmane.org>
2012-04-13  8:47                                                           ` Alexey Shvetsov
     [not found]                                                             ` <273131eb997f295f6b1f3d103a7013d4-heEE5zn7HfaV8fSEjHp0FA@public.gmane.org>
2012-04-14  1:27                                                               ` Nicholas A. Bellinger

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.