Quantcast
Channel: Mellanox Interconnect Community: Message List
Viewing all 6227 articles
Browse latest View live

Re: Troubleshooting the iSER enable on Mellanox ConnectX-2 EN and running iSCSI traffic.

$
0
0

Thanks Ophir for the reply.

 

Hi Anil,

 

Do you have MLNX_OFED installed? did you use OFED inbox driver?

 

Anil> Whether MLNX_OFED should be available as inbox? I tried your commands

and they did not run, please see the output given below.

 

# yum install "InfiniBand Group"

Loaded plugins: aliases, changelog, downloadonly, fastestmirror, kabi,

presto, refresh-packagekit,

              : security, tmprepo, verify, versionlock

Loading support for CentOS kernel ABI

Loading mirror speeds from cached hostfile

 

  • base: mirrors.unifiedlayer.com

 

  • extras: mirror.anl.gov

 

  • updates: mirrors.easynews.com

Setting up Install Process

No package InfiniBand Group available.

Error: Nothing to do

#

#

# ibdev2netdev

bash: ibdev2netdev: command not found

# ibdev2netdev

bash: ibdev2netdev: command not found

# ofed_info | head

bash: ofed_info: command not found

#

 

 

 

you didn't reach the level of testing ISER, first you need to make sure

that RoCE is running, and for that you need RDMA support.

 

Anil>> I knew, I am missing something. yes, I want to make sure that RoCE

is running first

 

Thanks,

 

Anil


Re: Troubleshooting the iSER enable on Mellanox ConnectX-2 EN and running iSCSI traffic.

Re: Troubleshooting the iSER enable on Mellanox ConnectX-2 EN and running iSCSI traffic.

$
0
0

Ophir,

 

This <http://community.mellanox.com/docs/DOC-1465> is the exact link what I

was following. I installed packages from there and got stuck up at

following section.

 

Configure port parameters:

Configure IP Address and enable the port.

*It can be done via console scripts such as nmtui, ifconfig (not permanent)

or other method*

For example:

 

#ifconfig enp5s0 12.12.12.1/24 <http://12.12.12.1/24> up

 

 

 

I tried to install these packages again and it came up with following

response:

 

# yum -y groupinstall "InfiniBand Support"

Loaded plugins: aliases, changelog, downloadonly, fastestmirror, kabi,

presto, refresh-packagekit, security, tmprepo, verify,

              : versionlock

Loading support for CentOS kernel ABI

Loading mirror speeds from cached hostfile

 

  • base: centos-distro.cavecreek.net

 

  • extras: mirror.nwresd.org

 

  • updates: mirrors.xmission.com

Setting up Group Process

Checking for new repos for mirrors

Package libibverbs-utils-1.1.7-1.el6.x86_64 already installed and latest

version

Package libibverbs-1.1.7-1.el6.x86_64 already installed and latest version

Package librdmacm-utils-1.0.17-1.el6.x86_64 already installed and latest

version

Package libibcm-1.0.5-3.el6.x86_64 already installed and latest version

Package rdma-3.10-3.el6.noarch already installed and latest version

Package librdmacm-1.0.17-1.el6.x86_64 already installed and latest version

Package libmlx4-1.0.5-4.el6.1.x86_64 already installed and latest version

Package libipathverbs-1.2-4.el6.x86_64 already installed and latest version

Package libmthca-1.0.6-3.el6.x86_64 already installed and latest version

Package libnes-1.1.3-1.el6.x86_64 already installed and latest version

Package libcxgb3-1.3.1-1.el6.x86_64 already installed and latest version

Package ibsim-0.5-7.el6.x86_64 already installed and latest version

Package dapl-2.0.34-1.el6.x86_64 already installed and latest version

Package libibmad-1.3.9-1.el6.x86_64 already installed and latest version

Package libibumad-1.3.8-1.el6.x86_64 already installed and latest version

Package rds-tools-2.0.6-3.el6.x86_64 already installed and latest version

Package ibutils-1.5.7-8.el6.x86_64 already installed and latest version

Package ibacm-1.0.8-0.git7a3adb7.el6.x86_64 already installed and latest

version

Warning: Group infiniband does not have any packages.

No packages in any requested group available to install or update

#

#

# yum -y install perftest infiniband-diags

Loaded plugins: aliases, changelog, downloadonly, fastestmirror, kabi,

presto, refresh-packagekit, security, tmprepo, verify,

              : versionlock

Loading support for CentOS kernel ABI

Loading mirror speeds from cached hostfile

 

  • base: mirror.tocici.com

 

  • extras: mirror.nwresd.org

 

  • updates: mirrors.xmission.com

Setting up Install Process

Package perftest-2.0-2.el6.x86_64 already installed and latest version

Package infiniband-diags-1.5.12-5.el6.x86_64 already installed and latest

version

Nothing to do

#

 

 

So it seems like theses packages are there on my system.

 

If you think, I need to do following extra, I can do that.

 

*You can also install MLNX_OFED, see Mellanox website for the driver

package.*

 

Click here, and follow the links.

 

*Mellanox Products: Mellanox OpenFabrics Enterprise Distribution for Linux

(MLNX_OFED)*

<http://www.mellanox.com/page/products_dyn?product_family=26&mtag=linux_sw_drivers>

 

 

 

 

On Tue, Sep 16, 2014 at 12:02 PM, ophirmaor <socialmedia@mellanox.com>

Re: Troubleshooting the iSER enable on Mellanox ConnectX-2 EN and running iSCSI traffic.

$
0
0

Ophir,

 

I downloaded driver from your web site and probably it seems to behave much

better now. I am giving you output of the commands what you asked earlier.

 

# ibdev2netdev

mlx4_0 port 2 ==> eth4 (Down)

mlx4_0 port 1 ==> eth5 (Down)

# ofed_info | head

MLNX_OFED_LINUX-2.3-1.0.1 (OFED-2.3-1.0.0):

 

ar_mgr:

ar_mgr/e338fbc05dd6b480f8505791e50700b7/ar_mgr-1.0-0.23.g20d8d45.tar.gz

 

bupc:

bupc/6b0f0c8b7d7ff2e258e600d65f6da291/bupc-2.18.0-421.src.rpm

 

cc_mgr:

cc_mgr/4a29eb085479e51b6bb278efcddfe379/cc_mgr-1.0-0.22.g20d8d45.tar.gz

#

 

 

 

So interface eth4 and eth5 can be used for iSER, correct?

 

I have two cards and want to set one card in one system as iSER Initiator

and other card as iSER target.

 

Can I use these two cards in the same system as Initiator and target?

 

Thanks,

Anil

Re: Troubleshooting the iSER enable on Mellanox ConnectX-2 EN and running iSCSI traffic.

$
0
0

eth4 and eth5 will be the interfaces you need to configure. correct.

Do you have two hosts? if so, you can configure one host (with one Mellanox adapter) as target (you can use TGT for example) and another server equipped with Mellanox adapter as the initiator.

you can follow HowTo Configure TGT enabled with iSER Transport for RHEL for that.

 

Ophir.

Re: Windows 2008 R2 Drivers Mellanox ConnectX-2 IPoIB adaptor

$
0
0

Erez,

 

1) 8gb

2) i did so after your response

3) no, not specific

4) i did after your response

 

I works now

i uninstalled all drivers and software

after installing the latest drivers and rebooting the machine the network cards become available

 

thanks for the help

 

Kris.

Re: Why LRO is disabled by default in mlx4_en driver?

$
0
0

LRO settings set to 'OFF' by default as it done by other vendors. This is like old good know behavior and user can change it according to his requirement.

Some applications are bandwidth depended and other are latency and network device parameters should  be set according to the benchmark/application results.

Re: How to create IB partitions without enabling IPOIB

$
0
0

In order to let to the nodes communicate over configured partition child interface should be created for IPoIB interface, or application should specify the P_Key.

Did you try to use ib_send_lat (or other) tools with --pkey_index argument?


Re: InfiniBand RDMA latency test on Xen's dom0 crashes

$
0
0

Something cause to out-of-memory on your box. It is not clean why did you set log_num_mtt to be so high- 4194304. What was the initial failure?

Another point, that you 'dmesg' says that used FW it is probably good to consider firmware upgrade.

Re: Can't Achieve 40Gbps

$
0
0

Your information is little bit confusing. You are talking about Ethernet but runngin 'ethtoool' with ib0 device. You have two Mellanox adapter in the system. Please, verify that the correct one is used.

ibv_devinfo and ibdev2netdev commands will help you.

Windows: Network cable unplugged

$
0
0

Hi there,

 

I have a Mellanox MIS5025Q-1SFC , and 2 x MELLANOX MCX354A-FCBT card.

When I installed them in my windows 2012 r2 and win 7 client machine, and installed the drive pack from Mellanox website, it recognize it, but it showed the cable is not plugged in.  (Via direct-connect between two computer or thru the switch)  the link green light is up, but within Windows, it is still show up as no network cable is connected.  I am using Mellanox MC2207128-003 passive cable, am I doing something wrong ? thanks!

Configuring iSER target using Mellanox MT26448 (ConnectX2) card

$
0
0

Can you please help me with following?

 

I am trying to use Mellanox ConnectX2 card as target and I am getting following error when running tgtd there.

 

tgtd

(null): iser_ib_init(3397) rdma_bind_addr -1: Cannot assign requested address

(null): iscsi_tcp_init_portal(227) unable to bind server socket, Address already in use

(null): iscsi_tcp_init_portal(227) unable to bind server socket, Address already in use

(null): iscsi_add_portal(276) failed to create/bind to portal (null):3260

Re: Configuring iSER target using Mellanox MT26448 (ConnectX2) card

Re: Windows: Network cable unplugged

$
0
0

What is ibv_devinfo command output?

Re: Hyper-V vSwitch speed problems

$
0
0

Hi!

Can you posting hour system configurations and OS version?

I'm also have a CX-2 based system in my personal lab.

I prefer to test in vSphere environment, but I remember that performance on Windows environment was always over 1Gb ETH connections.

 

If you show me your detailed configuration then I'll post result after weekend test.

 

P.S

Mellanox announced end of support CX-2.

Current WinOF release will be a last support CX-2 on Windows!

Check release notes and user guide.


Re: Windows: Network cable unplugged

$
0
0

Do you have subnet manager running on the network? This is required for an IB fabric to work. Since the switch you are using is unmanaged, this has to be run on a host machine.

ibv_devinfo will confirm if these hosts have addresses assigned which in turn will indicate SM availability.

Re: Replace the fiber optic cable

Re: Resource monitor chart does not display Mellanox usage

Re: Windows: Network cable unplugged

$
0
0

Hi there,

 

Thanks. 

Yes subnet manager was what I didn't know that I need to use   I did the openSM, and it is running now.

Why does IB need a subnet manager?

 

I did run ib_devinfo, it just show the port_active, and not an address. 

 

Under network properties, I assigned like 192.168.1.3/255.255.255.0, I don't need any subnet just like regular networking right ?

Re: Windows: Network cable unplugged

$
0
0

Also, since I am using an unmanaged switch, I don't mind running OpenSM on a host machine, but if I am just using IB for my backend storage, would the switch I have right now be sufficient ? or do I still need a managed one..   thinking about doing iSCSI

Viewing all 6227 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>