Quantcast
Channel: Mellanox Interconnect Community: Message List
Viewing all 6227 articles
Browse latest View live

Re: how to password reset in voltaire 4036 ?


Multiple MTU in routed vlans

$
0
0

I'm running a pair of SX1024s as the core switch on my network.

There is a storage server capable of MTU 9000 and a few clients capable of the same MTU size, but I also have clients that are not Capable of large MTUs. I was thinking of creating a large MTU VLAN to connect the storage and large MTU capable clients and another normal MTU VLAN and routing between the VLANs to enable access to the sotrage for non large-MTU capable clients .
Is this solution going to work, what are the potential pitfalls I need to be aware of ?

 

 

 

Thanks

Re: Where to find TILE-Gx user manual and driver/firmware?

$
0
0

Hi Wei,

try in MyMellanox website.

 

Ophir.

Re: Multiple MTU in routed vlans

$
0
0

Hi,

There is a DF (don't fragment) flag on the IP header that allow of forbid packet fragments.

your problem is when running 9K packets from the Storage to some of the 1500 MTU servers.

If the packets reaches the switch with the DF bit on (means don't fragment) it will be dropped, otherwise, the switch will fragment the packet, and it should reassembeled on the NIC.

 

What is your application?

 

See also:IPv4 - Wikipedia

 

Thanks,

Ophir.

Re: mlx4 driver stripping inner vlan from double-tagged frame

Re: Not getting connection between 4036E switch and MT26428 adapter

$
0
0

Hello Will

 

Do you have a subnet Manager running on the switch or the host? There needs to be at least one SM in the fabric to bring links active.

 

-Steve

Re: Not getting connection between 4036E switch and MT26428 adapter

$
0
0

Thanks, Steve, for your reply. Yes, the SM is running on the Voltaire

switch.

 

In further testing, I downed the connected server, swapped the IB card with

another one, and voila - the link came up! So, bad card. I just don't know

how I could have figured that out. In any case, problem resolved.

 

Will

DPDK-L3FWD PROX Compilation Error :: mlx5_mr.c:39:30: fatal error: infiniband/verbs.h: No such file or directory

$
0
0

Hi,

 

I am trying to compile DPDK PROX L3FWD application for the mlx4 driver and is running into following compilation issues. I have followed the steps from following link as reference.

http://www.mellanox.com/related-docs/prod_software/MLNX_DPDK_Quick_Start_Guide_v2.2_4.2.pdf

 

CC mlx5_ethdev.o

  CC mlx5_mac.o

  CC mlx5_rxq.o

  CC mlx5_vlan.o

  CC mlx5_rxmode.o

  CC mlx5_mr.o

  CC mlx5_rss.o

  CC mlx5_fdir.o

  CC mlx5_stats.o

/usr/src/dpdk/drivers/net/mlx5/mlx5_mr.c:39:30: fatal error: infiniband/verbs.h: No such file or directory

#include <infiniband/verbs.h>

                              ^

compilation terminated.

make[6]: *** [mlx5_mr.o] Error 1

make[6]: *** Waiting for unfinished jobs....

/usr/src/dpdk/mk/internal/rte.compile-pre.mk:126: recipe for target 'mlx5_mr.o' failed

  CC mlx4.o

 

 

I do have the following file and is accessible. There is no other verbs.h in the system.

root@root# ls /usr/include/infiniband/verbs.h

/usr/include/infiniband/verbs.h

root@tbserver15:/usr# find . -name verbs.h

./include/infiniband/verbs.h

root@tbserver15:/usr#

MLNX_OFED_LINUX-3.4-2.0.0.0-ubuntu16.04-x86_64.iso is installed in my system.

 

And firmware version is as below.

root@root:/usr# ibstat

CA 'mlx4_0'

        CA type: MT4103

        Number of ports: 2

        Firmware version: 2.37.7190

        Hardware version: 0

 

I have extracted the DPDK package from www.mellanox.com/downloads/Drivers/MLNX_DPDK_2.2_4.2.tar.gz

 

I am using following Docker file to generate docker image.

 

FROM ubuntu:vivid

 

RUN apt-get update && apt-get install -y --no-install-recommends \

  gcc build-essential make curl git liblua5.2-dev libedit-dev libpcap-dev libncurses5-dev libncursesw5-dev  pkg-config vim \

  && apt-get clean && rm -rf /var/lib/apt/lists/*

 

ENV DPDK_VERSION=2.2.0 \

  RTE_SDK=/usr/src/dpdk \

  RTE_TARGET=x86_64-native-linuxapp-gcc \

  PROX_COMMIT=a52953c4a92ecfcfdd06fc01fce42b57f998cb10 \

  PROX_DIR=/usr/src/PROX

 

RUN curl -sSL  www.mellanox.com/downloads/Drivers/MLNX_DPDK_2.2_4.2.tar.gz | tar -xz; \

  mv MLNX_DPDK_2.2_4.2 ${RTE_SDK}

 

# don't build kernel modules

RUN sed -i s/CONFIG_RTE_EAL_IGB_UIO=y/CONFIG_RTE_EAL_IGB_UIO=n/ ${RTE_SDK}/config/common_linuxapp \

  && sed -i s/CONFIG_RTE_LIBRTE_KNI=y/CONFIG_RTE_LIBRTE_KNI=n/ ${RTE_SDK}/config/common_linuxapp \

  && sed -i s/CONFIG_RTE_LIBRTE_MLX4_PMD=n/CONFIG_RTE_LIBRTE_MLX4_PMD=y/ ${RTE_SDK}/config/common_linuxapp \

  && sed -i s/CONFIG_RTE_KNI_KMOD=y/CONFIG_RTE_KNI_KMOD=n/ ${RTE_SDK}/config/common_linuxapp

 

# don't build unnecessary stuff

RUN sed -i s/CONFIG_RTE_APP_TEST=y/CONFIG_RTE_APP_TEST=n/ ${RTE_SDK}/config/common_linuxapp \

  && sed -i s/CONFIG_RTE_TEST_PMD=y/CONFIG_RTE_TEST_PMD=n/ ${RTE_SDK}/config/common_linuxapp

 

RUN cd ${RTE_SDK} \

  && make install T=${RTE_TARGET} DESTDIR=install -j

 

RUN git config --global http.sslVerify false

 

# clone PROX from the repository

RUN git clone http://github.com/nvf-crucio/PROX.git \

  && cd PROX \

  && git checkout ${PROX_COMMIT} \

  && cd .. \

  && mv PROX ${PROX_DIR}

# build PROX

RUN cd ${PROX_DIR} \

  && make

 

WORKDIR ${PROX_DIR}/build/

 

Can some one let me know how to proceed further?


Re: How to make libvma working in chroot?

Re: MCX313A-BCCT/MCX415A-BCAT SETUP

$
0
0

You have not provided detailed information of the cable & nics (part number, PSID etc), but in general, to be able to connect properly a Mellanox CX-3 adapter to a Mellanox CX-4 adapter over an 40g optical-cable, it  requires:

  1. 1. to ensure that the QSFP 40G AOC cable is supported by both adapters (you have not specified the full details of the cable (part-number etc...)
  2. 2. to ensure compatible NIC fw & WinOF/WinOF-2 versions for each win2012R2 server edge
  3. 3. proprietary port configuration

suggesting to approach to our Mellanox website to get all the information above

http://www.mellanox.com/index.php

In addition, you can open a support-call by mailing our support@mellanox.com, place a detailed description and we'll reply to you accordingly

 

Re: MSX6025F

$
0
0

Hello Thomas,

 

I have done some research on this.

Mellanox is Partners with Hewlett Packard Enterprise, and MSX6025F-2SFS is provided by HPE and MSX6025F-1SFS provided by Mellanox.

Beside that the switches are the same.

Re: DPDK-L3FWD PROX Compilation Error :: mlx5_mr.c:39:30: fatal error: infiniband/verbs.h: No such file or directory

$
0
0

Hi Praveen,

 

If you are trying to compile it for the mlx4 driver, meaning for connectX-3 cards, you do not need the mlx5 packages.

You should set to No all the mlx5 parameters before starting the compilation.

 

Regards,

Viki

 

Re: MSX6025F

$
0
0

Hi Thomas,

 

The different between MSX6025F-1SFS to MSX6025F-2SFS is the number of PSU's coming with the switch.

Re: DPDK-L3FWD PROX Compilation Error :: mlx5_mr.c:39:30: fatal error: infiniband/verbs.h: No such file or directory

$
0
0

Hi Praveen,

If you'll still encounter any issue even after removing the mlx5 parameters, I suggest to open a new case to Mellanox support.

You can open a new support ticket by sending an email to support@mellanox.com

 

Regards,

Viki

SX6710 Keeps Shutting Down

$
0
0

I have an SX6710 in our lab - first exposure to Mellanox - and it keeps going into what I call "Jet Engine Mode" as the fans are spinning so fast it sounds like a plane ready to take off. Even though there is still power and the fans are spinning out of control, all of the ports are off and the web interface is inaccessible as well even though I can still ping the management port that the web is connected to.

 

I'm trying to parse through the logs to see if I can figure out why it is shutting down but being completely unfamiliar, I'm not making too much sense of it. When I look at the log after rebooting (I need to pull the power plugs to reboot) I can clearly see the system reboot message. When I start looking backwards from there, I can clearly find where the fan max threshold is set to 18000 and I can see statsd.ERR messages saying the Health Daemon is already performing a sweep. Searching backwards from there I can find a health.ERR showing Health Daemon  ISR scan failed.

 

Again, being brand new to Mellanox, I'd appreciate any advice or pointer to the direction I should be looking as I'm not even sure I'm in the correct rabbit hole at this point.

 

Thanks!!!


Re: DPDK-L3FWD PROX Compilation Error :: mlx5_mr.c:39:30: fatal error: infiniband/verbs.h: No such file or directory

$
0
0

Hi Viki,

 

Thanks for the support.

 

With the changes suggested by you, I have disabled the mlx5 pmd in the config file and tried to compile the code, but encountered many errors. Please find below a snippet of the same.

 

I have changed the value of CONFIG_RTE_LIBRTE_MLX5_PMD=n  in config/common_linuxapp to ensure that the MLX5 package is not taken while compiling.

 

Can you please guide me to proceed further?

 

/**************************************************************************************************************************************/

 

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3749:33: error: unused variable 'status' [-Werror=unused-variable]

  enum ibv_exp_query_intf_status status;

                                 ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3748:4: error: variable 'attr' set but not used [-Werror=unused-but-set-variable]

  } attr;

    ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3743:25: error: unused variable 'mod' [-Werror=unused-variable]

  struct ibv_exp_qp_attr mod;

                         ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3734:29: error: unused parameter 'inactive' [-Werror=unused-parameter]

    unsigned int socket, int inactive, const struct rte_eth_rxconf *conf,

                             ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c: In function 'rxq_setup_qp':

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3438:1: error: control reaches end of non-void function [-Werror=return-type]

}

^

cc1: all warnings being treated as errors

/usr/src/dpdk/mk/internal/rte.compile-pre.mk:126: recipe for target 'mlx4.o' failed

make[6]: *** [mlx4.o] Error 1

/usr/src/dpdk/mk/rte.subdir.mk:61: recipe for target 'mlx4' failed

make[5]: *** [mlx4] Error 2

/usr/src/dpdk/mk/rte.subdir.mk:61: recipe for target 'net' failed

make[4]: *** [net] Error 2

/usr/src/dpdk/mk/rte.sdkbuild.mk:77: recipe for target 'drivers' failed

make[3]: *** [drivers] Error 2

/usr/src/dpdk/mk/rte.sdkroot.mk:123: recipe for target 'all' failed

make[2]: *** [all] Error 2

/usr/src/dpdk/mk/rte.sdkinstall.mk:84: recipe for target 'pre_install' failed

make[1]: *** [pre_install] Error 2

/usr/src/dpdk/mk/rte.sdkroot.mk:98: recipe for target 'install' failed

 

/**************************************************************************************************************************************/

DPDK-L3FWD PROX Compilation Error with MLX5 params disabled

$
0
0

Hi Team,

 

This has further reference to the thread DPDK-L3FWD PROX Compilation Error :: mlx5_mr.c:39:30: fatal error: infiniband/verbs.h: No such file or directory

 

Based on the resolution provided in the above thread, I have disabled the mlx5 pmd in the config file and tried to compile the code, but encountered many errors. Please find below a snippet of the errors. To make sure that the mlx5 package is not taken, I have changed the value of CONFIG_RTE_LIBRTE_MLX5_PMD=n  in config/common_linuxapp so that its not taken while compiling.

 

Can you please guide me to proceed further?

 

/**************************************************************************************************************************************/

 

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3749:33: error: unused variable 'status' [-Werror=unused-variable]

  enum ibv_exp_query_intf_status status;

                                 ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3748:4: error: variable 'attr' set but not used [-Werror=unused-but-set-variable]

  } attr;

    ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3743:25: error: unused variable 'mod' [-Werror=unused-variable]

  struct ibv_exp_qp_attr mod;

                         ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3734:29: error: unused parameter 'inactive' [-Werror=unused-parameter]

    unsigned int socket, int inactive, const struct rte_eth_rxconf *conf,

                             ^

/usr/src/dpdk/drivers/net/mlx4/mlx4.c: In function 'rxq_setup_qp':

/usr/src/dpdk/drivers/net/mlx4/mlx4.c:3438:1: error: control reaches end of non-void function [-Werror=return-type]

}

^

cc1: all warnings being treated as errors

/usr/src/dpdk/mk/internal/rte.compile-pre.mk:126: recipe for target 'mlx4.o' failed

make[6]: *** [mlx4.o] Error 1

/usr/src/dpdk/mk/rte.subdir.mk:61: recipe for target 'mlx4' failed

make[5]: *** [mlx4] Error 2

/usr/src/dpdk/mk/rte.subdir.mk:61: recipe for target 'net' failed

make[4]: *** [net] Error 2

/usr/src/dpdk/mk/rte.sdkbuild.mk:77: recipe for target 'drivers' failed

make[3]: *** [drivers] Error 2

/usr/src/dpdk/mk/rte.sdkroot.mk:123: recipe for target 'all' failed

make[2]: *** [all] Error 2

/usr/src/dpdk/mk/rte.sdkinstall.mk:84: recipe for target 'pre_install' failed

make[1]: *** [pre_install] Error 2

/usr/src/dpdk/mk/rte.sdkroot.mk:98: recipe for target 'install' failed

 

/**************************************************************************************************************************************/

 

Thanks

Praveen

Re: MCX313A-BCCT/MCX415A-BCAT SETUP

$
0
0

Hi aviap,

 

Thank you for your response.  I am trying to connect a MC2210310-050 going from MCX313A-BBCT (Driver version: 5.22.12447.0) to MCX415A-BCAT (Driver version: 1.10.13423.0). 

 

I was able to established a link going from MCX313A-BBCT to HPE 5900 (1X40G PORT CONFIGURED) so I know there's nothing wrong with the adapter card.

 

I used the same cable going from the MCX415A-BCAT to the same HPE5900 (1X40G PORT CONFIGURED) and there wasn't any link at all. 

 

I hope this will help.  Thank you in advance.

Re: How to make libvma working in chroot?

$
0
0

no I cant. It looks like chroot need support software (I mean like connectx_config_port, etc). I installed it. And it conflicts with openibd at parent system. also I cant retake control to chrooted openibd.

Re: How to make libvma working in chroot?

$
0
0

I'll test it and reply. tested yet only on 3.4.2/1

Viewing all 6227 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>