When connecting from the Mellanox switch SN2100 (should apply to other Mellanox models) 100Gb switch you first have to split the ports. Here is how.
Ssh into the Mellanox switch. You are essentially going into the Ethernet port in question (yours may vary). In our example, we are connected to Ethernet Port 2 on the Ethernet switch. From that port, we will split the port into 4 sub ports forcing the port to 10G and disabling auto-negotiation. From here you can also enable jumbo frames on the ports. example: "interface ethernet 1/2/1-1/2/4 mtu 9000 force"
Please reference the Mellanox product manual for further instructions.
ssh@admin<IP Address>
password
- switch-68054e [standalone: master] > enable
- switch-68054e [standalone: master] # configure terminal
- switch-68054e [standalone: master] (config) # interface eth 1/2
- switch-68054e [standalone: master] (config interface ethernet 1/2) # shutdown
- switch-68054e [standalone: master] (config interface ethernet 1/2) # module-type qsfp-split-4
- the following interfaces will be unmapped: 1/2
- Type 'yes' to confirm split: yes
- switch-68054e [standalone: master] (config) # interface eth 1/2/1 speed 10G no-autoneg force
- switch-68054e [standalone: master] (config) # interface eth 1/2/2 speed 10G no-autoneg force
- switch-68054e [standalone: master] (config) # interface eth 1/2/3 speed 10G no-autoneg force
- switch-68054e [standalone: master] (config) # interface eth 1/2/4 speed 10G no-autoneg force
- switch-68054e [standalone: master] configuration write
To check the VTrak D5000 you can review the port status from our web interface under IO port or from CLI via ssh. example: ssh@administrator@<IPaddress>
Login: Administrator
Password: Password
administrator@cli> iscsi -a list -t port-------------------------------------------------------------------------------PortId: 1 CtrlId: 1Id: 1_1 IsMgmt: 0JumboFrame: Enabled PortStatus: EnabledLinkStats: Up, Active MacAddress: 00:01:55:62:93:77MaxSupportSpeed: 10000 Mbps CurrentSpeed: 10000 MbpsRelativePortals: 0-------------------------------------------------------------------------------PortId: 2 CtrlId: 1Id: 2_1 IsMgmt: 0JumboFrame: Enabled PortStatus: EnabledLinkStats: Up, Active MacAddress: 00:01:55:62:93:78MaxSupportSpeed: 10000 Mbps CurrentSpeed: 10000 MbpsRelativePortals: 1-------------------------------------------------------------------------------PortId: 1 CtrlId: 2Id: 1_2 IsMgmt: 0JumboFrame: Enabled PortStatus: EnabledLinkStats: Up, Active MacAddress: 00:01:55:62:93:79MaxSupportSpeed: 10000 Mbps CurrentSpeed: 10000 MbpsRelativePortals: 2-------------------------------------------------------------------------------PortId: 2 CtrlId: 2Id: 2_2 IsMgmt: 0JumboFrame: Enabled PortStatus: EnabledLinkStats: Up, Active MacAddress: 00:01:55:62:93:7AMaxSupportSpeed: 10000 Mbps CurrentSpeed: 10000 MbpsRelativePortals: 3
To change set Jumbo Frames from the Mellanox terminal set the MTU by going into the Ethernet ingerface in question. For more help please look up the Mellanox user:
https://www.mellanox.com/related-docs/prod_management_software/MLNX-OS_ETH_v3_6_3508_UM.pdf
Example:
switch-68054e [standalone: master] (config interface ethernet 1/2/2) # shutdown
switch-68054e [standalone: master] (config interface ethernet 1/2/2) # mtu 9000
switch-68054e [standalone: master] (config interface ethernet 1/2/2) # no shutdown
Note: Be sure to write/save your switch configuration otherwise settings will be lost after a reload/reboot.
When checking the status of the ethernet port in question you should see something similar:
switch-68054e [standalone: master] (config) # show interfaces ethernet 1/2/1
Eth1/2/1:
Admin state : Enabled
Operational state : Up
Last change in operational status: 0:11:14 ago (1 oper change)
Boot delay time : 0 sec
Description : N\A
Mac address : 50:6b:4b:9f:5d:9c
MTU : 9000 bytes (Maximum packet size 9022 bytes)
Fec : auto
Flow-control : receive off send off
Actual speed : 10 Gbps
Auto-negotiation : Disabled
Width reduction mode : Unknown
Switchport mode : access
MAC learning mode : Enabled
Forwarding mode : inherited cut-through
Telemetry sampling: Disabled TCs: N\A
Telemetry threshold: Disabled TCs: N\A
Telemetry threshold level: N\A
Last clearing of "show interface" counters: Never
60 seconds ingress rate : 104 bits/sec, 13 bytes/sec, 1 packets/sec
60 seconds egress rate : 8688 bits/sec, 1086 bytes/sec, 7 packets/sec
Rx:
121 packets
0 unicast packets
110 multicast packets
11 broadcast packets
15277 bytes
0 discard packets
0 error packets
0 fcs errors
0 undersize packets
0 oversize packets
0 pause packets
0 unknown control opcode
0 symbol errors
0 discard packets by storm control
Tx:
4709 packets
12 unicast packets
3027 multicast packets
1670 broadcast packets
737856 bytes
0 discard packets
0 error packets
0 hoq discard packets
