I have just installed a Mikrotik CRS504 switch on my network to add 100GB connections between a desktop and storage server. I have run the fiber for the server and am getting links at both ends, but the server is not picking up an IP address on the server NIC for the 100GB card and I cannot figure out why. This is my first MikroTik switch and first venture into fiber and have spent the past several weeks trying to figure out why this won't work. What should I be looking at to resolve this issue?
Details:
Netgate 6100 (WAN, DHCP server) -> Netgear X728T Switch -> Mikrotik CRS504
The Mikrotik switch is connected to the Netgear switch via a 100GB breakout DAC cable to three of the 10GB SFP ports (fourth cable is not connected to anything.) The CRS504 can get to the Internet and I just updated the CRS504 switch to 7.13.1 today. It is in Bridge mode has a static IP address of 192.168.0.2 (/24) with a Gateway and DNS server set to 192.168.0.1 (which is the IP of the Netgate 6100.) The Netgear switch is connected to the Netgate 6100.
The server is connected to the Netgear switch via two embedded NICs currently which are set to DHCP and both pick up IP addresses. I've added a Mellanox ConnectX-4 VPI 100GB card to the server. I've updated the card to the latest firmware and changed the port to ETH via the Mellanox tools in another Linux server because of the issue of adding packages to this server (Truenas Scale.) I can see in iDRAC, TrueNAS dashboard and on the card that is has a link to the Mikrotik switch, but it does not pick up an IP address.
The distance between the CRS504 and the server is 55', I'm using a 20 meter 12 Fiber OM4 50/125 Multimode Trunk Cable to connect the server to the switch. I'm using QSFP28-SR4-100G transceivers on both switch and server.
Thanks for any assistance.
Details:
Netgate 6100 (WAN, DHCP server) -> Netgear X728T Switch -> Mikrotik CRS504
The Mikrotik switch is connected to the Netgear switch via a 100GB breakout DAC cable to three of the 10GB SFP ports (fourth cable is not connected to anything.) The CRS504 can get to the Internet and I just updated the CRS504 switch to 7.13.1 today. It is in Bridge mode has a static IP address of 192.168.0.2 (/24) with a Gateway and DNS server set to 192.168.0.1 (which is the IP of the Netgate 6100.) The Netgear switch is connected to the Netgate 6100.
The server is connected to the Netgear switch via two embedded NICs currently which are set to DHCP and both pick up IP addresses. I've added a Mellanox ConnectX-4 VPI 100GB card to the server. I've updated the card to the latest firmware and changed the port to ETH via the Mellanox tools in another Linux server because of the issue of adding packages to this server (Truenas Scale.) I can see in iDRAC, TrueNAS dashboard and on the card that is has a link to the Mikrotik switch, but it does not pick up an IP address.
The distance between the CRS504 and the server is 55', I'm using a 20 meter 12 Fiber OM4 50/125 Multimode Trunk Cable to connect the server to the switch. I'm using QSFP28-SR4-100G transceivers on both switch and server.
Thanks for any assistance.
Statistics: Posted by russ13gifford — Thu Jan 11, 2024 6:46 pm