Net3 ACN Gateway Crashing - N34G-4OUT

Hey All,

I'm a dealer as well as a freelancer here in Chicago.

Today I'm out at the set of Empire Season 2 helping them shoot a couple of shots in studio.  They are having an issue that I need help troubleshooting.  I sold them the hardware (new Ion, new gateway, and a bunch of other things) around June of this year, so I have a number of vested interests in getting this fixed for them.

They have this gateway setup on a very simple network:  Netgear Prosafe Switch FS108P, Ion 2k, Airport WAP (for Ipad Mini), and this NET3 gateway.  They have an identical setup for some other stages here and are experiencing the same crashing issues.  These rigs are outputting between 600 and 1200 addresses depending on which stage they are on on a given day.  They are on for an average of 15 hours a day, and 5 or 6 days a week, and are power cycled at least once a day, usually twice a day (during moves).

4 times since July 1 they have had a gateway just completely drop connection to the consoles.  The gateway doesn't loose power, it shows as not having connectivity to the console (all four ports flashing).  They have cycled power on the entire control rig (including switches and consoles) and had it come back up.  This isn't during fades, large changes or anything.  Just sitting idle for hours, and then bang, nothing.  I'm not clear if the dimmers maintain state or turn off, but I can find out if that would inform the situation.

Today being a shooting day, there isn't much I can do to troubleshoot, or really even poke around in the GCE.  However, what should I have them look for?

The first things I thought of to check is:

Turn off RDM

Check ethernet cables

Ensure static IPs

Cycle power routinely (but they say they do already)

What else should I recommend.  It is a pretty new node, and in fact, if I had to guess, it likely isn't the node that is the issue.  To me it sounds like a networking issue.  The FS108P is unmanaged, but either way if it was working great, I wouldn't think that switch would dump connectivity for no reason.

Also, this happens to both rigs, which are both almost completely new, so it sounds like a config issue more than an anomaly.  Is there a firmware update for these gateways?  What else am I missing.

Tech support, if you want to reach out, I can send SNs, software versions, or whatever else you might want to know.

Thanks all,

Casey

Parents
  • Hi Casey,

    can you list following Information for each product:

    1a.) Ion IP:

    Subnet Mask:

    Default Gateway:

    1b.) Gateway IP:

    Subnet Mask:

    Default Gateway

    1c.) Airport WAP IP:

    Subnet Mask

    Default Gateway

    1d.) Ipad Mini IP:

    Subnet Mask:

    Default Gateway:

    2.) What protocols are enabled in Ion?

    3.) What Eos Software is installed on Ion ? Eos v2.3.1?

    4.) What Firmware is installed on Net3 Gateway? v6.0.1 is current - best to Update Gateways to this (with UpdaterAtor)

    5.) Do all Show files do this? Could you mail me a copy of one of the Showfiles? cc (a-t) etcconnect (d-ot) com

    6.) Gateway is getting power from PSU or only PoE from Switch?

    7.) Could you send the Ion logs and date/time when such a drop out happened?

    Good Luck!

  • Hey Corey,
    I'll send you what I can now. The rest might have to come later when we aren't shooting (edit: I'll edit this with more info as it becomes available)

    1a.) Ion IP: 10.101.100.101 (static)

    Subnet Mask: can't check now

    Default Gateway: can't check now

    1b.) Gateway IP: 10.101.50.101  (it is set to get an IP from DHCP (from the console, I presume).  Also has set to maintain IP on reboot.)

    Subnet Mask:  255.255.0.0

    Default Gateway  0.0.0.0

    ---It also has set the update IP to be 10.101.100.101 so that they can update the software from the console, I presume---


    1c.) Airport WAP IP: 10.101.50.104

    Subnet Mask 255.255.0.0

    Default Gateway can't check now

    1d.) Ipad Mini IP: DHCP from Airport WAP

    Subnet Mask: 255.255.0.0

    Default Gateway:

    2.) What protocols are enabled in Ion? Only sACN and DMX

    3.) What Eos Software is installed on Ion ? v2.2.1 I don't know why they haven't updated yet. I'll ask.

    4.) What Firmware is installed on Net3 Gateway? v6.0.1 is current - best to Update Gateways to this (with UpdaterAtor) v6.0.1.9.0.4

    5.) Do all Show files do this? Could you mail me a copy of one of the Showfiles? cc (a-t) etcconnect (d-ot) com I'll ask for permission to do so.

    6.) Gateway is getting power from PSU or only PoE from Switch? PoE from switch. That switch has a budget of 53W and the gateway is the only device it is powering via PoE.

    7.) Could you send the Ion logs and date/time when such a drop out happened? I cannot, but have asked that if it happens again that they do so.

    EDIT: Updated 10:13am with GCE details.  Also, they had RDM enabled on all ports.  I disabled it.  And I got permission to send over the show file so I will do so now.

Reply
  • Hey Corey,
    I'll send you what I can now. The rest might have to come later when we aren't shooting (edit: I'll edit this with more info as it becomes available)

    1a.) Ion IP: 10.101.100.101 (static)

    Subnet Mask: can't check now

    Default Gateway: can't check now

    1b.) Gateway IP: 10.101.50.101  (it is set to get an IP from DHCP (from the console, I presume).  Also has set to maintain IP on reboot.)

    Subnet Mask:  255.255.0.0

    Default Gateway  0.0.0.0

    ---It also has set the update IP to be 10.101.100.101 so that they can update the software from the console, I presume---


    1c.) Airport WAP IP: 10.101.50.104

    Subnet Mask 255.255.0.0

    Default Gateway can't check now

    1d.) Ipad Mini IP: DHCP from Airport WAP

    Subnet Mask: 255.255.0.0

    Default Gateway:

    2.) What protocols are enabled in Ion? Only sACN and DMX

    3.) What Eos Software is installed on Ion ? v2.2.1 I don't know why they haven't updated yet. I'll ask.

    4.) What Firmware is installed on Net3 Gateway? v6.0.1 is current - best to Update Gateways to this (with UpdaterAtor) v6.0.1.9.0.4

    5.) Do all Show files do this? Could you mail me a copy of one of the Showfiles? cc (a-t) etcconnect (d-ot) com I'll ask for permission to do so.

    6.) Gateway is getting power from PSU or only PoE from Switch? PoE from switch. That switch has a budget of 53W and the gateway is the only device it is powering via PoE.

    7.) Could you send the Ion logs and date/time when such a drop out happened? I cannot, but have asked that if it happens again that they do so.

    EDIT: Updated 10:13am with GCE details.  Also, they had RDM enabled on all ports.  I disabled it.  And I got permission to send over the show file so I will do so now.

Children
  • Corey and I are working through this via email. It sounds like a number of small setup issues working together to occasionally create IP address problems. I think the largest solution will be to change everything to static IPs, but there are a few other small suggestions Corey gave us to put the network more in line with best practices.

    I just wanted to post back here that we are getting the support that we needed.
Related