News:

  • September 25, 2026, 04:31:10 AM

Login with username, password and session length

« previous next »
Pages: 1 [2] 3

Author Topic: BRX Email Stopped Working  (Read 43965 times)

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #15 on: June 11, 2020, 12:54:23 PM »
Quote from: BobO on June 11, 2020, 12:19:07 PM
It's a fundamental network/routing thing. The program shouldn't be a factor.

Weird.  It worked for so long, and I haven't messed with the router settings at all in 6 weeks.
I'm pretty sure my switch does not support port mirroring, would have to figure out how to do it in my router.
Logged

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #16 on: June 11, 2020, 01:12:21 PM »
Quote from: Bolt on June 11, 2020, 12:54:23 PM
Weird.  It worked for so long, and I haven't messed with the router settings at all in 6 weeks.
I'm pretty sure my switch does not support port mirroring, would have to figure out how to do it in my router.

I'd cycle the power to any switches and routers. They sometimes get tummy aches.
Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #17 on: June 12, 2020, 12:19:42 PM »
Quote from: BobO on June 11, 2020, 01:12:21 PM
I'd cycle the power to any switches and routers. They sometimes get tummy aches.

No luck there.

Today the PLC started acting even funnier, after hanging up on some Modbus TCP reads it lost after power cycling some of the network's access points.

I finally got to a point in the process where I could preform a physical Term -> Stop, Power Down, wait, Power Up, Stop -> Run -> Term.  (Yesterday I only quickly did a Run to Stop transition while re-submitting the @Email Device settings).

Emails started rolling through after that...

Any ideas what could cause this spiral out of control?
Logged

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #18 on: June 12, 2020, 01:18:18 PM »
There are cases where the controller can run out of stack buffers due to high network loads. It tries to clean things up, but it isn't always 100%. If you see $CommStackOverrn (ST146) or $QueuesFlushed (ST145) set, that's what's happened. You can also get clues of ugly network situations from $EthDroppedPkts (DST40) and $EthStoppedIntr (DST41). If you start seeing weirdness, check these.
Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #19 on: June 12, 2020, 01:37:27 PM »
Dang, I wished I would have checked those before power cycling.
Logged

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #20 on: June 12, 2020, 06:39:45 PM »
Quote from: Bolt on June 12, 2020, 01:37:27 PM
Dang, I wished I would have checked those before power cycling.

Generally, none of these are issues. When PLCs are connected to more public networks, inevitably weird network traffic can show up. These locations can give insight into what might be happening.
Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #21 on: August 20, 2020, 12:37:03 PM »
Quote from: Bolt on June 12, 2020, 12:19:42 PM
... preform a physical Term -> Stop, Power Down, wait, Power Up, Stop -> Run -> Term.  ....

I had to do this again today to remedy the SMTP not working
Logged

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #22 on: August 20, 2020, 01:32:27 PM »
Quote from: Bolt on August 20, 2020, 12:37:03 PM
Quote from: Bolt on June 12, 2020, 12:19:42 PM
... preform a physical Term -> Stop, Power Down, wait, Power Up, Stop -> Run -> Term.  ....

I had to do this again today to remedy the SMTP not working

Quote
There are cases where the controller can run out of stack buffers due to high network loads. It tries to clean things up, but it isn't always 100%. If you see $CommStackOverrn (ST146) or $QueuesFlushed (ST145) set, that's what's happened. You can also get clues of ugly network situations from $EthDroppedPkts (DST40) and $EthStoppedIntr (DST41). If you start seeing weirdness, check these.

You didn't check these did you?

Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #23 on: August 20, 2020, 03:39:33 PM »
No..  I noticed there was a production window in which I could shutdown the PLC, and I ran with that, before I re-read this thread and saw what I needed to check first.  Oops.
Logged

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #24 on: October 08, 2020, 05:34:21 PM »
Happened again this morning.  DMLogger shows at last email attempt:
Code: [Select]
Port 29298(0x7272),10/08/20 10:51:53.377 ,"TCP connection failed or was unexpectedly closed in EMAIL @0000116F"

Port 29298(0x7272),10/08/20 10:51:53.376 ,"SMTP disconnected!"

Port 29298(0x7272),10/08/20 10:51:53.376 ,"Server connection lost. Shutting down..."
Currently, the following bits are:

DST40 $EthDroppedPkts == 35
DST41 $EthStoppedIntr == 0
ST145 $QueuesFlushed == OFF
ST146 $CommStackOverrn == OFF
Logged

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #25 on: October 08, 2020, 06:08:01 PM »
Quote from: Bolt on October 08, 2020, 05:34:21 PM
Happened again this morning.  DMLogger shows at last email attempt:
Code: [Select]
Port 29298(0x7272),10/08/20 10:51:53.377 ,"TCP connection failed or was unexpectedly closed in EMAIL @0000116F"

Port 29298(0x7272),10/08/20 10:51:53.376 ,"SMTP disconnected!"

Port 29298(0x7272),10/08/20 10:51:53.376 ,"Server connection lost. Shutting down..."
Currently, the following bits are:

DST40 $EthDroppedPkts == 35
DST41 $EthStoppedIntr == 0
ST145 $QueuesFlushed == OFF
ST146 $CommStackOverrn == OFF

That sounds like the server is dropping the connection, but everything looks fine. Not sure why the server would do that.
Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO

Bolt

  • Hero Member
  • *****
  • Posts: 598
Re: BRX Email Stopped Working
« Reply #26 on: October 08, 2020, 07:46:59 PM »
Well, without further user input subsequent emails started rolling again, I think it only didn't send the one in question at 10:51.  Sorry, I didn't specifically try to send a test email before posting.

In such a scenario, do you reckon it activates the EMAIL instruction's On Error JMP to Stage function?
Logged

Controls Guy

  • Internal Dev
  • Hero Member
  • ****
  • Posts: 3626
  • Darth Ladder
Re: BRX Email Stopped Working
« Reply #27 on: October 08, 2020, 09:37:17 PM »
Quote from: BobO on October 08, 2020, 06:08:01 PM
That sounds like the server is dropping the connection, but everything looks fine. Not sure why the server would do that.

Could BRX interpret slow/glitchy interwebs connection as a server hangup?
Logged
I retract my earlier statement that half of all politicians are crooks.  Half of all politicians are NOT crooks.  There.

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #28 on: October 09, 2020, 12:00:57 AM »
Quote from: Bolt on October 08, 2020, 07:46:59 PM
In such a scenario, do you reckon it activates the EMAIL instruction's On Error JMP to Stage function?

Yes.
Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO

BobO

  • Host Moderator
  • Hero Member
  • *****
  • Posts: 6176
  • Yes Pinky, Do-more will control the world!
Re: BRX Email Stopped Working
« Reply #29 on: October 09, 2020, 12:03:26 AM »
Quote from: Controls Guy on October 08, 2020, 09:37:17 PM
Could BRX interpret slow/glitchy interwebs connection as a server hangup?

Maybe, but TCP timeouts are quite long. This sounds more like the server terminated the connection, but it is impossible to know for certain without a Wireshark packet trace.
Logged
"It has recently come to our attention that users spend 95% of their time using 5% of the available features. That might be relevant." -BobO
Pages: 1 [2] 3
« previous next »