Host Engineering Forum

General Category => Do-more CPUs and Do-more Designer Software => Topic started by: ryanastiefes on June 27, 2022, 04:28:55 PM

Title: $Main failure!
Post by: ryanastiefes on June 27, 2022, 04:28:55 PM
Came back from vacation today to find a PLC I installed and had been running for about two months Halted due to a critical error. In the system status I have no error messages just warnings but located in the ERR: box it shows "$Main failure!". DST51 =1 before I put the PLC back in run mode. I have a PLC Image that I captured to further troubleshoot and have not rebooted the plc neither.

PLC = BX-DM1E-36ER-3-D
OS = 2.9.3
Booter = 1.1.0

Any thoughts?

Title: Re: $Main failure!
Post by: Controls Guy on June 27, 2022, 05:04:37 PM
DST51 includes the following:  'watchdog timeout, memory error, I/O Error - configuration or mapping - typically happens if the I/O layout changed, Ethernet I/O Master detected an error (usually a missing slave or the I/O layout in a slave has changed)'

Check this thread, you might have the same issue https://forum.hosteng.com/index.php?topic=3661.0
Title: Re: $Main failure!
Post by: BobO on June 27, 2022, 05:10:49 PM
Came back from vacation today to find a PLC I installed and had been running for about two months Halted due to a critical error. In the system status I have no error messages just warnings but located in the ERR: box it shows "$Main failure!". DST51 =1 before I put the PLC back in run mode. I have a PLC Image that I captured to further troubleshoot and have not rebooted the plc neither.

PLC = BX-DM1E-36ER-3-D
OS = 2.9.3
Booter = 1.1.0

Any thoughts?

We had a case where a data escape was overwriting $Main (it was a SERIO module DMX issue). We fixed the issue but added the runtime check to make sure that if $Main ever got shut down, we would go fatal.

Don't know of anything else that could cause it, unless a MEMCLEAR or some other heavy handed memory operation is getting loose. We had cases where C-mores would write beyond the end of strings, which could overwrite things, but I thought that got fixed a while ago.

Might be interesting to look at the warnings and see if there are any hints there.


Title: Re: $Main failure!
Post by: ryanastiefes on June 27, 2022, 05:19:33 PM
What warnings should I be looking at? I want to put this back into operation but I'm hesitant.
Title: Re: $Main failure!
Post by: ryanastiefes on June 27, 2022, 05:23:10 PM
I have a POM module RS232/RS485 other than that it's bone stock. What registers should I be monitoring to give me a better perspective on whats happening?
Title: Re: $Main failure!
Post by: BobO on June 27, 2022, 05:41:49 PM
What warnings should I be looking at? I want to put this back into operation but I'm hesitant.

Nothing in particular, just curious what they are. If it's comm failures, that's a non-issue, but other warnings might be suggestive of programming errors. Specifically what we are checking is whether the .Running bit of $Main has been cleared, which should never happen.

I know of nothing other than the DMX512 issue that could ever trigger it, but we felt like it was a good check to leave in. In that case the issue was an I/O module returning a length value was well beyond the buffer space, and the I/O driver was blindly copying the wrong length. We fixed it two different ways, and as far as I'm aware, it's never occurred again.

We just released 2.9.5. You might want to upgrade.

Title: Re: $Main failure!
Post by: Controls Guy on June 27, 2022, 05:50:53 PM
ADC hasn't updated the download page yet.
Title: Re: $Main failure!
Post by: BobO on June 27, 2022, 05:55:48 PM
ADC hasn't updated the download page yet.

No, but I think we added the firmware to live update.
Title: Re: $Main failure!
Post by: Controls Guy on June 27, 2022, 06:04:50 PM
Sorry, thought you were talking about DMD.   Yeah, live update notified me about firmware 2.9.5 this morning.
Title: Re: $Main failure!
Post by: ryanastiefes on June 27, 2022, 06:09:08 PM
Any system tags I should be monitoring from here on out. I would hate for this to happen again and not have any explanation as to what happened. I've updated the firmware to 2.9.5
Title: Re: $Main failure!
Post by: BobO on June 27, 2022, 06:16:59 PM
Any system tags I should be monitoring from here on out. I would hate for this to happen again and not have any explanation as to what happened. I've updated the firmware to 2.9.5

I know of no reason why it should happen to start with, so there isn't really anything I can tell you to monitor. My question regarding warnings was to see if there was anything there that might suggest what is going on.
Title: Re: $Main failure!
Post by: ryanastiefes on June 27, 2022, 06:28:28 PM
The only warning I get is about the two analog channels I'm not using. Other than that nothing
Title: Re: $Main failure!
Post by: ryanastiefes on June 28, 2022, 02:49:25 PM
Found another controller today with the same issue, $Main Failure!. What could be causing this?
Title: Re: $Main failure!
Post by: BobO on June 28, 2022, 04:08:27 PM
Found another controller today with the same issue, $Main Failure!. What could be causing this?

I don't know. You are the first report since we added the check in 2.9.1 for DMX512 case I described.

Has something changed lately?
Title: Re: $Main failure!
Post by: BobO on June 28, 2022, 04:10:46 PM
And if you are willing to send your program to us, we're happy to look through it.
Title: Re: $Main failure!
Post by: ryanastiefes on June 28, 2022, 06:22:22 PM
Thanks, what email would you like me to send the image to?
Title: Re: $Main failure!
Post by: BobO on June 28, 2022, 09:52:57 PM
Thanks, what email would you like me to send the image to?

support@hosteng.com
Title: Re: $Main failure!
Post by: ryanastiefes on June 29, 2022, 01:08:01 PM
Sent.
Thanks for taking a look!