Inter-Tel Mitel 5000 T1/E1 PRI 580.2700 Primary Interface Module

[Only1russ]

Inter-Tel Mitel 5000 T1/E1 PRI 580.2700 Primary Interface Module REV AR

I installed a PRI about 30 days ago.
There was a storm. It knocked the area off line.
(not just us - several blocks)

The PRI will not come back up.
The PRI provider says their equipment is ok.

What log(s) do I look at, and how can I tell anything about
System Alarm 114

Do I need a new card?


[12Apr16 12:10:46] rch_app[INFO]:
====================================================================
[12Apr16 12:10:46] rch_app[INFO]: Resource Command Handler Started...
[12Apr16 12:10:46] rch_app[INFO]: tdm_to_chan_map_t: success connecting to shared memory
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0080 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0081 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0082 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0083 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0084 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0085 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0086 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0087 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0088 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0089 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 008A associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 008B associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 008C associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 008D associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 008E associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 008F associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0090 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0091 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0092 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0093 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0094 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0095 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0096 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0097 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0098 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 0099 associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 009A associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 009B associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 009C associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 009D associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 009E associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: TDM slot 009F associated with channel FFFF
[12Apr16 12:10:46] rch_app[INFO]: success attaching to shared memory: /tmp/vm
[12Apr16 12:10:46] rch_app[INFO]: Restart *not* detected
[12Apr16 12:10:46] rch_app[INFO]: CMCI ver libcmci.a-4.14.06, success opening socket to target IntMsp
[12Apr16 12:10:46] rch_app[INFO]: main() - Configuring dual-filter ECAN for internal MSP (Chagall)
[12Apr16 12:10:46] rch_app[INFO]: DSP event thread started.

[12Apr16 12:10:46] rch_app[INFO]: DSP Periodic thread started.

[12Apr16 12:10:46] rch_app[INFO]: DSP modem supervisor thread started.
[12Apr16 12:10:46] rch_app[INFO]: Country code is 0
[12Apr16 12:10:46] rch_app[INFO]: Downloading NA DSP code.
[12Apr16 12:10:46] rch_app[INFO]: Put DSP into reset
[12Apr16 12:10:46] rch_app[INFO]: dsp clear reset
[12Apr16 12:10:46] rch_app[INFO]: DSP download Verified!
[12Apr16 12:10:46] rch_app[INFO]: Send the DSP off-line messages to CP
[12Apr16 12:10:46] rch_app[INFO]: MDM_DBG *** modem_is_ready failed 10 times!
[12Apr16 12:10:46] rch_app[INFO]: DSP 1 online.
[12Apr16 12:10:46] rch_app[INFO]: LCD APP: LCD Application Started...
[12Apr16 12:10:46] rch_app[INFO]: LCD APP: pid 886
[12Apr16 12:10:46] rch_app[INFO]: LCD APP: Waiting for ONLINE from Call Processing
[12Apr16 12:10:46] rch_app[INFO]: ARM Code Version = v10_24_03_16
[12Apr16 12:10:46] rch_app[INFO]: SPU Code Version = C64V_7_8_16
[12Apr16 12:11:12] rch_app[INFO]: Creating thread to process sysq messages
[12Apr16 12:11:13] rch_app[ERR]: set_exim_satellite() - Error enabling smtp authentication
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00bd fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00be fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00c2 fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00c3 fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00c8 fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00c9 fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00cb fw: 3 main:
[12Apr16 12:11:15] rch_app[ERR]: cd_get_endpoint_version() - Invalid library args id: 0 dt: 0x00cc fw: 3 main:
[12Apr16 12:11:44] rch_app[ERR]: error response rcvd from target IntMsp, channel 65535, fcode 0x1
result_code: 0xa1a index: 17 cmd_type: 121 cmd_class: 194
[12Apr16 12:11:54] rch_app[INFO]: LCD APP: Received ONLINE from CP
[12Apr16 12:11:54] rch_app[INFO]: rsc_cmd_hdlr_t::initialize() - Requesting Country.
[12Apr16 12:11:54] rch_app[INFO]: LCD APP: Requesting system version from CP
[12Apr16 12:11:55] rch_app[INFO]: Country code is 0
[12Apr16 12:11:55] rch_app[INFO]: Downloading NA DSP code.
[12Apr16 12:11:55] rch_app[INFO]: Put DSP into reset
[12Apr16 12:11:55] rch_app[INFO]: dsp clear reset
[12Apr16 12:11:55] rch_app[INFO]: DSP download Verified!
[12Apr16 12:11:55] rch_app[INFO]: Send the DSP off-line messages to CP
[12Apr16 12:11:55] rch_app[INFO]: rsc_cmd_hdlr_t::ccc_rsc_country_response: Country is 0.
[12Apr16 12:11:55] rch_app[INFO]: MDM_DBG *** modem_is_ready failed 10 times!
[12Apr16 12:11:55] rch_app[INFO]: DSP 1 online.
[12Apr16 12:11:55] rch_app[INFO]: LCD APP: Requesting system type from CP
[12Apr16 12:11:56] rch_app[INFO]: LCD APP: Requesting system alarms from CP
[12Apr16 12:11:56] rch_app[INFO]: LCD APP: Registered to recieve system alarms from CP
[12Apr16 12:11:56] rch_app[ERR]: error response rcvd from target IntMsp, channel 65535, fcode 0x425
result_code: 0x4f index: 24 cmd_type: 2 cmd_class: 6
[12Apr16 12:11:56] rch_app[ERR]: error response rcvd from target IntMsp, channel 65535, fcode 0x425
result_code: 0x4f index: 26 cmd_type: 2 cmd_class: 6
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0060 with TDM slot 0080
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0061 with TDM slot 0081
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0062 with TDM slot 0082
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0063 with TDM slot 0083
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0064 with TDM slot 0084
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0065 with TDM slot 0085
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0066 with TDM slot 0086
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0067 with TDM slot 0087
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0068 with TDM slot 0088
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0069 with TDM slot 0089
[12Apr16 12:11:57] rch_app[INFO]: associating channel 006A with TDM slot 008A
[12Apr16 12:11:57] rch_app[INFO]: associating channel 006B with TDM slot 008B
[12Apr16 12:11:57] rch_app[INFO]: associating channel 006C with TDM slot 008C
[12Apr16 12:11:57] rch_app[INFO]: associating channel 006D with TDM slot 008D
[12Apr16 12:11:57] rch_app[INFO]: associating channel 006E with TDM slot 008E
[12Apr16 12:11:57] rch_app[INFO]: associating channel 006F with TDM slot 008F
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0070 with TDM slot 0090
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0071 with TDM slot 0091
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0072 with TDM slot 0092
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0073 with TDM slot 0093
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0074 with TDM slot 0094
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0075 with TDM slot 0095
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0076 with TDM slot 0096
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0077 with TDM slot 0097
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0078 with TDM slot 0098
[12Apr16 12:11:57] rch_app[INFO]: associating channel 0079 with TDM slot 0099
[12Apr16 12:11:57] rch_app[INFO]: associating channel 007A with TDM slot 009A
[12Apr16 12:11:57] rch_app[INFO]: associating channel 007B with TDM slot 009B
[12Apr16 12:11:57] rch_app[INFO]: associating channel 007C with TDM slot 009C
[12Apr16 12:11:57] rch_app[INFO]: associating channel 007D with TDM slot 009D
[12Apr16 12:11:57] rch_app[INFO]: associating channel 007E with TDM slot 009E
[12Apr16 12:11:57] rch_app[INFO]: associating channel 007F with TDM slot 009F

         

[Only1russ]

There are too many different logs to see that all seem to have some reference to this:

which one is best?

and can the pri card just "go bad"?





alarm log:

Apr 11 05:58:42 CATAR5000 CP[925]: A010 ALARM  '1110' - MRO Is Off Hook
Apr 11 05:59:01 CATAR5000 CP[925]: Alarm 10 Automatically Cleared
Apr 11 05:59:01 CATAR5000 CP[925]: A000 ALARM  Alarm Automatically Cleared
Apr 11 08:26:56 CATAR5000 CP[925]: A010 ALARM  '1123' - CAT1123 Is Off Hook
Apr 11 08:29:17 CATAR5000 CP[925]: Alarm 10 Automatically Cleared
Apr 11 08:29:17 CATAR5000 CP[925]: A000 ALARM  Alarm Automatically Cleared
Apr 11 11:23:10 CATAR5000 CP[925]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 11 11:23:52 CATAR5000 CP[925]: Alarm 114 Automatically Cleared
Apr 11 11:23:52 CATAR5000 CP[925]: A002 ALARM  Network Alarm Automatically Cleared
Apr 11 11:24:02 CATAR5000 CP[925]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 11 11:25:19 CATAR5000 CP[925]: Alarm 114 Manually Cleared by 1102
Apr 11 11:25:19 CATAR5000 CP[925]: A001 ALARM  Alarm Manually Cleared By '1102'
Apr 11 16:36:13 CATAR5000 CP[925]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 11 16:36:50 CATAR5000 CP[925]: Alarm 114 Manually Cleared by 1102
Apr 11 16:36:50 CATAR5000 CP[925]: A001 ALARM  Alarm Manually Cleared By '1102'
Apr 11 16:39:13 CATAR5000 CP[900]: System Reset Type = 'Reset Due To Termination Signal'
Apr 11 16:39:27 CATAR5000 DEI[1123]: M999 dei: 6.0.77
Apr 11 16:40:07 CATAR5000 CP[900]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 11 16:41:51 CATAR5000 CP[900]: Alarm 114 Manually Cleared by 1102
Apr 11 16:41:52 CATAR5000 CP[900]: A001 ALARM  Alarm Manually Cleared By '1102'
Apr 11 16:46:53 CATAR5000 CP[900]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 11 17:36:57 CATAR5000 CP[901]: System Reset Type = 'Code Change'
Apr 11 17:37:08 CATAR5000 DEI[1074]: M999 dei: 6.0.77
Apr 11 17:37:31 CATAR5000 CP[901]: A000 ALARM  Alarm Automatically Cleared
Apr 11 17:38:13 CATAR5000 CP[1212]: System Reset Type = 'Database Restore Complete'
Apr 11 17:38:27 CATAR5000 DEI[1320]: M999 dei: 6.0.77
Apr 11 17:38:29 CATAR5000 CP[1212]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 12 09:27:45 CATAR5000 CP[900]: System Reset Type = 'Reset Due To Termination Signal'
Apr 12 09:28:00 CATAR5000 DEI[1135]: M999 dei: 6.0.77
Apr 12 09:35:44 CATAR5000 CP[900]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 12 10:57:54 CATAR5000 CP[900]: A010 ALARM  '1110' - MRO Is Off Hook
Apr 12 10:57:56 CATAR5000 CP[900]: Alarm 10 Automatically Cleared
Apr 12 10:57:56 CATAR5000 CP[900]: A000 ALARM  Alarm Automatically Cleared
Apr 12 12:11:04 CATAR5000 CP[901]: System Reset Type = 'Reset Due To Termination Signal'
Apr 12 12:11:18 CATAR5000 DEI[1114]: M999 dei: 6.0.77
Apr 12 12:11:58 CATAR5000 CP[901]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 12 12:16:24 CATAR5000 CP[901]: Alarm 114 Automatically Cleared
Apr 12 12:16:24 CATAR5000 CP[901]: A002 ALARM  Network Alarm Automatically Cleared
Apr 12 12:16:34 CATAR5000 CP[901]: A114 ALARM  T1/E1/PRI Module (T1M) 3 Port 1 In Red Alarm
Apr 12 14:13:14 CATAR5000 CP[901]: Alarm 114 Manually Cleared by 1102
Apr 12 14:13:14 CATAR5000 CP[901]: A001 ALARM  Alarm Manually Cleared By '1102'

         

[DND ON]

Loop up the smart jack, check to see if the errors on the CO side clear. Loop up the PRI card, check to see if the PBX errors clear.

That should get you stasrted down the right path.

[Tech Electronics]

Only1russ,

I never like seeing this error as it usually means there is a high probability of corruption in the database; especially if it happens a lot. I have seen this on several systems where the power has been less than stable or the system resets repeatedly.

Apr 11 17:36:57 CATAR5000 CP[901]: System Reset Type = 'Code Change'

I would perform a database test and then I would try deleting the T-1 card and recreating it if you are able to loop up both sides as DND ON suggested. If that doesn't fix it then you may need to replace the T-1 card.

Sorry,

TE

[Only1russ]

THANKS!

I used a RJ45, created a loop back and confirmed there were no issues with Mitel.
The issue was with the ADTran 908E - the unit worked, the configs were good, but the ports were fried.

The logs were showing an error, but it was hard to track down, but the loop back simply proved that the Mitel worked, with no errors, then we were able to focus on the PRI provider's equipment!

THANKS!

-- Russ T.

[DND ON]

Cool. Keep an eye on the log files for a few days. Hopefully the system reset was caused by the processor getting slammed by T1 errors, and not a database corruption like TE mentioned.