| Key | Time
(last) | Node | PID | User | Severity | Process | Error | Ticket Generated
(Condition/Type) | Additional Information |
|
1214779899.95 | 2008-Jun-29 17:51:39 (2008-Jul-05 10:51:50) | stkensrv3 | 16325 | enstore | E (123) | INVENTORY | Too many mounts | | {'text': 'VO9711 (9940B) exceeds 2000 mounts'} |
|
1215013892.63 | 2008-Jul-02 10:51:32 (2008-Jul-05 10:51:50) | stkensrv3 | 14389 | enstore | E (67) | INVENTORY | Too many mounts | | {'text': 'VO9657 (9940B) exceeds 2000 mounts'} |
|
1215108153.27 | 2008-Jul-03 13:02:33 (2008-Jul-05 08:55:22) | stkensrv3 | 24306 | root | W (15) | ALARM_CLIENT | Swap_utilization_between_20_and_30% | | {'text': ''} |
|
1215264893.24 | 2008-Jul-05 08:34:53 (2008-Jul-05 08:34:53) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOJ998 | | {'text': {}} |
|
1215193092.4 | 2008-Jul-04 12:38:12 (2008-Jul-05 08:24:10) | stkensrv3 | 29023 | enstore | A (2) | LTO4G1LM | The mover LTO4_45.mover is in state SEEK for 21 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215264163.08 | 2008-Jul-05 08:22:43 (2008-Jul-05 08:22:43) | stkenmvr145a | 24433 | root | W (1) | LTO4_45MV | Too long in state SEEK for VOJ998. Client host cmsstor70.fnal.gov | | {'text': {}} |
|
1215159205.74 | 2008-Jul-04 03:13:25 (2008-Jul-05 08:11:37) | stkensrv0 | 2751 | root | W (10) | ALARM_CLIENT | Average_cpu_load_is_between_3_and_4_during_last_15_min | | {'text': ''} |
|
1212559628.01 | 2008-Jun-04 01:07:08 (2008-Jul-05 07:07:11) | stkensrv0 | 30634 | root | A (121) | ALARM_CLIENT | BAD CONFIGURATION: Farmlet mismatch NSAM=0 NSTK=0 NCDF=2 NENS=0 | | {'text': ''} |
|
1215256810.28 | 2008-Jul-05 06:20:10 (2008-Jul-05 06:20:10) | stkensrv3 | 29023 | enstore | A (1) | LTO4G1LM | The mover LTO4_47.mover is in state SEEK for 21 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215256702.05 | 2008-Jul-05 06:18:22 (2008-Jul-05 06:18:22) | stkenmvr147a | 17551 | root | W (1) | LTO4_47MV | Too long in state SEEK for VOL192. Client host cmsstor67.fnal.gov | | {'text': {}} |
|
1215108339.32 | 2008-Jul-03 13:05:39 (2008-Jul-05 00:55:49) | stkensrv3 | 30529 | root | W (4) | ALARM_CLIENT | Swap_utilization_exceeds_30% | | {'text': ''} |
|
1214686358.79 | 2008-Jun-28 15:52:38 (2008-Jul-04 21:30:39) | stkensrv3 | 1134 | enstore | A (2) | LTO4G1LM | The mover LTO4_45.mover is in state SEEK for 20 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215225027.53 | 2008-Jul-04 21:30:27 (2008-Jul-04 21:30:27) | stkenmvr145a | 24433 | root | W (1) | LTO4_45MV | Too long in state SEEK for VOL174. Client host cmsstor75.fnal.gov | | {'text': {}} |
|
1215128223.31 | 2008-Jul-03 18:37:03 (2008-Jul-04 18:52:04) | stkensrv0 | 9171 | root | I (2) | ALARM_CLIENT | No lost+found for /diskb | | {'text': ''} |
|
1215128223.04 | 2008-Jul-03 18:37:03 (2008-Jul-04 18:52:04) | stkensrv0 | 9167 | root | I (2) | ALARM_CLIENT | No lost+found for /diska | | {'text': ''} |
|
1215099709.3 | 2008-Jul-03 10:41:49 (2008-Jul-04 16:28:51) | stkensrv2 | 11958 | enstore | E (14) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_50.mover'}} |
|
1215099837.75 | 2008-Jul-03 10:43:57 (2008-Jul-04 16:28:28) | stkensrv2 | 11958 | enstore | E (12) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_46.mover'}} |
|
1215099817.34 | 2008-Jul-03 10:43:37 (2008-Jul-04 16:28:27) | stkensrv2 | 11958 | enstore | E (10) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_45.mover'}} |
|
1215099817.26 | 2008-Jul-03 10:43:37 (2008-Jul-04 16:28:01) | stkensrv2 | 11958 | enstore | E (15) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_47.mover'}} |
|
1215099688.54 | 2008-Jul-03 10:41:28 (2008-Jul-04 16:28:01) | stkensrv2 | 11958 | enstore | E (14) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_41.mover'}} |
|
1215099773.76 | 2008-Jul-03 10:42:53 (2008-Jul-04 16:27:40) | stkensrv2 | 11958 | enstore | E (14) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_43.mover'}} |
|
1215099773.61 | 2008-Jul-03 10:42:53 (2008-Jul-04 16:27:40) | stkensrv2 | 11958 | enstore | E (15) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_44.mover'}} |
|
1215099751.69 | 2008-Jul-03 10:42:31 (2008-Jul-04 16:27:40) | stkensrv2 | 11958 | enstore | E (15) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_42.mover'}} |
|
1215099860.35 | 2008-Jul-03 10:44:20 (2008-Jul-04 16:27:10) | stkensrv2 | 11958 | enstore | E (15) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_51.mover'}} |
|
1215099688.38 | 2008-Jul-03 10:41:28 (2008-Jul-04 16:26:45) | stkensrv2 | 11958 | enstore | E (16) | INQSRV | SERVERDIED | | {'text': {'server': 'CD-LTO4G1.library_manager'}} |
|
1215099794.36 | 2008-Jul-03 10:43:14 (2008-Jul-04 16:26:23) | stkensrv2 | 11958 | enstore | E (13) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_48.mover'}} |
|
1215099773.68 | 2008-Jul-03 10:42:53 (2008-Jul-04 16:26:23) | stkensrv2 | 11958 | enstore | E (15) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_49.mover'}} |
|
1215099731.28 | 2008-Jul-03 10:42:11 (2008-Jul-04 16:26:23) | stkensrv2 | 11958 | enstore | E (17) | INQSRV | SERVERDIED | | {'text': {'server': 'LTO4_40.mover'}} |
|
1215192976.92 | 2008-Jul-04 12:36:16 (2008-Jul-04 12:36:16) | stkenmvr145a | 24433 | root | W (1) | LTO4_45MV | Too long in state SEEK for VOJ970. Client host cmsstor61.fnal.gov | | {'text': {}} |
|
1215159751.97 | 2008-Jul-04 03:22:31 (2008-Jul-04 07:05:44) | stkensrv0 | 6388 | root | W (5) | ALARM_CLIENT | Average_cpu_load_is_between_4_and_5_during_last_15_min | | {'text': ''} |
|
1215172780.22 | 2008-Jul-04 06:59:40 (2008-Jul-04 06:59:40) | stkensrv0 | 6678 | root | W (1) | ALARM_CLIENT | Average_cpu_load_during_last_15_min_exceeds_5 | | {'text': ''} |
|
1215172159.71 | 2008-Jul-04 06:49:19 (2008-Jul-04 06:49:19) | stkensrv3 | 29023 | enstore | A (1) | LTO4G1LM | The mover LTO4_41.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215172159.58 | 2008-Jul-04 06:49:19 (2008-Jul-04 06:49:19) | stkensrv3 | 29023 | enstore | A (1) | LTO4G1LM | The mover LTO4_43.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215123707.84 | 2008-Jul-03 17:21:47 (2008-Jul-04 06:49:19) | stkensrv3 | 29023 | enstore | A (2) | LTO4G1LM | The mover LTO4_45.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215172159.38 | 2008-Jul-04 06:49:19 (2008-Jul-04 06:49:19) | stkensrv3 | 29023 | enstore | A (1) | LTO4G1LM | The mover LTO4_51.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215108000.91 | 2008-Jul-03 13:00:00 (2008-Jul-04 06:49:18) | stkensrv3 | 29023 | enstore | A (2) | LTO4G1LM | The mover LTO4_48.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215172158.59 | 2008-Jul-04 06:49:18 (2008-Jul-04 06:49:18) | stkensrv3 | 29023 | enstore | A (1) | LTO4G1LM | The mover LTO4_44.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215129365.56 | 2008-Jul-03 18:56:05 (2008-Jul-04 01:54:13) | stkensrv2 | 21941 | root | W (5) | ALARM_CLIENT | Average_cpu_load_during_last_15_min_exceeds_5 | | {'text': ''} |
|
1215118210.6 | 2008-Jul-03 15:50:10 (2008-Jul-03 15:50:10) | stkensrv0 | 9344 | enstore | W (1) | VOLSRV | APPROACHING QUOTA LIMIT | | {'text': '(CD-LTO3, minos) is approaching its quota limit (130/135)'} |
|
1215117370.93 | 2008-Jul-03 15:36:10 (2008-Jul-03 15:36:10) | stkensrv0 | 9344 | enstore | W (1) | VOLSRV | volume VOK479 is set to NOACCESS | | {'text': {'label': 'VOK479'}} |
|
1215117370.23 | 2008-Jul-03 15:36:10 (2008-Jul-03 15:36:10) | stkenmvr108a | 21174 | root | E (1) | LTO08MV | encountered FTT_EUNRECOVERED error. Going OFFLINE. Please check the tape drive | | {'text': {}} |
|
1214957701.19 | 2008-Jul-01 19:15:01 (2008-Jul-03 14:34:33) | stkensrv3 | 24310 | root | A (9) | ALARM_CLIENT | Node stkendca6a has rate 0. FIX, or disable its mover. | | {'text': ''} |
|
1215108728.19 | 2008-Jul-03 13:12:08 (2008-Jul-03 13:12:08) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL147 | | {'text': {}} |
|
1215108403.93 | 2008-Jul-03 13:06:43 (2008-Jul-03 13:06:43) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL143 | | {'text': {}} |
|
1215108354.53 | 2008-Jul-03 13:05:54 (2008-Jul-03 13:05:54) | stkensrv3 | 30834 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.47. FIX, or disable its mover. | | {'text': ''} |
|
1215108001.1 | 2008-Jul-03 13:00:01 (2008-Jul-03 13:00:01) | stkensrv3 | 29023 | enstore | A (1) | LTO4G1LM | The mover LTO4_46.mover has not updated its state for 10 minutes, will remove it from at_movers list | | {'text': {}} |
|
1215105858.53 | 2008-Jul-03 12:24:18 (2008-Jul-03 12:24:18) | stkenmvr112a | 24969 | root | E (1) | LTO12MV | Write error on VOK468. Volume is set readonly | | {'text': {}} |
|
1215101128.39 | 2008-Jul-03 11:05:28 (2008-Jul-03 11:05:28) | stkensrv3 | 8337 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.26. FIX, or disable its mover. | | {'text': ''} |
|
1215093322.41 | 2008-Jul-03 08:55:22 (2008-Jul-03 09:55:16) | stkensrv3 | 9322 | root | A (2) | ALARM_CLIENT | Node stkendca6a has rate 4.35. FIX, or disable its mover. | | {'text': ''} |
|
1215095085.4 | 2008-Jul-03 09:24:45 (2008-Jul-03 09:24:45) | stkensrv3 | 7251 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.33. FIX, or disable its mover. | | {'text': ''} |
|
1215082677.43 | 2008-Jul-03 05:57:57 (2008-Jul-03 06:56:31) | stkensrv3 | 24394 | root | A (2) | ALARM_CLIENT | Node stkendca6a has rate 1.30. FIX, or disable its mover. | | {'text': ''} |
|
1215084302.91 | 2008-Jul-03 06:25:02 (2008-Jul-03 06:25:02) | stkensrv3 | 21484 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.11. FIX, or disable its mover. | | {'text': ''} |
|
1215079481.95 | 2008-Jul-03 05:04:41 (2008-Jul-03 05:04:41) | stkensrv3 | 7490 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 5.28. FIX, or disable its mover. | | {'text': ''} |
|
1215077092.89 | 2008-Jul-03 04:24:52 (2008-Jul-03 04:24:52) | stkensrv3 | 509 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.15. FIX, or disable its mover. | | {'text': ''} |
|
1215070498.3 | 2008-Jul-03 02:34:58 (2008-Jul-03 02:34:58) | stkensrv3 | 21099 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.04. FIX, or disable its mover. | | {'text': ''} |
|
1215065122.54 | 2008-Jul-03 01:05:22 (2008-Jul-03 01:05:22) | stkensrv3 | 27707 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.24. FIX, or disable its mover. | | {'text': ''} |
|
1215062764.57 | 2008-Jul-03 00:26:04 (2008-Jul-03 00:26:04) | stkensrv3 | 19598 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.17. FIX, or disable its mover. | | {'text': ''} |
|
1215058577.87 | 2008-Jul-02 23:16:17 (2008-Jul-02 23:16:17) | stkensrv3 | 16025 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.44. FIX, or disable its mover. | | {'text': ''} |
|
1215052612.85 | 2008-Jul-02 21:36:52 (2008-Jul-02 21:36:52) | stkensrv3 | 14750 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.59. FIX, or disable its mover. | | {'text': ''} |
|
1215050898.09 | 2008-Jul-02 21:08:18 (2008-Jul-02 21:08:18) | stkensrv3 | 17284 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 6.44. FIX, or disable its mover. | | {'text': ''} |
|
1215048917.78 | 2008-Jul-02 20:35:17 (2008-Jul-02 20:35:17) | stkensrv3 | 20202 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 3.81. FIX, or disable its mover. | | {'text': ''} |
|
1215024967.34 | 2008-Jul-02 13:56:07 (2008-Jul-02 13:56:07) | stkensrv3 | 4393 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 6.91. FIX, or disable its mover. | | {'text': ''} |
|
1215014754.85 | 2008-Jul-02 11:05:54 (2008-Jul-02 11:05:54) | stkensrv3 | 30609 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.70. FIX, or disable its mover. | | {'text': ''} |
|
1215014350.26 | 2008-Jul-02 10:59:10 (2008-Jul-02 10:59:10) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL111 | | {'text': {}} |
|
1215012915.91 | 2008-Jul-02 10:35:15 (2008-Jul-02 10:35:15) | stkensrv3 | 1137 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.89. FIX, or disable its mover. | | {'text': ''} |
|
1215008924.18 | 2008-Jul-02 09:28:44 (2008-Jul-02 09:28:44) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL103 | | {'text': {}} |
|
1215008476.77 | 2008-Jul-02 09:21:16 (2008-Jul-02 09:21:16) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL104 | | {'text': {}} |
|
1215006350.33 | 2008-Jul-02 08:45:50 (2008-Jul-02 08:45:50) | stkensrv3 | 22648 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.62. FIX, or disable its mover. | | {'text': ''} |
|
1215000928.0 | 2008-Jul-02 07:15:28 (2008-Jul-02 07:15:27) | stkensrv3 | 26901 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.20. FIX, or disable its mover. | | {'text': ''} |
|
1214998937.4 | 2008-Jul-02 06:42:17 (2008-Jul-02 06:42:17) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL105 | | {'text': {}} |
|
1214998556.13 | 2008-Jul-02 06:35:56 (2008-Jul-02 06:35:56) | stkensrv3 | 19188 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.02. FIX, or disable its mover. | | {'text': ''} |
|
1214996739.34 | 2008-Jul-02 06:05:39 (2008-Jul-02 06:05:39) | stkensrv3 | 21747 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.68. FIX, or disable its mover. | | {'text': ''} |
|
1214992585.7 | 2008-Jul-02 04:56:25 (2008-Jul-02 04:56:25) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL100 | | {'text': {}} |
|
1214992501.93 | 2008-Jul-02 04:55:01 (2008-Jul-02 04:55:01) | stkensrv3 | 17877 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 9.91. FIX, or disable its mover. | | {'text': ''} |
|
1214988981.85 | 2008-Jul-02 03:56:21 (2008-Jul-02 03:56:21) | stkensrv3 | 23012 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 0.29. FIX, or disable its mover. | | {'text': ''} |
|
1214982343.48 | 2008-Jul-02 02:05:43 (2008-Jul-02 02:05:43) | stkensrv3 | 11137 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.18. FIX, or disable its mover. | | {'text': ''} |
|
1214974496.37 | 2008-Jul-01 23:54:56 (2008-Jul-01 23:54:56) | stkensrv3 | 9123 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 2.34. FIX, or disable its mover. | | {'text': ''} |
|
1214969011.23 | 2008-Jul-01 22:23:31 (2008-Jul-01 22:23:31) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL092 | | {'text': {}} |
|
1214969008.74 | 2008-Jul-01 22:23:28 (2008-Jul-01 22:23:28) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL091 | | {'text': {}} |
|
1214961931.67 | 2008-Jul-01 20:25:31 (2008-Jul-01 20:25:31) | stkensrv3 | 29158 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.63. FIX, or disable its mover. | | {'text': ''} |
|
1214955981.99 | 2008-Jul-01 18:46:21 (2008-Jul-01 18:46:21) | stkensrv3 | 27464 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 7.13. FIX, or disable its mover. | | {'text': ''} |
|
1214950041.78 | 2008-Jul-01 17:07:21 (2008-Jul-01 17:07:21) | stkensrv3 | 29023 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL085 | | {'text': {}} |
|
1214949946.61 | 2008-Jul-01 17:05:46 (2008-Jul-01 17:05:46) | stkensrv3 | 25810 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 9.08. FIX, or disable its mover. | | {'text': ''} |
|
1214945796.07 | 2008-Jul-01 15:56:36 (2008-Jul-01 15:56:36) | stkensrv3 | 21616 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 4.29. FIX, or disable its mover. | | {'text': ''} |
|
1214938713.72 | 2008-Jul-01 13:58:33 (2008-Jul-01 13:58:33) | stkensrv3 | 23253 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 6.60. FIX, or disable its mover. | | {'text': ''} |
|
1214935168.01 | 2008-Jul-01 12:59:28 (2008-Jul-01 12:59:28) | stkensrv3 | 28787 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 5.17. FIX, or disable its mover. | | {'text': ''} |
|
1214926717.12 | 2008-Jul-01 10:38:37 (2008-Jul-01 10:38:37) | stkensrv3 | 19058 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 7.68. FIX, or disable its mover. | | {'text': ''} |
|
1214921765.02 | 2008-Jul-01 09:16:05 (2008-Jul-01 09:16:05) | stkensrv3 | 10498 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 9.20. FIX, or disable its mover. | | {'text': ''} |
|
1214910970.51 | 2008-Jul-01 06:16:10 (2008-Jul-01 06:16:10) | stkensrv3 | 24929 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 3.98. FIX, or disable its mover. | | {'text': ''} |
|
1214909151.86 | 2008-Jul-01 05:45:51 (2008-Jul-01 05:45:51) | stkensrv3 | 27852 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 7.96. FIX, or disable its mover. | | {'text': ''} |
|
1214905110.34 | 2008-Jul-01 04:38:30 (2008-Jul-01 04:38:30) | stkensrv3 | 23996 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 5.50. FIX, or disable its mover. | | {'text': ''} |
|
1214903292.07 | 2008-Jul-01 04:08:12 (2008-Jul-01 04:08:12) | stkensrv3 | 26078 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 5.89. FIX, or disable its mover. | | {'text': ''} |
|
1214899152.49 | 2008-Jul-01 02:59:12 (2008-Jul-01 02:59:12) | stkensrv3 | 3805 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 5.35. FIX, or disable its mover. | | {'text': ''} |
|
1214887549.6 | 2008-Jun-30 23:45:49 (2008-Jun-30 23:45:49) | stkensrv3 | 14933 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 6.94. FIX, or disable its mover. | | {'text': ''} |
|
1214876972.86 | 2008-Jun-30 20:49:32 (2008-Jun-30 20:49:32) | stkensrv3 | 15031 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 6.14. FIX, or disable its mover. | | {'text': ''} |
|
1214872147.94 | 2008-Jun-30 19:29:07 (2008-Jun-30 19:29:07) | stkensrv3 | 9042 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 7.25. FIX, or disable its mover. | | {'text': ''} |
|
1214868822.76 | 2008-Jun-30 18:33:42 (2008-Jun-30 18:33:42) | stkensrv0 | 9344 | enstore | W (1) | VOLSRV | volume VOL062 is set to NOACCESS | | {'text': {'label': 'VOL062'}} |
|
1214867859.55 | 2008-Jun-30 18:17:39 (2008-Jun-30 18:33:42) | stkensrv3 | 29023 | enstore | I (3) | LTO4G1LM | mover_error updated suspect volume list for VOL062 | | {'text': {}} |
|
1214865521.24 | 2008-Jun-30 17:38:41 (2008-Jun-30 17:38:41) | stkensrv3 | 1107 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 9.82. FIX, or disable its mover. | | {'text': ''} |
|
1214862596.78 | 2008-Jun-30 16:49:56 (2008-Jun-30 16:49:56) | stkensrv3 | 23914 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 7.33. FIX, or disable its mover. | | {'text': ''} |
|
1214858757.44 | 2008-Jun-30 15:45:57 (2008-Jun-30 15:45:57) | stkensrv3 | 27362 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.05. FIX, or disable its mover. | | {'text': ''} |
|
1214852318.55 | 2008-Jun-30 13:58:38 (2008-Jun-30 13:58:38) | stkensrv3 | 7638 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 7.50. FIX, or disable its mover. | | {'text': ''} |
|
1214846893.48 | 2008-Jun-30 12:28:13 (2008-Jun-30 12:28:13) | stkensrv3 | 14899 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.53. FIX, or disable its mover. | | {'text': ''} |
|
1214812179.94 | 2008-Jun-30 02:49:39 (2008-Jun-30 02:49:39) | stkensrv3 | 32045 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.99. FIX, or disable its mover. | | {'text': ''} |
|
1214804736.7 | 2008-Jun-30 00:45:36 (2008-Jun-30 00:45:36) | stkensrv0 | 3665 | enstore | W (1) | VOLSRV | volume VOK446 is set to NOACCESS | | {'text': {'label': 'VOK446'}} |
|
1214801076.38 | 2008-Jun-29 23:44:36 (2008-Jun-29 23:44:36) | stkenmvr112a | 22863 | root | E (1) | LTO12MV | Write error on VOK444. Volume is set readonly | | {'text': {}} |
|
1214792705.4 | 2008-Jun-29 21:25:05 (2008-Jun-29 21:25:05) | stkensrv3 | 3815 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.59. FIX, or disable its mover. | | {'text': ''} |
|
1214783905.61 | 2008-Jun-29 18:58:25 (2008-Jun-29 18:58:25) | stkensrv3 | 16435 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL036 | | {'text': {}} |
|
1214783705.04 | 2008-Jun-29 18:55:05 (2008-Jun-29 18:55:05) | stkensrv3 | 16814 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 5.87. FIX, or disable its mover. | | {'text': ''} |
|
1214774092.37 | 2008-Jun-29 16:14:52 (2008-Jun-29 16:14:52) | stkensrv3 | 20528 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.50. FIX, or disable its mover. | | {'text': ''} |
|
1214770556.71 | 2008-Jun-29 15:15:56 (2008-Jun-29 15:15:56) | stkensrv3 | 18347 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 8.73. FIX, or disable its mover. | | {'text': ''} |
|
1214762608.55 | 2008-Jun-29 13:03:28 (2008-Jun-29 13:03:28) | stkenmvr146a | 19554 | root | W (1) | LTO4_46MV | Too long in state SEEK for VOL015. Client host cmsstor78.fnal.gov | | {'text': {}} |
|
1214759114.95 | 2008-Jun-29 12:05:14 (2008-Jun-29 12:05:14) | stkensrv3 | 21853 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 9.75. FIX, or disable its mover. | | {'text': ''} |
|
1214743367.86 | 2008-Jun-29 07:42:47 (2008-Jun-29 07:42:47) | stkensrv3 | 16435 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL021 | | {'text': {}} |
|
1214741085.56 | 2008-Jun-29 07:04:45 (2008-Jun-29 07:04:45) | stkensrv3 | 16221 | root | A (1) | ALARM_CLIENT | Node stkendca6a has rate 2.12. FIX, or disable its mover. | | {'text': ''} |
|
1214734998.49 | 2008-Jun-29 05:23:18 (2008-Jun-29 05:23:18) | stkensrv3 | 1134 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL019 | | {'text': {}} |
|
1214734986.05 | 2008-Jun-29 05:23:06 (2008-Jun-29 05:23:06) | stkensrv3 | 1134 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL022 | | {'text': {}} |
|
1214730910.38 | 2008-Jun-29 04:15:10 (2008-Jun-29 04:52:20) | stkensrv3 | 1134 | enstore | I (2) | LTO4G1LM | mover_error updated suspect volume list for VOL020 | | {'text': {}} |
|
1214730924.25 | 2008-Jun-29 04:15:24 (2008-Jun-29 04:52:15) | stkensrv3 | 1134 | enstore | I (2) | LTO4G1LM | mover_error updated suspect volume list for VOL011 | | {'text': {}} |
|
1214730921.91 | 2008-Jun-29 04:15:21 (2008-Jun-29 04:15:21) | stkensrv3 | 1134 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL013 | | {'text': {}} |
|
1214719565.49 | 2008-Jun-29 01:06:05 (2008-Jun-29 01:06:05) | stkensrv3 | 1134 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOL010 | | {'text': {}} |
|
1214686790.95 | 2008-Jun-28 15:59:50 (2008-Jun-28 15:59:50) | stkensrv3 | 1134 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOJ947 | | {'text': {}} |
|
1214686319.11 | 2008-Jun-28 15:51:59 (2008-Jun-28 15:51:59) | stkenmvr145a | 9265 | root | W (1) | LTO4_45MV | Too long in state SEEK for VOJ947. Client host cmsstor41.fnal.gov | | {'text': {}} |
|
1214589677.2 | 2008-Jun-27 13:01:17 (2008-Jun-27 13:01:17) | stkensrv3 | 1134 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOJ988 | | {'text': {}} |
|
1214569296.73 | 2008-Jun-27 07:21:36 (2008-Jun-27 07:21:36) | stkenmvr146a | 19554 | root | W (1) | LTO4_46MV | Too long in state SEEK for VOJ990. Client host cmsstor55.fnal.gov | | {'text': {}} |
|
1214525958.53 | 2008-Jun-26 19:19:18 (2008-Jun-26 19:19:18) | stkenmvr151a | 2525 | root | E (1) | LTO4_51MV | 1 mount VOJ982 failed: ('exceptions.OSError', '[Errno 32] Broken pipe', 'error') | | {'text': {}} |
|
1214525958.12 | 2008-Jun-26 19:19:18 (2008-Jun-26 19:19:18) | stkensrv0 | 3665 | enstore | W (1) | VOLSRV | volume VOJ982 is set to NOACCESS | | {'text': {'label': 'VOJ982'}} |
|
1214525655.81 | 2008-Jun-26 19:14:15 (2008-Jun-26 19:14:15) | stkenmvr115a | 10432 | root | E (1) | LTO15MV | 1 mount VOG941 failed: ('exceptions.OSError', '[Errno 32] Broken pipe', 'error') | | {'text': {}} |
|
1214525655.42 | 2008-Jun-26 19:14:15 (2008-Jun-26 19:14:15) | stkensrv0 | 3665 | enstore | W (1) | VOLSRV | volume VOG941 is set to NOACCESS | | {'text': {'label': 'VOG941'}} |
|
1214525648.29 | 2008-Jun-26 19:14:08 (2008-Jun-26 19:14:08) | stkenmvr113a | 31222 | root | E (1) | LTO13MV | DISMOUNTFAILED dismount VOE372 failed: ('exceptions.OSError', '[Errno 32] Broken pipe', 'error') | | {'text': {}} |
|
1214525646.98 | 2008-Jun-26 19:14:06 (2008-Jun-26 19:14:06) | stkensrv0 | 3665 | enstore | W (1) | VOLSRV | volume VOE372 is set to NOACCESS | | {'text': {'label': 'VOE372'}} |
|
1214525552.36 | 2008-Jun-26 19:12:32 (2008-Jun-26 19:12:32) | stkensrv3 | 29964 | enstore | I (1) | LTO4G1LM | mover_error updated suspect volume list for VOJ985 | | {'text': {}} |
|
1214422670.62 | 2008-Jun-25 14:37:50 (2008-Jun-25 14:37:50) | stkenmvr145a | 3426 | root | W (1) | LTO4_45MV | Too long in state SEEK for VOJ963. Client host cmsstor68.fnal.gov | | {'text': {}} |
|
1214417337.49 | 2008-Jun-25 13:08:57 (2008-Jun-25 13:08:57) | stkenmvr151a | 28141 | root | W (1) | LTO4_51MV | Too long in state SEEK for VOJ963. Client host cmsstor75.fnal.gov | | {'text': {}} |
|
1214285089.96 | 2008-Jun-24 00:24:49 (2008-Jun-24 00:24:49) | stkenmvr145a | 3426 | root | W (1) | LTO4_45MV | Too long in state SEEK for VOJ941. Client host cmsstor59.fnal.gov | | {'text': {}} |
|
1214265649.6 | 2008-Jun-23 19:00:49 (2008-Jun-23 19:00:49) | stkenmvr151a | 28141 | root | W (1) | LTO4_51MV | Too long in state SEEK for VOJ926. Client host cmsstor33.fnal.gov | | {'text': {}} |
|
1207038557.53 | 2008-Apr-01 03:29:17 (2008-Apr-01 03:29:17) | stkensrv3 | 4954 | enstore | E (1) | LTO3LM | Mover error (LTO3_19.mover) caused volume VOG442 to go NOACCESS | | {'text': {}} |
|
1207038556.7 | 2008-Apr-01 03:29:16 (2008-Apr-01 03:29:16) | stkensrv0 | 31371 | enstore | W (1) | VOLSRV | volume VOG442 is set to NOACCESS | | {'text': {'label': 'VOG442'}} |