Events:
<p>
<dl>
<a name="1514459706.0.18"></a>
<dt> 2017-12-28 at 12:12

 [tegner]
<dd> The machine hosting the Tegner slurm master controller is currently unavailable. Batch system operations won't respond. Given the holiday season the time to fix is hard to estimate.

<!-- lama -->

<a name="1513774263.0.18"></a>
<dt> 2017-12-20 at 13:45

 [tegner]
<dd> Tegner:



At about 11:38 CET (10:38 UTC), the Tegner login node tegner-login-1 crashed because of a memory module that went bad.

Currently tegner-login-2 is used instead.



<!-- ragge -->

<a name="1513588167.0.17"></a>
<dt> 2017-12-18 at 10:07

 [beskow]
<dd> The involved batch front-ends have been restarted and things should work as usual. Note that many job running on the affected front-end have been affected.

<!-- lama -->

<a name="1513579758.0.17"></a>
<dt> 2017-12-18 at 07:46

 [beskow]
<dd> One batch front-end seem to have gotten OOM'ed (out-of-memory) over night and will likely be restarted later this morning. Until then batch-system related operations will be affected.



<!-- lama -->

<a name="1513256099.1.18"></a>
<dt> 2017-12-14 at 13:49

 [tegner]
<dd> At 14:00 today 2017-12-14 we will start a rolling upgrade of the compute nodes and login-nodes of tegner. With the exception of when we restart the login nodes there should be no impact for users. We plan to restart tegner.pdc.kth.se on Monday 20171218 at 10:00 and tegner-login-2.pdc.kth.se at 16:00 today.

<!-- dah -->

<a name="1512813325.1.17"></a>
<dt> 2017-12-09 at 10:52

 [beskow]
<dd> Informational - last night a batch front-end unintentionally was emptied rather than drained of jobs. Some jobs might have been affected.

<!-- lars. -->

<a name="1511866749.1.17"></a>
<dt> 2017-11-28 at 11:59

 [beskow]
<dd> Cooling/backup cooling fail-over tests completed. Jobs running again.



<!-- lama -->

<a name="1511788567.1.17"></a>
<dt> 2017-11-27 at 14:10

 [beskow]
<dd> Tomorrow, 2017-11-28 starting ~10:00, we will stress the cooling/backup cooling fail-over. The system will be up, but no user jobs will be allowed to execute during testing. The tests are supposed to be completed during the same day.



<!-- lama -->

<a name="1510666136.0.17"></a>
<dt> 2017-11-14 at 14:28

 [beskow]
<dd> The system has been restarted and is since a while running jobs again.



<!-- lama -->

<a name="1510657674.0.17"></a>
<dt> 2017-11-14 at 12:07

 [beskow]
<dd> The system will be restarted ~13:00 today.



<!-- lama -->

<a name="1510649934.0.17"></a>
<dt> 2017-11-14 at 09:55

 [beskow]
<dd> During maintenance work on the machine room environment control system, backup cooling did not work as anticipated. Two cabinets out of eleven did shut down due to lack of sufficient cooling. We will assess the situation somewhat and then decide on whether to make a full system restart, or let stray running jobs complete.



<!-- lama -->

<a name="1509649689.0.18"></a>
<dt> 2017-11-02 at 20:05

 [tegner]
<dd> The tegner cluster should now be back and accepting jobs. However - we have identified an issue with the new setup that - while hopefully mitigated most likely still will require an additional shorter service window as soon as a proper solution can be found.





<!-- dah -->

<a name="1509557711.1.17"></a>
<dt> 2017-11-01 at 18:31

 [beskow]
<dd> Preventive maintenance of beskow and neighbouring file-system klemming completed. Systems serving jobs since a while.



<!-- lama -->

<a name="1509096480.1.17"></a>
<dt> 2017-10-27 at 11:27

 [beskow]
<dd> Preventive maintenance on beskow will start Wednesday November 1st, 08:00. The system will be unavailable during parts of that day.

<!-- lama -->

<a name="1509084196.1.18"></a>
<dt> 2017-10-27 at 07:57

 [tegner]
<dd> The Tegner cluster will have a service window the 1st and possibly 2nd of November 2017. System software will be updated  and the system interconnect will be restructured to allow for additional nodes. We hope to complete the work in one day but the 2nd of November is reserved as well in case unforeseen delays develops.

<!-- dah -->

<a name="1508244385.0.18"></a>
<dt> 2017-10-17 at 14:46

 [tegner]
<dd> The tegner-login-1, one of the login-node of the Tegner cluster, was unresponsive for about 30 minutes around 14:00. It should be back now and no running jobs should have been affected. Further diagnostics are in progress.

<!-- dah -->

<a name="1507901939.0.18"></a>
<dt> 2017-10-13 at 15:38

 [tegner]
<dd> Tegner is up and running again.

<!-- ragge -->

<a name="1507894624.0.18"></a>
<dt> 2017-10-13 at 13:35

 [tegner]
<dd> Tegner - switch failure, all 32 nodes in t02 rack crashed.

<!-- ragge -->

<a name="1506533122.0.17"></a>
<dt> 2017-09-27 at 19:21

 [beskow]
<dd> What seem to be a tripped circuit breaker made ~90 nodes in one cabinet shutdown due to under-voltage earlier this afternoon. There was service on power in another cabinet of the system this morning, it remains to be seen if it is correlated or not.





<!-- lama -->

<a name="1504288873.1.17"></a>
<dt> 2017-09-01 at 19:56

 [beskow]
<dd> Most parts of the Beskow upgrade complete. Jobs are running, and login is enabled again.



<!-- lama -->

<a name="1503315894.1.17"></a>
<dt> 2017-08-21 at 13:22

 [beskow]
<dd> Starting Monday 2017-08-28, the Beskow upgrade will be launched. Preparation and physical installation is estimated to one work-week. Integration, customisation & stabilisation will take place the following workweek.



<!-- lama -->

<a name="1500292057.0.17"></a>
<dt> 2017-07-17 at 13:44

 [beskow]
<dd> The system has been restarted and is running jobs again. One cabinet, 1/9 of the system, is being locked out from running jobs, this to reduce power draw in it.



<!-- lama -->

<a name="1500283305.0.17"></a>
<dt> 2017-07-17 at 11:16

 [beskow]
<dd> One cabinet has gotten power problems and one row of cabinets has been automatically shut down overnight. All running jobs affected. The system will now be shutdown. Given the season of year, a restart might take somewhat longer than what we would like it to.



<!-- lama -->

<a name="1499666783.1.18"></a>
<dt> 2017-07-10 at 08:05

 [tegner]
<dd> The tegner login node tegner-login-1 has is now back after having been restarted.

<!-- dah -->

<a name="1499618491.1.18"></a>
<dt> 2017-07-09 at 18:41

 [tegner]
<dd> tegner-login-1, one of the login node of the tegner cluster will be restarted at CEST 08:00 Monday July 10th 2017 for system software updates. Please consider using tegner-login-2 until then. If you have any questions please send an email to support@pdc.kth.se 

<!-- dah -->

<a name="1499167686.1.17"></a>
<dt> 2017-07-04 at 13:27

 [beskow]
<dd> Maintenance completed. The system is on-line and running jobs again.



<!-- lama -->

<a name="1499071827.1.17"></a>
<dt> 2017-07-03 at 10:46

 [beskow]
<dd> Preventive maintenance to take place tomorrow, 2017-07-04. The system will be taken off-line after 08:00. 



<!-- lama -->

<a name="1496345172.0.17"></a>
<dt> 2017-06-01 at 21:22

 [beskow]
<dd> Earlier this evening/afternoon the PDC network backbone was not acting well. As a precaution jobs were inhibited to start while investigating. The block has now been lifted and jobs are starting again.



<!-- lama -->

<a name="1495819341.0.17"></a>
<dt> 2017-05-26 at 19:19

 [beskow]
<dd> The system was restarted earlier in the afternoon. Batch jobs were released and allowed to run a short while ago.



<!-- lama -->

<a name="1495785765.0.17"></a>
<dt> 2017-05-26 at 09:58

 [beskow]
<dd> Several cabinets reported power related problems this morning and many nodes have shut down. As today is a non-working day (klämdag/Brückentag) the response time, and time to fix, will be affected.



<!-- lama -->

<a name="1489433615.0.17"></a>
<dt> 2017-03-13 at 20:30

 [beskow]
<dd> cabinet c2-1 power disruptions causes nodes 1536-1727 (nids) to fail. Jobs on affected nodes will also fail.



<!-- lama -->

<a name="1489163521.0.16"></a>
<dt> 2017-03-10 at 17:30

 [milner]
<dd> The restart is finished, milner is on-line again.



<!-- lama -->

<a name="1489135969.0.16"></a>
<dt> 2017-03-10 at 09:49

 [milner]
<dd> Some critical milner file-systems went off-line over-night and the system is in need to be restarted. This will commence late this Friday afternoon the earliest.



<!-- lama -->

<a name="1486482918.1.18"></a>
<dt> 2017-02-07 at 16:54

 [tegner]
<dd> The service window for tegner has now ended. Thanks for your patience

<!-- dah -->

<a name="1485940042.1.18"></a>
<dt> 2017-02-06 at 09:30

 [tegner]
<dd> Tegner will have a scheduling pause for maintenance and upgrades 6-7th of February. Access to login- and transfer nodes may be affected for parts of the service window.



<!-- dah -->

</dl>
All flash news for 
<a href="/cgi-bin/flash/flash.py?year=2024">2024</a>, 
<a href="/cgi-bin/flash/flash.py?year=2023">2023</a>, 
<a href="/cgi-bin/flash/flash.py?year=2022">2022</a>, 
<a href="/cgi-bin/flash/flash.py?year=2021">2021</a>, 
<a href="/cgi-bin/flash/flash.py?year=2020">2020</a>, 
<a href="/cgi-bin/flash/flash.py?year=2019">2019</a>, 
<a href="/cgi-bin/flash/flash.py?year=2018">2018</a>, 
<a href="/cgi-bin/flash/flash.py?year=2017">2017</a>, 
<a href="/cgi-bin/flash/flash.py?year=2016">2016</a>, 
<a href="/cgi-bin/flash/flash.py?year=2015">2015</a>, 
<a href="/cgi-bin/flash/flash.py?year=2014">2014</a>, 
<a href="/cgi-bin/flash/flash.py?year=2013">2013</a>, 
<a href="/cgi-bin/flash/flash.py?year=2012">2012</a>, 
<a href="/cgi-bin/flash/flash.py?year=2011">2011</a>, 
<a href="/cgi-bin/flash/flash.py?year=2010">2010</a>, 
<a href="/cgi-bin/flash/flash.py?year=2009">2009</a>, 
<a href="/cgi-bin/flash/flash.py?year=2008">2008</a>, 
<a href="/cgi-bin/flash/flash.py?year=2007">2007</a>, 
<a href="/cgi-bin/flash/flash.py?year=2006">2006</a>, 
<a href="/cgi-bin/flash/flash.py?year=2005">2005</a>, 
<a href="/cgi-bin/flash/flash.py?year=2004">2004</a>, 
<a href="/cgi-bin/flash/flash.py?year=2003">2003</a>, 
<a href="/cgi-bin/flash/flash.py?year=2002">2002</a>, 
<a href="/cgi-bin/flash/flash.py?year=2001">2001</a>, 
<a href="/cgi-bin/flash/flash.py?year=2000">2000</a>, 
<a href="/cgi-bin/flash/flash.py?year=1999">1999</a>, 
<a href="/cgi-bin/flash/flash.py?year=1998">1998</a>, 
<a href="/cgi-bin/flash/flash.py?year=1997">1997</a>, 
<a href="/cgi-bin/flash/flash.py?year=1996">1996</a>, 
<a href="/cgi-bin/flash/flash.py?year=1995">1995</a>
<br><br><a href="https://www.pdc.kth.se/">Back to PDC</a>
<br><a href="https://www.pdc.kth.se/cgi-bin/flash/rss.py">Subscribe to rss</a>