Differences between revisions 4 and 9 (spanning 5 versions)
Revision 4 as of 2010-10-12 19:46:12
Size: 3229
Comment:
Revision 9 as of 2018-10-18 06:28:03
Size: 3761
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Computer Restart Procedures = = Most information here is OBSOLETE as of 2018 Oct 17 =

=
= Computer Restart Procedures ==
Line 5: Line 7:
||[[Computer Restart Procedures/BURTgooey|BURTgooey]] || [#links Useful links] || ||[[Computer_Restart_Procedures/BURTgooey|BURTgooey]] || [[#links|Useful links]] ||
Line 7: Line 9:
||[#c1sus c1sus] ||[#c1ioo c1ioo] || ||[[#c1sus|c1sus]] ||[[#c1ioo|c1ioo]] ||
Line 10: Line 12:
|| [#nodus nodus] ||[#fb fb] (Includes DAQ) || || [[#nodus|nodus]] ||[[#fb|fb]] (Includes DAQ) ||
Line 26: Line 28:
On reboot, these models should automatically start up. See also the [#fb fb/DAQ] section. On reboot, these models should automatically start up. See also the [[#fb|fb/DAQ]] section.
Line 32: Line 34:
On reboot, these models should automatically start up. See also the [#fb fb/DAQ] section. On reboot, these models should automatically start up. See also the [[#fb|fb/DAQ]] section.
Line 85: Line 87:
''Cold start order is:''

 . 0. If necessary, stop everything (fb, front ends, mx_streams, etc)

 . 1. Start fb codes (daqd, nds)

 . 2. Start IOP (startc1x##)

 . 3. Start FE models (startc1SYSNAME)

 . 4. Start mx_streams (/etc/restart_streams)

 . If the DAQ is in a bad state, try to start fresh in this order. It seems to usually work.



Line 90: Line 109:
 * [[EPICS gateway]]  * [[EPICS_gateway]]

Most information here is OBSOLETE as of 2018 Oct 17

Computer Restart Procedures

Here is where we should keep information on how to restart the computers that periodically need restarting.

BURTgooey

Useful links

c1sus

c1ioo

nodus

fb (Includes DAQ)


  • Useful links

Which models run on which machines?


  • c1sus

This machine runs the c1x02, c1sus, c1mcs, c1rms FE models. It controls the BS, ITMX, ITMY, PRM,SRM,MC1,MC2, and MC3 optics.

On reboot, these models should automatically start up. See also the fb/DAQ section.


  • c1ioo

This machine runs the c1x03, c1ioo, and c1gpt FE models. It controls mode cleaner wavefront sensors, mode cleaner length, and green locking.

On reboot, these models should automatically start up. See also the fb/DAQ section.

c1ioo is a Sun X4600 machine. As such for a complete shutdown (not normally necessary but sometimes), do the following:

Shutdown the computer normally. (Power button or "shutdown -h now").

Go out to the rack and unplug all 4 power supply cables on the back of the machine.

Wait for a bit for the machine to completely stop (30 seconds or so).

Plug all the cables back in, and press the power button.


  • fb and DAQ issues

For dataviewer to get data you need to make sure "daqd" and "nds pipe" are running on the fb machine.

  • If they are not running, you can start by hand by doing:
  • 1. ssh fb
  • 2. screen
  • 3. /opt/rtcds/caltech/c1/target/fb/daqd -c ./daqdrc &

  • 4. /opt/rtcds/caltech/c1/target/fb/nds pipe > nds.log &

  • 5. Press ctrl-a and then ctrl-d.
  • Eventually there should be a script to automatically restart these if they go down

For testpoints to be available for a given front end, you need running on the correct front end computer:

  • The IOP needs to be running, since it handles, it is genamed something like c1x00, c1x01, etc.
  • "sudo /opt/rtcds/caltech/c1/scripts/startc1SYSNAME" where SYSNAME is something like sus or ioo or x02
  • The above starts the IOCs, awgtpman, and loads the front end module.
  • mx_streams running (use "sudo /etc/restart_streams") this should start a mx_stream for each front end system and is needed to talk to the fb

To confirm the necessary codes are running on a front end, you can:

  • To check if the front ends are loaded, you can use "lsmod" on the front end machine, looking for c1SYSNAMEfe entries
  • To check if the IOCs are running, you can "ps -ef | grep epicsC1.cmd" - there should be 1 per model
  • To check if mx_streams are running, you can "ps -ef | grep mx_stream" - there should be 1 per model
  • To check if awgtpman are running, you can "ps -ef | grep awgtpman" - there should be 1 per model

Cold start order is:

  • 0. If necessary, stop everything (fb, front ends, mx_streams, etc)
  • 1. Start fb codes (daqd, nds)
  • 2. Start IOP (startc1x##)
  • 3. Start FE models (startc1SYSNAME)
  • 4. Start mx_streams (/etc/restart_streams)
  • If the DAQ is in a bad state, try to start fresh in this order. It seems to usually work.


  • nodus

Nodus is a Solaris box in the rack in the office. Here are some of the things that it runs that you will want to restart:

New_Computer_Restart_Procedures (last edited 2018-10-18 06:28:03 by GautamvenugopalanATligoDOTorg)