• Complete_power_shutdowwn_2022

Complete power shutdown and start-up plan

There will be a power shutdown for 40m lab completely on Feb 5th (Sat), 2022 from 10am to 2pm. Following is the detailed plan for how to shutdown the whole lab and bring it back up online.

1. Shutdown

1.1. CDS Shutdown

1.1.1. Creating backups

• Ensure all SDF tables in all FE models are saved to keep the changes persistent through power cycle.
• Note that ADC, DAC index orders might change in C1SUS2 I/O chassis and maybe others.
• Create burtgooey backups of all available req files or ensure that autoburt has successfully run in past some time.

1.1.2. Slow computers

1.1.2.1. Old computers

telnet into following computers:

• c1auxey

shutdown

If the computers do not respond (in cases where you cannot telnet into them or maybe the above shutdown command does not work through telnet, it is untested), it is ok to hard reboot them. This can be done using the key on the crate. If no key, press the reset button or keep the ON/OFF button pressed until the machine powers down.

1.1.2.2. New computers

ssh into the following computers:

• c1susaux
• c1auxex
• c1psl
• c1iscaux

And do the following:

sudo systemctl stop modbusIOC.service
sudo shutdown

• c1vac

I suppose shutting down c1vac changes the state of the gate valves. But shutting down (power down) of the acromag targets will change the relay (or signal) states. It may close the valves.

• Take a screenshot of the valve states before the action
• Close the automated valves as many as possible.
• Shutdown c1vac and power down the acromag targets

1.1.3. Fast computers

ssh into following computers:

• c1lsc
• c1sus
• c1ioo

sudo /sbin/shutdown -h now

ssh into following computers:

• c1iscex
• c1iscey
• c1su2

And do the following:

rtcds stop --all
sudo /sbin/shutdown -h now

Note: c1lsc/c1sus/c1ioo are entangled and stopping the models on one of the machines will cause the others unresponsive. I'd recommend to run "shutdown -h now" at once on these three machines without stopping the RT processes. (KA)

1.1.4. Teststand computers

First ssh into c1teststand

ssh c1teststand

then ssh into the following computers in order and do the following:

• c1bhd
• fb1 (clone)
• chiara (clone)

sudo shutdown

And then shutdown c1teststand computer itself.

Switch off the chassis power buttons, AA/AI power buttons, and then switch off the power supply at the bottom of the stand.

1.1.5. Martian computers

1.1.5.1. Megatron

ssh megatron
sudo systemctl stop FSSSlow.service
sudo shutdown

1.1.5.2. Optimus

ssh optimus
cd /home/controls/Git/40m/scripts/MC
sudo docker-compose down
cd /home/controls/Git/40m/softchansmodbus
sudo docker-compose down
sudo shutdown

1.1.5.3. viviana

ssh viviana
sudo shutdown

1.1.5.4. paola

ssh paola
sudo shutdown

1.1.5.5. fb1

ssh fb1
sudo shutdown

1.1.5.6. chiara

ssh chiara
sudo shutdown

1.1.5.7. nodus

ssh nodus
sudo shutdown

1.2. Electronics racks

1.2.1. Yend Rack

If you switch off any of the power buttons on the rack, list them down here.

• SR560
• uPDH Box powered with its own supply.
• Signal Generator
• Oven temp controller. Set temperature was 35.7 degrees Celsisu.

1.2.2. 1Y4

• Computers that should be shutdown by now:
  • c1iscey
  • paola

If you switch off any of the power buttons on the rack, list them down here.

• Network Switch (plug pulled in the back)
• I/O Expansion chassis, turned power button on front.
• Powerstrip in the back was turned off.

1.2.2.1. Sorenson power supplies

1.2.3. 1Y3

• Computers that should be shutdown by now:
  • c1iscaux

If you switch off any of the power buttons on the rack, list them down here.

• Powerstrip in the back was turned off. This turned off the network switch too.
• I/O Expansion chassis, turned power button on the front.

1.2.3.1. Sorenson power supplies

1.2.4. 1Y2

If you switch off any of the power buttons on the rack, list them down here.

• RF electronics with power switch
• Turned off power strip on the floor.

1.2.4.1. Sorenson power supplies

• Power buttons on Kepco HV supply are on the front bottom left corner.

1.2.5. 1Y1

If you switch off any of the power buttons on the rack, list them down here.

• Video MUX
• C1SU2 I/O chassis on front
• Turned off the power strip

1.2.6. 1Y0

If you switch off any of the power buttons on the rack, list them down here.

1.2.6.1. Sorenson power supplies

1.2.7. 1X1

• Found a powered Ref Cavity Ion Pump Control but probably unused.
• 17 AC power connections

If you switch off any of the power buttons on the rack, list them down here.

• I/O Expansion chassis turned off at front and back
• Universal Motion Controller
  • 1 74.24 deg OFF
  • 2 NO
  • 3 NO
• Unplugged Network Switch
• Turned off power strip in the back top.
• Unplugged 1X9-4 Kepco HV supply in the back.

1.2.7.1. Power supplies

1.2.8. 1X2

• Mostly has electronics, no power supplies.
• 15 AC power connections
• Vertex temp sensor
• Computers that should be shutdown by now:
  • c1psl
  • c1ioo

If you switch off any of the power buttons on the rack, list them down here.

• Network switch at position 1X2-1
• Power strip in back bottom

1.2.9. AUX OMC SOUTH (Small rack south of 1X2)

If you switch off any of the power buttons on the rack, list them down here.

• It has one function generator powered on top. 313.14 Hz, 100 mVpp, LoadHiZ
• 1 Marconi FG on top at 11.066195 MHz:
  • Freq: 11.066195 MHz
  • RF Level: 13 dBm
  • MOD Disable
  • FM2 AC OFF
  • FM1 0, AC, OFF
  • MOdF AC 1.0000 kHz

1.2.10. 1YNot

• Mostly used for storing stuff
• 9 AC power connections

If you switch off any of the power buttons on the rack, list them down here.

• c1ass

1.2.11. 1X4

• Mostly has electronics and computers, no power supplies.
• 8 AC power connections
• Computers that should be shutdown by now:
  • c1lsc
  • c1sus
  • c1susaux
• 1X4 I/O Chassis

If you switch off any of the power buttons on the rack, list them down here.

• Turned off 1X4 I/O Chassis power buttons front and back
• Dolphin network switch in the back

1.2.12. 1X5

• 6 AC power connections

If you switch off any of the power buttons on the rack, list them down here.

1.2.12.1. Power supplies

1.2.13. 1X6

• Network Switch 1
• 7 AC power connections
• Computers that should be shutdown by now:
  • fb1
  • megatron
  • FB (old) already off
• Jetstar powered at the bottom most location. Needs to be checked.

If you switch off any of the power buttons on the rack, list them down here.

• Network switch (unplugged in the back)
• Jetstar turned off in the back by little black button
• Master Timer Sequencer in the back by button

1.2.14. 1X7

• Network Switch 1
• Network switch 2
• 19 AC power connections
• Computers that should be shutdown by now:
  • nodus
  • chiara
  • optimus
• UPS at the bottom of the rack

If you switch off any of the power buttons on the rack, list them down here.

• Network switch 1
• Network switch 2

• GPS TimeSource

• UPS turned off
• Power strips in the back, top and bottom.

1.2.15. Teststand

• Switch off c1bhd I/O Chassis
• Switch off power supply in the bottom

1.2.16. 1X8 (Vacuum Rack)

• 16 AC power connections
• 2 UPS at the bottom
• Computers that should be shutdown by now:
  • c1vac
  • Lenovo laptop

If you switch off any of the power buttons on the rack, list them down here.

1.2.16.1. Power supplies

1.2.17. 1X9

• Computers that should be shutdown by now:
  • c1auxex

If you switch off any of the power buttons on the rack, list them down here.

• Turned off I/O chassis in the front and the back.
• Turned off Acromag chassis front switch.
• Turned off ac power strip in the back.

1.2.17.1. Power supplies

1.2.18. Xend Rack

• SR560 x2
• Function Generator
• uPDH Box powered with its own supply.

If you switch off any of the power buttons on the rack, list them down here.

• SR560 1
• SR560 2
• Function Generator
• uPDH box.

1.3. Lasers and other instruments

1.3.1. PSL

• Readings:

1.3.2. Vertex + PSL table

• Newport and other PD power supplies
• PSL laser controller
• Thorlabs HV (pzt) driver; reading 160.1 V
• Rb87 10 MHz frequency standard
• Thorlabs temperature controller

1.3.3. X end station

• Some uniphase box is powered on the right side of end station

If you switch off any of the power buttons on the rack, list them down here.

• Shutter Driver (switched off on the back)
• Innolight Laser controller (turned down the current, was 1.98 A; push off, flipped the key)
• Crystal Oven Temp controller on left side (TEC 200, 37.1 degrees celsius)
• Switched off AC power strips

1.3.4. Y end station

If you switch off any of the power buttons on the rack, list them down here.

• Uniphase box flipped the key
• Uniblitz shutter Driver (switched off on the back)
• Innolight AUX pump laser controller (was already off, flipped the key)
• Thorlabs crystal Oven Temp controller (TEC 200, 35.7 degrees celsius)
• Switched off AC power strips

1.3.5. Oplev Lasers

• Flipped keys on all oplev keys, was done sometime ago.

1.4. Control room equipment

• Shutdown following computers:
  • zita
  • donatella
  • allegra
  • pianosa
  • rossa
  • Giada
  • c1sim
• Network switches for Martian network

2. Startup

2.1. Office space

• Turned on network switches for martian network, and WiFi routers.

• Turned on windows (CAD) machine

2.2. Main network stations

• Power on network switches,
• Power on chiara (main nameserver)
• Power on nodus, try ping, try ssh.
• Power on fb1, try ssh.
• Power on paola (xend laptop), viviana (yend laptop), optimus, megatron.
• Restart PSL FSSSlow.service on megatron
• Restart elog on nodus
• Restart IMC autolocker on optimus

2.3. Control room equipment

• Power on zita
• Power on giada
• Power on donatella
• Power on allegra
• Power on pianosa
• Power on rossa

2.4. PSL + Vertex instruments

• Turn on newport PD power supplies on PSL table.

• Turn on TC200 temp controller on (setpoint --> 36.9 C)

• Turn on two oscilloscopes in PSL table.

• Turn on PSL (current setpoint --> 2.1 A, other settings seem nominal)

• Turn on Thorlabs HV pzt supply.

2.5. YEND and XEND instruments

• Turn on XEND AUX pump on (current setpoint --> 1.984 A)

• Turn on XEND AUX SHG oven on (setpoint --> 37.1 C), wait until see green beam.

• Turn on XEND AUX shutter controller on.

• Turn on DCPD supplies, OpLev supplies, and/or AC strips on.

• Turn on YEND AUX pump on (current setpoint --> )

• Turn on YEND AUX SHG oven on (setpoint -->35.7 C), wait until see green beam.

• Turn on YEND AUX shutter controller on.

• Turn on DCPD supplies, OpLev supplies, and/or AC strips on.

2.6. Other instruments

• Turn on ITMX OpLev / laser instrument AC strip.

2.7. Electronics racks

2.8. CDS Shutdown

2.8.1. Slow computers

2.8.2. Fast computers