|
Size: 4169
Comment:
|
Size: 5184
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 68: | Line 68: |
| * in /diskless/root apt install locales openssh-server man emacs-nox | * FIXME: tftpd-hpa and pxe setup * in /diskless/root * apt install locales openssh-server man emacs-nox nfs-client * FIXME: update initramfs: * /etc/initramfs-tools/initramfs.conf * /etc/initramfs-tools/modules * update-initramfs -u * FIXME: make script to setup/mount /diskless/root on fb1 * mount --bind /dev /diskless/root/dev * mount -t proc /proc /diskless/root/proc * chroot /diskless/root * apt install advligorts-rcg advligorts-fe * FIXME: need to install rtcds kernel for deb 10 for now, until rcg 5.0 dkms fixed for deb 10 * fix permissions on /opt/rtcds: * advligorts on NFS host for target * recursive group advligorts * setgid for all directories * umask for group write permission ## bugs: * bug finding generate_KisselButton.py: ``` Unable to find the following file in CDS_MEDM_PATH: SUS_SINGLE.adl ERROR: Could not find file: generate_KisselButton.py Searched path: /opt/rtcds/caltech/c1/post_build Exiting make: *** [Makefile:166: install-c1sus] Error 1 ``` |
Summer 2022 CDS system upgrade
The plan is to upgrade the 40m CDS system to latest RTS release. As of this writing, that would be advLigoRTS 4.2.8.
The basic plan:
- Set up a new rack midway down the Y arm (1Y3b).
- Move all 6 current front end machines, and FB, to the new rack.
- Install a new front end machine with support for AVX512 instructions in the new rack.
Run OneStop fiber between all the front ends and their IO chassis (which all stay in their current locations).
- Install Dolphin IX interconnect for all front ends in the new rack (drop all old RFM).
- IX card in all front ends
- IX switch in new rack
- Upgrade all machines (front ends (via diskless boot) and FB) to Debian 11 (or 10, whichever is currently in production at the sites).
- Install all needed software components via CDSSoft Debian 11 (or 10) archive.
Before the upgrade we will test the new software configuration on the 40m test stand.
We will assume that we will support up to 8 front end machines in the new system (7 will be present after the upgrade)
What do we need that we don't currently have:
- Dolphin IX cards and cables for 8 hosts, and an 8-port switch
Already received from Keith Thorne at LLO
7 OneStop cards+fiber for the machines that don't have it.
Being shipped from LHO
- KVM switch for the new rack.
- New front end machine with support for AVX512 instructions
What is the fastest model that has been tested with RTS 4.2.8?
What we need that we think we currently have (need to actually find and store these to avoid double counting):
- A Rack
- Some other FE machines for all of our running models? How many? Can we re-use some existing computers? NEED to TEST that new RTS works on these or we are in danger of hanging up the whole 40m during this upgrade.
- A framebuilder. I know is **SHOULD** work, but that's what we say about everything right before it doesn't work. Need to test this also and possibly buy a new FB if our old one has issues.
Items |
Quantity |
Description |
Status |
Action |
KVM 8-port Switch |
1 |
keyboard and display control switch |
unknown |
See table below for details |
OneStop Card |
17 |
PCIe extension from FE to IO chassis |
received |
|
OneStop Fibre (100 m) |
7 |
PCIe extension fibre |
received |
|
Dolphin IX Card |
8 |
FE RFM adapter card |
received |
|
Dolphin IX Cables |
8 |
FE to dolphin switch |
received |
|
Dolphin 8-port switch |
1 |
dolphin switch to connect all FE |
received |
|
Rack |
1 |
Rack to mount all FE machines, dolphin switch, KVM switch |
received |
|
Items |
Quantity |
Description |
Link |
Price |
|
KVM PS2 8-port Switch |
1 |
Keyboard and display control switch |
$429.95 |
|
|
PS/2 KVM Cable 6 Ft |
2 |
Converts the VGA to VGA + PS2 for the older computers |
$19.95 |
|
The FE machines initially spec'd for the teststand are c1sus2 and c1bhd. Currently, c1sus2 has been moved to the main system and c1bhd may be moved over in the near future, so I believe we need at least 2+ FE machines to have an operational teststand longterm. In the meantime, we need a new front-end to test dolphin communication with c1bhd.
Items |
Quantity |
Description |
Status |
Action |
Front-end (FE) machines |
2+ |
Needed to test dolphin communication |
received |
|
OSS-PCIE-HIB25-X4 Gen 2 Host Cable Adaptor. |
2+ |
OneStop companion card on FE |
unknown |
|
recipe
fb1
- debootstrap /diskless/root
- FIXME: tftpd-hpa and pxe setup
- in /diskless/root
- apt install locales openssh-server man emacs-nox nfs-client
- FIXME: update initramfs:
- /etc/initramfs-tools/initramfs.conf
- /etc/initramfs-tools/modules
- update-initramfs -u
- FIXME: make script to setup/mount /diskless/root on fb1
- mount --bind /dev /diskless/root/dev
- mount -t proc /proc /diskless/root/proc
- chroot /diskless/root
- apt install advligorts-rcg advligorts-fe
- FIXME: need to install rtcds kernel for deb 10 for now, until rcg 5.0 dkms fixed for deb 10
- fix permissions on /opt/rtcds:
- advligorts on NFS host for target
- recursive group advligorts
- setgid for all directories
- umask for group write permission
bug finding generate_KisselButton.py:
` Unable to find the following file in CDS_MEDM_PATH: SUS_SINGLE.adl ERROR: Could not find file: generate_KisselButton.py Searched path: /opt/rtcds/caltech/c1/post_build Exiting make: *** [Makefile:166: install-c1sus] Error 1 `