Differences between revisions 4 and 12 (spanning 8 versions)

Summer 2022 CDS system upgrade

The plan is to upgrade the 40m CDS system to latest RTS release. As of this writing, that would be advLigoRTS 4.2.8.

The basic plan:

Set up a new rack midway down the Y arm (1Y3b).
Move all 6 current front end machines, and FB, to the new rack.
Install a new front end machine with support for AVX512 instructions in the new rack.
Run OneStop fiber between all the front ends and their IO chassis (which all stay in their current locations).
Install Dolphin IX interconnect for all front ends in the new rack (drop all old RFM).
- IX card in all front ends
- IX switch in new rack
Upgrade all machines (front ends (via diskless boot) and FB) to Debian 11 (or 10, whichever is currently in production at the sites).
Install all needed software components via CDSSoft Debian 11 (or 10) archive.

Before the upgrade we will test the new software configuration on the 40m test stand.

We will assume that we will support up to 8 front end machines in the new system (7 will be present after the upgrade)

What do we need that we don't currently have:

Dolphin IX cards and cables for 8 hosts, and an 8-port switch
- Already received from Keith Thorne at LLO
7 OneStop cards+fiber for the machines that don't have it.
- Being shipped from LHO
KVM switch for the new rack.
New front end machine with support for AVX512 instructions
- What is the fastest model that has been tested with RTS 4.2.8?

What we need that we think we currently have (need to actually find and store these to avoid double counting):

A Rack
Some other FE machines for all of our running models? How many? Can we re-use some existing computers? NEED to TEST that new RTS works on these or we are in danger of hanging up the whole 40m during this upgrade.
A framebuilder. I know is **SHOULD** work, but that's what we say about everything right before it doesn't work. Need to test this also and possibly buy a new FB if our old one has issues.

Items	Length	Quantity	Description	Status
PCIe x4 fibre, OSS PCIe 1.0 x4 (8 Gb/s)	70 m	1	c1iscex to IO chassis	unknown
	50 m	2	c1sus,c1ioo to IO chassis	unknown
	30 m	1	c1iscey to IO chassis	unknown
	10 m	1	c1bhd to IO chassis	unknown
	5 m	2	c1lsc,c1sus2 to IO chassis	unknown
Front-end (FE) machines		2+	Needed to test dolphin communication	unknown
KVM 8-port Switch		1	keyboard and display control switch	unknown
OneStop Card		17	PCIe extension from FE to IO chassis	received
OneStop Fibre (100 m)		7	PCIe extension fibre	received
Dolphin IX Card		8	FE RFM adapter card	received
Dolphin IX Cables		8	FE to dolphin switch	received
Dolphin 8-port switch		1	dolphin switch to connect all FE	received
Rack		1	Rack to mount all FE machines, dolphin switch, KVM switch	received

-  ⇤ ← Revision 4 as of 2022-05-27 22:26:22 → 
  Size: 1287
  Editor: JamesonrollinsATligoDOTorg
  Comment:
+   ← Revision 12 as of 2022-08-04 22:57:53 → ⇥
  Size: 3291
  Editor: TegaedoATligoDOTorg
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 8:
-. Move all front end machines, and FB, to the new rack.
+. Move all 6 current front end machines, and FB, to the new rack.
 1. Install a new front end machine with support for AVX512 instructions in the new rack.
-Line 13:
+Line 14:
-. Upgrade all machines (front ends (via diskless boot) and FB) to Debian 11.
 1. Install all needed software components via CDSSoft Debian 11 archive.
+. Upgrade all machines (front ends (via diskless boot) and FB) to Debian 11 (or 10, whichever is currently in production at the sites).
 1. Install all needed software components via CDSSoft Debian 11 (or 10) archive.
-Line 18:
+Line 19:
-We will assume that we will support 8 front end machines in the new system
+We will assume that we will support up to 8 front end machines in the new system (7 will be present after the upgrade)
-Line 20:
+Line 21:
+----
-Line 23:
+Line 25:
-    * '''''Already on the way from Keith Thorne at LLO'''''
+    * '''''Already received from Keith Thorne at LLO'''''
-Line 25:
+Line 27:
-    * '''''Do LIGO have spares of this?  How do we acquire?'''''
+    * '''''Being shipped from LHO'''''
-Line 27:
+Line 29:
+. New front end machine with support for AVX512 instructions
    * '''''What is the fastest model that has been tested with RTS 4.2.8?'''''

What we need that we think we currently have (need to actually find and store these to avoid double counting):
 1. A Rack
 1. Some other FE machines for all of our running models? How many? Can we re-use some existing computers? NEED to TEST that new RTS works on these or we are in danger of hanging up the whole 40m during this upgrade.
 1. A framebuilder. I know is **SHOULD** work, but that's what we say about everything right before it doesn't work. Need to test this also and possibly buy a new FB if our old one has issues.
----
|| Items || Length || Quantity || Description || Status ||
||<|5> PCIe x4 fibre, OSS PCIe 1.0 x4 (8 Gb/s) || 70 m|| 1 || c1iscex to IO chassis ||<#FF0000> unknown||
|| 50 m|| 2 || c1sus,c1ioo to IO chassis ||<#FF0000> unknown||
|| 30 m|| 1 || c1iscey to IO chassis ||<#FF0000> unknown||
|| 10 m|| 1 || c1bhd to IO chassis ||<#FF0000> unknown||
|| 5 m || 2 || c1lsc,c1sus2 to IO chassis ||<#FF0000> unknown||
||<-2> Front-end (FE) machines || 2+ || Needed to test dolphin communication||<#FF0000> unknown||
||<-2> KVM 8-port Switch || 1 || keyboard and display control switch ||<#FF0000> unknown||
||<-2> OneStop Card || 17 || PCIe extension from FE to IO chassis ||<#00FF00> received||
||<-2> OneStop Fibre (100 m) || 7 || PCIe extension fibre ||<#00FF00> received||
||<-2> Dolphin IX Card || 8 || FE RFM adapter card ||<#00FF00> received||
||<-2> Dolphin IX Cables || 8 || FE to dolphin switch ||<#00FF00> received||
||<-2> Dolphin 8-port switch || 1 || dolphin switch to connect all FE ||<#00FF00> received||
||<-2> Rack || 1 || Rack to mount all FE machines, dolphin switch, KVM switch ||<#00FF00> received||