Electronics PDR

1
Electronics PDR

• Stephen Guiwits
• Dean Palmer
• Ernest Croner
• 023 Robinson Room
• January 21, 2009

2
Agenda

• Overview
• Major sub-systems
• Real-Time Electronics (Computer Room)
• Active Mirror Electronics (Cassegrain Cage / AO
  Lab)
• AO Bench Electronics (Cassegrain Cage / AO Lab)
• Data Room Electronics (Data Room / AO Lab)
• Palomar Infrastructure Upgrades
• Milestones
• Costs
• Questions, Comments, or Suggestions

3
Overview
4
Real-Time Control Electronics

• Design
• Layout
• Racks
• Make / Model
• Capacity
• Computing Machines
• Make / Model
• PCI Cards
• Cabling
• Switches
• Quadrics
• Network
• KVM
• Uninterruptible Power Supply (UPS)
• Make / Model

4
5
RTC Design

• Cluster of 10 PCs in the computer room
• Real-time calculations performed on 16 Nvidia
  GPUs
• PC 0 provides the interface, central scheduling,
  and control of the cluster
• PC 1 PC 8 house the GPUs
• PC 9 is dedicated to telemetry recording
• Cluster communication provided by the high speed
  Quadrics switch
• 2 complete systems for production and development

6
Real-Time Control Electronics

• Layout

7
Real-Time Control Electronics

• Racks
• Make / Model
• Shark Rack
• T2 Base Rack (x 4)
• Part Number T2EC016-A
• Capacity
• 42U (1U 1.75 Inches)
• 37 Deep Frame

8
Real-Time Control Electronics

• Racks
• 4 Total
• Production / Development
• Front Door, Fully Vented
• Rear Door, Fully Vented
• 42U Mounting Rails
• Fan Top Panel
• 19 inch Fixed Shelf w/Adjustable Mounting
  Brackets

• T2

9
Real-Time Control Electronics

• Computing Machines
• Make / Model
• PC 0 PC 8
• HP xw9400
• Two Dual Core AMD Opteron 2220, 2.80 GHz
  Processors
• 4 GB (4x1GB) DDR2-667 ECC RAM
• 80 GB SATA 7200 RPM HDD
• Telemetry PC
• HP xw9400
• Two Dual Core AMD Opteron 2212, 2GHz Processors
• 32GB (8x4GB) DDR20533 ECC
• 160 GB SATA 10K RPM HDD
• NVIDIA Quadro NVS 285 Graphics Card

10
Real-Time Control Electronics

• Computing Machines
• PC 9

11
Real-Time Control Electronics

• Computing Machines
• PC 0
• For LGS
• UTT
• Slot 4
• IP Carrier Card
• Acromag
• APC8621A
• D/A
• Acromag
• IP 231E

12
Real-Time Control Electronics

• Computing Machines
• PC 1 - 8

13
Real-Time Control Electronics

• Computing Machines
• Cabling
• Telemetry PC
• Standard power cable to power strip on the rack
• 1 Coaxial Cable from timing board to PC 0s
  timing board
• 1 SC-SC fiber cable from QLogic card to RAID
  system
• 3M Quadrics cable from Quadrics PCI card to
  Quadrics switch
• 3M RJ 45 cable from ethernet 1 to network switch
  (port 9)
• 3M USB cable from USB 1 to KVM switch (port 9)
• 3M DVI cable from DVI (graphics card) to KVM
  Switch (port 9)

14
Real-Time Control Electronics

• Computing Machines
• Cabling
• PC 0
• Standard power cable to power strip on the rack
• 300 cross over cable from ethernet port 2 to
  ethernet port 2 on the cassegrain cage PC (pc
  lt--gt pc communication)
• 1 Coaxial Cable from timing board to PC Telems
  timing board
• 1M Camera link cable from EDT PCI card to
  SciMeasure Optical Splitter
• 3M Quadrics cable from Quadrics PCI card to
  Quadrics switch
• 3M RJ 45 cable from ethernet 1 to network switch
  (port 0)
• 3M USB cable from USB 1 to KVM switch (port 10)
• 3M DVI cable from DVI (graphics card) to KVM
  Switch (port 10)

15
Real-Time Control Electronics

• Computing Machines
• Cabling
• PC 0 (Continued)
• 300 fiber (lc-lc) from FibreExtreme port 1
  (through cable wrap) to the custom HO DM I/F box
  located on DM Rack 1
• 300 fiber (lc-lc) from FibreExtreme port 1
  (through cable wrap) to the custom HO DM I/F box
  located on DM Rack 2
• 300 fiber (lc-lc) from FibreExtreme port 2
  (through cable wrap) to the custom LO DM I/F box
  located on DM Rack 2
• 300 fiber (lc-lc) from FibreExtreme port 3
  (through cable wrap) to the custom TTM I/F box
  located on AO Control Rack 2

16
Real-Time Control Electronics

• Computing Machines
• Cabling
• PC 1 PC 8
• Standard power cable to power strip on the rack
• 1M Camera link cable from EDT PCI card to
  SciMeasure Optical Splitter
• 3M Quadrics cable from Quadrics PCI card to
  Quadrics switch
• 3M RJ 45 cable from ethernet 1 to network switch
  (port ltpc gt)
• 3M USB cable from USB 1 to KVM switch (port ltpc
  gt)
• 3M DVI cable from DVI (graphics card) to KVM
  Switch (port ltpc )

17
Real-Time Control Electronics
18
Real-Time Control Electronics

• Switches
• Quadrics
• QsNet II (16 way solution)
• 1064 Mbytes/s
• 900 MB/S Sustainable
• Network
• EtherFast 4116 16-Port 10/100 Ethernet Switch
• Model Number EF4116
• KVM
• KVMS 16 port USB DVI KVM Switch
• 17 Inch LCD Monitor / Keyboard drawer
• Model Number UNIMUX-DVI-16

19
Real-Time Control Electronics

• Uninterruptible Power Supply (UPS)
• Make / Model
• American Power Conversion Corp (APC)
• APC AIS 3000
• Part Number ISVT15KF2B4S
• 18 minutes of uptime
• Allows for a little expansion if needed
• Cost 11,000 (if expansion desired)
• Cost 8,000 (no expansion)

20
Active Mirror Control Electronics

• Active Mirror Electronics

20
21
Active Mirror Control Electronics

• Design
• DM Control
• DM High-Speed Data Link
• HO DM
• LO DM
• TTM
• DM Drivers
• Cabling
• Cooling
• Liquid
• Design
• Hardware
• Costs
• Air
• Design
• Hardware
• Costs
• Rack Locations inside the cassegrain cage

21
22
Active Mirror Control Electronics

• HODM control through 8 Xinetics GenIII Driver
  Chassis each of which can control 480 Channels
• LODM control is provided by the existing JPL
  electronics
• Able to fit all DM driver electronics into two
  full size racks
• DM Driver Electronics require cooling
• Intend to air cool them the lab during lab
  development
• Air cooled design in place
• Developing a liquid cooling design for location
  at cassegrain cage and AO lab
• Two phases of cabling
• Phase 1 Lab Development
• Use Xinetics provided interface panels with 99
  omnetics connectors to the DM
• Phase 2
• Build custom interface boxes to 16 custom cables
  that allow us greater flexibility in location of
  cables
• Provide serial interface to configure and monitor
  driver states
• Provide high speed SOR-422U interface for DM
  control

22
23
Active Mirror Control Electronics

• Provide serial interface to configure and monitor
  driver states
• Currently planning on using a terminal server
  configuration to communicate with the driver
• Xinetics is working on a master/slave
  configuration which would allow communication
  with each driver through the master. If this
  works, we will abandon the terminal server
  design.
• Provide high speed SOR-422U interface for DM
  control

23
24
DM High-Speed Data Link

• Transmit End
• Curtiss Wright FibreXtreme SL240 PCIe 2.5 Gb/s
  Data Link Card
• Up to 247 MB/s per channel sustained data rate
  per channel
• Low overhead ANSI/VITA 17.1-2003 Serial FPDP
  Protocol
• Based on Fiber Channel. Uses similar ordered
  sets
• Low latency (about 1us)
• 4 independent channels

25
DM High-Speed Data Link

• Receive End
• Curtiss Wright FibreXtreme SL240 CMC 2.5 Gb/s
  Data Link Card
• IEEE P1386 Common Mezzanine Card form factor
  (same as PMC)
• 32-bit parallel FPDP data bus _at_ 62.5 MHz

• Custom Carrier Board
• 6U VME form factor. FPGA based.
• Four SOR-422U parallel output ports for
  connection to Xinetics Drivers.
• P1 port for connection to LODM and TTM
  amplifiers.

26
DM High-Speed Data Link Architecture
27
Active Mirror Control Electronics
16 cables with 375-pin Hypertronics connectors
99 cables with 51-pin Omnetics connectors
28
Active Mirror Control Electronics

• HO DM Cabling

28
29
Active Mirror Control Electronics

• HO DM Cabling

29
30
Active Mirror Control Electronics

• Layout (Liquid Rack 1)

30
31
Active Mirror Control Electronics

• Layout (Liquid Rack 2)

31
32
Active Mirror Control Electronics

• Layout (Air Rack 1)

32
33
Active Mirror Control Electronics

• Layout (Air Rack 2)

33
34
Active Mirror Control Electronics

• Rack locations inside the cassegrain cage
• DM racks located in 2 and 3

35
AO Bench Electronics

• AO Bench Electronics

35
36
AO Bench Electronics

• Design
• Layout
• Workstation Computer
• Make / Model
• PCI Cards
• Cabling
• Motion Control
• Make / Models
• Cabling
• Monster Motor Cable
• Design
• Cable / Connector
• Cost
• Rack Locations inside the cassegrain cage

36
37
AO Bench Electronics

• Two 24U Bud Industry Racks
• Rack mounted PC provides supervisory control for
  AO bench devices
• 4 Motion Controllers
• 2 SciMeasure Controllers (1 NGS)
• Light Sources (Laser and White Light)
• New Monster Motor Cable
• TTM Custom Interface Box

38
AO Bench Electronics

• Layout (Rack 1)

39
AO Bench Electronics

• Layout (Rack 2)

40
AO Bench Electronics

• Computer
• Make / Model
• Advanced Industrial Computer
• RMC-4S-2
• Rack Mount
• 7 PCI Slots
• 0C 50C
• PCI Cards
• PCI IP Carrier Card
• Acromag
• APC8621E

40
41
AO Bench Electronics

• Computer (Continued)
• PCI Cards
• Digital I/O
• IP470A
• 48 bi-directional input/output channels
• TTL compatible inputs
• Extended temperature range
• 425.00
• Connects to a custom board inside the monster
  motor cable box which is then routed to a break
  out box and connected to the white light source.
  We will re-use the existing hardware and cables.

41
42
AO Bench Electronics

• Computer (Continued)
• PCI Cards
• Engineering Design Team (EDT)
• PCI DV C-Link
• Communication with the acquisition camera
• Direct 5M camera link cable connection

42
43
AO Bench Electronics

• Computer (Continued)
• Ethernet
• Connects to PC 0 via a 300 crossover cable
• Gigabit Ethernet (For Video Data Transfer)
• Connection through the Palomar cable wrap

43
44
AO Bench Electronics

• Motion Control
• Make / Models
• Aerotech (2)
• Ensemble EPAQ
• 6 Axis
• RS 232 communication
• 6 ATS 50 motors (4 for stimulus, 1 for
  acquisition camera)
• 1 ATS 100 (Stimulus fold mirror Replaces
  current 850E)
• 1 ATS 150 (HOWFS focus stage)
• 4 AOM 130 (SSMs, each with external encoder)

44
45
AO Bench Electronics

• Motion Control
• Make / Models
• Newport (2)
• ESP 300
• 3 Axis
• RS 232 communication
• 2 MFA-CC (HOWFS Lenslet Changer)
• 1 UTS50CC (HOWFS Camera Focus)
• 2 LTA-HS (Second ESP300 to support OAR experiment)

45
46
Motor Cable Interface

• Cable Design
• We are not planning on reusing the existing
  cable.
• Not enough conductors.
• No shielded twisted pairs (desirable for encoder
  signals).
• Scheduling conflicts.
• Note Could be made to work with secondary power
  cable and remote sense encoder / limit
  switch power.
• Two Cable Design to separate power signals from
  low-level signals
• Signal Cable (custom made)
• 78 26 AWG shielded twisted pairs for encoder
  signals
• 132 26 AWG single conductors for limit switches,
  hall sensors, etc.
• 10 20 AWG single conductors for encoder, limit
  switch, and camera power
• Hypertronics NPJY23 / 2HFR/1NMRR/4HFR/1NMRR/2HRF
  connectors
• Power Cable (custom made)
• 20 20 AWG shielded quads for motor power
• 8 RG316 coaxes for PZTs
• Hypertronics NPJY23/13NMRR/2VMR connectors

47
Motor Cable Interface

• Interface Boxes
• Rack Box
• 5V remote sense P.S. for encoders and limit
  switches
• 12V power supply for acquisition camera
• D-sub connectors to motor controllers
• Lemo connectors to TTM Interface
• Bench Box
• Distribute 5V power
• D-sub connectors to motorized stages
• Lemo connectors to FSM
• Hirose connector to acquistion camera

48
Motor Cable Interface
49
AO Bench Electronics

• AO Bench Control Cassegrain Rack Locations
• AO bench racks located in 4 and 6

50
Data Room Electronics

• Data Room Electronics

50
51
Data Room Electronics

• Design

51
52
Data Room Electronics

• Make / Model
• HP xw9400 Workstation
• 4 GB RAM
• 3,000.00
• Monitors
• HP w2207h 22-inch Widescreen Flat Panel Monitor x
  3
• 300.00 each
• UPS
• Back-UPS ES
• 100.00
• Mobility
• Custom made table that will move between the data
  room and the AO lab
• Already built
• Locations
• AO Lab
• Palomar Data Room

52
53
Palomar Upgrades

• Palomar Infrastructure

53
54
Palomar Infrastructure Upgrades

• Palomar will require upgrades to handle the P3K
  AO System
• Power at cassegrain cage
• 10kW
• Active cooling at cassegrain and AO Lab (if
  funded)
• Cooling lines
• Chiller
• Routing of cables
• RTC DM fibers
• RTC Cassegrain Computer
• Cables must also run to the AO lab during non
  telescope time.
• Cooling to computer room
• RTC System produces a significant amount of heat
• Power upgrades (10kW)
• Computer room reorganization

54
55
Electronics Milestones

• RTC procured 2/25/2008 ?
• Electronics PDR 1/21/2009 ?
• DM racks integrated 1/4/2009 ?
• HODM only, air cooled
• Control racks integrated 10/29/2009 ?
• Cass PC, HOWFS, 2 motor controllers
• P3K closed-loop testbed complete 3/1/2010 ?
• Pre-ship Review 4/6/2010 ?
• Production racks and cables integrated 8/10/2010 ?
  
• LODM, cable interfaces, stimulus, etc.
• PALM-3000 first light 10/1/2010 ?

55
56
Costs

• Costs spreadsheet
• Comprehensive list of
• Electronic component
• Price
• Procured / To be procured

57
Questions, Comments, Suggestions