Download Status of SSRF control system

STATUS OF SSRF CONTROL SYSTEM
@EPICS collaboration meeting 2008
Shen Liren
SSRF Control group
[email protected]
2008-3-12
Control system status
•
•
•
•
•
The development & runtime environment of hardware/software has
been set up(include high level physical application environment):
– Control system network & server system
– Epics environment
– Matlab 2007a with Accelerator Toolbox (AT) & middle layer
Have tested all of device controller:
– VME system, PLC, Serial device controller etc.
– Prepared, done all related EPICS driver testing.
All Subsystem control schema for the machine were confirmed and
tested prototype under the control system environment.
As yet, All the control system of Linac, Booster & Ring has been
finished and used during commissioning.
Now was delivered for daily operation and works fine.
Control Group
SSRF CN, Shanghai, 2008
SSRF Control system overview
公共网络
VPN客户端
路由器
• EPICS based control system
• Connected by 2G Backbone
Ethernet with backbone
redundancy for the whole system
OPI
OPI
OPI
防火墙
OPI
VPN服务器
数据库服务器
SAN
应用服务器
核心交换机
DNS/LDAP
RADIUS
DC etc
储存环1 5
IOC
增强器1 2
直线
一层实验室
1 5
线站1 7
计算机
计算机
计算机
二层实验室
1 5
计算机
计算机
计算机
• For LINAC, Booster, Storage ring
control, MPS, Timing System &
the Software System
• Using Ethernet as fieldbus
– Ethernet based PLC
– Serial 2 Ethernet translate for
serial device
– Soft IOC
Control Group
SSRF CN, Shanghai, 2008
Environment of Control system
• The development and runtime environment of control system
have been set up and come into use.
• Composed with the control system network system, server
system and OPI system.
• Uniform running and development environment.
• Developer and operator can login in on any terminal and share
resource of entire environment with one account system.
Control Group
SSRF CN, Shanghai, 2008
Control System Network
•1000M Ethernet with 3 layer
switcher
•backbone reach 2G.
•Control system sub lan by VLAN
•Division and recombine
•Full Network manage ability and
application oriented Qos
•Backbone redundancy design to
ensure reliability
•Remote access and monitor
PS system
•Sub system division by VALN
•10.30.X.X/24
•Static 3 layer route table
•Access List table for access control
•Can be integrated other system easy in
future
Control Group
BI system
…
Server system
OPI
SSRF CN , Shanghai, 2008
Development and runtime enviroment
• Set up the uniform development environment which base on
PC Linux system for development and operations.
• All of the OPI and the server system running the fedora 7
system for supply the EPICS development and high level
physics application environment.
• Using NIS and NFS to manage user account and share
resource. As part of runtime environment, the database server,
boot server, Soft IOC server and EPICS application server
such archive and alarm handler were installed at the server
room.
Control Group
SSRF CN, Shanghai, 2008
Server System
• Two kinds of server:
– Linux & Windows Server
• Integrated with Windows UNIX service 3.5
– The operation system
• Fedora core 7
• Windows 2003 R2 64bit & 32bit
• Different application on different type of server
– NIS, YUM, PXE, NFS, NTP, Windows AD, Epics Boot, Soft IOC,
Archive, Alarm, Database, Web Service, WEB, e-Log etc.
• User can log on the any terminal with one set of account
• User’s home on one NFS Server
Control Group
SSRF CN, Shanghai, 2008
Hardware system
• Uniform hardware design, as typical implementation of SSRF
control system have:
–
–
–
–
–
–
Ethernet everywhere
VME 64x System : GE VMIVME-7050 and Motorola MV5500.
PLC system: Yokogawa FM3, SIEMENS S300.
Serial port server MOXA NPort-5610.
The embedded controller: Digital power supply controller
VME board:
• Timing system: VME-EVG-230, VME-EVR-230, EVR-TTB-200,
EVR-OTB-200
• PS control system: VIPC 664
– Linux PC server (SoftIOC)
• Multi IOC running configure
• IOC management
Control Group
SSRF CN , Shanghai, 2008
VME 64X System
VME 64X crate
by Elma
4U 7Slot
9U 12 Sloat
•
CPU:
– Motorola MV5500
– GE VMIVME-7050
With the crate
monitor system
with Ethernet or
Serial port
Support Telnet,
Http
integrated with
EPICS
Control Group
SSRF
SSRF
CN CN,
Review,
Shanghai,
Shanghai,
20072008
Hardware
• Serial 2 Ethernet translate
MOXA NPort
5610-16
MOXA UC
Embedded Linux
DI/DO
PLC
System
Control Group
SSRF CN, Shanghai, 2008
Software System
• The SSRF control system running on EPICS base v3.14.8.2
• OPI
– EDM and some Python script
• High level physics application
– Matlab v2007a
– MCA/LabCA
– Accelerator Toolbox (AT) & middle layer was adopted.
• Perl/Python, Qt3
• CodeGear RAD Studio 2007(Borland C++/Delphi)
– EPICS base 3.14.8.2
Control Group
SSRF CN, Shanghai, 2008
Online Device test using AT@ Matlab
Control Group
SSRF CN Review, Shanghai, 2006
Centralize EPICS Develpoment platform
• Hardware
– HP Rack PC Server 580GG4
– Xeon 3.0G/8G RAM/300G SCSI HD
• Software
– OS
• Linux FC7/Kernel 2.6x/GCC 4.xx
– EPICS base
• 3.13.9/3.14.8.2/3.14.7/3.14.6/3.14.5
– Extensions
• Edm/medm/SDDS/Archiver/Sequencer/etc.
– Cross-compiler environment
• Gcc 2.8x/gcc 2.96/gcc 2.96 patch
• Target
– Motorola VME 5500/GE VME 7050/ Motorola VME2302
Control Group
SSRF CN Review, Shanghai, 2006
Centre Database System
• Store the machine parameters and reference information for all
stage of machine simulation and running.
• Access and set various accelerator run time configure
parameters, failure report and invalid record of all system.
• Store accelerator runtime data using enhance channel archive
system.
• Integrated with uniform authentication system, uniform
database access rule and data integrality.
• Remote access from Internet and web based database access
also could be applied.
Control Group
SSRF CN, Shanghai, 2008
Database System
• The hardware platform using SAN & database server cluster.
• Now we have tested on the MS SQL Server 2005 and will
transfer to Oracle 10g with RAC later.
Control Group
SSRF CN, Shanghai, 2008
Data archive & analysis tools
• Distributed archive engine with center relational database
• Native XML data type with xml schema for data storage
• Developed a data retrieval system based XML Web Services
to access the archived data.
• The system included bottom layer interface and interface
applicably for accelerator physics as well as client samples
exemplifying how to use the interface.
• Tools for users that can browse, retrieve and plot data
• By the client samples, user can development their own
application.
• Memo: not be used now, just in test progress
Control Group
SSRF CN , Shanghai, 2008
Data archive & analysis tools
Control Group
SSRF CN, Shanghai, 2008
e-Log System
•
•
•
•
Based on center database system
Using Web2.0 Blog system
Support RSS
Integrated with uniform authentication system
Control Group
SSRF CN, Shanghai, 2008
SSRF Control System
• Three part of control system:
– Linac, Booster, Storage Ring
– Magnet PS, Vacuum, Modulator, e-gun, Microwave, Transport
Line(inject&extract ), Timing, MPS, RF, Software
•
•
•
•
•
System
Power supply
Vaccum system
MPS system
Timing system
Control Group
device IOC
585
26
730
25
25
3
16
16
PV
60000
23298
16842
540
SSRF CN, Shanghai, 2008
EDM OPI of Linac control system
Control Group
SSRF CN Shanghai, 2008
PS Control System
• Over 550 magnet power supplies are used at SSRF
• All magnet PS are digital controlled
• 2 types of digital controller used:
– SINAP-developed digital PS controller:
• served for LINAC, Booster and Transport Lines
– PSI-designed digital controllers (Purchased from DLS Co., Ltd):
• served for Storage Ring and the Booster Ramp PS.
• Performance of high stability and reliability has been
demonstrated since SSRF commission.
Control Group
SSRF CN, Shanghai, 2008
Digital Power Supply Control system
•
•
•
•
Two kinds of system
Set up the prototype system
All system testing have been done
EPICS integrated
Control Group
SSRF CN, Shanghai, 2008
Digital Power supply control system
Control Group
SSRF CN , Shanghai, 2008
Statistics
Section
PS
IOC
Record
Cost(CNY)
Linac
50
1
3.0K
0.6M
Linac-to-Booster
21
1
1.3K
0.3M
Booster
58
2
4.0K
0.8M
Booster-to-Ring
25
1
1.7K
0.4M
Storage ring
431
22
50.0K
7.0M
Total
585
27
60.0K
9.1M
Control Group
SSRF CN, Shanghai, 2008
PS Control System
Control Group
SSRF CN, Shanghai, 2008
Booster PS Control System - in house design
Control Group
SSRF CN, Shanghai, 2008
Vacuum Control System
• Device based on serial port
–
–
–
–
•
Vacuum Gauge: VARIAN Multi Gauge
Sputter Ion Pump: JJJvac Sputter Ion Pump Power Supply
VAT
RGA（Residual Gas Analyzer）
Vacuum Valve
– PLC system
Control Group
SSRF CN, Shanghai, 2008
Vacuum Control System
• Serial Device Server: MOXA Nport 5610-16
– Total 53
• Gauge Controller: VARIAN MultiGauge
– Total 72, with 140 BA Gauges
• Pump Power Supply: JJJVac IPS & TSPC
– Total 406 IPS, with 406 Ion Pumps
– Total 229 TSPC, with 229TSP
• Valves: VAT
– Total 41
Control Group
SSRF CN, Shanghai, 2008
Vacuum Control System
OPI
RGA Monitor
PC/Windows
Ethernet
IOC
PC/Linux
Ethernet
Serial Device Server: MOXA NP5610
RS - 232
Pump Power
Supply
Gauge
Controller
Contact
Signal
PLC
Related
Systems
Valve Controller
RGA
Control Group
Pump
Gauge
Valves
I nterlock
Signals
Thermocouple
SSRF CN, Shanghai, 2008
Vacuum Control System
Control Group
SSRF CN, Shanghai, 2008
Vacuum Control
Control Group
SSRF
SSRF
CN CN,
Review,
Shanghai,
Shanghai,
20082006
Vacuum device control with MOXA UC7400
•
•
Serial device control with EPICS
embedded
Create new make files
–
•
make EPICS base support “linux-xscale”
target
IOC
IOC


Create new driver API on Monta vista
linux
–
–
W
Protocol converter between BSD socket
protocol and proprietary protocol
Using non-block mode to solve timeout
connections
Power supply of Ion pump
Control Group
OPI
OPI
A
R
N
I
UC7400
NPORT-5610
N
G
Various serial devices
Various serial devices
Edm GUI
SSRF CN , Shanghai, 2008
The event timing system
•
– Structure is simple used
broadcasting method
– Low Jitter with distributed RF clock
– Run on the EPCIS environment, base
3.14.x
– Easy to extend
C10
C11
SR3
C09
SR2
C12
C08
FAN2-1
C13
FAN2-2
SR4
SR1
C07
C14
C06
LN1
RF
FAN2-5
C15 SR5
•
EVG
FAN1
FAN2-7
BR2
BL
SR10 C05
•
C16
C04
C17
SR6
SR9
FAN2-3
C18
BR1
FAN2-4
C03
FAN2-6
µçÀÂ²Û¼Ü SR7
C19
SR8
C20
C01
New event timing system
•
Compact network based on
characteristic event system.
All EVRs are placed on timing crates
and BI local stations not being
triggered devices
All trigger outputs integrate with
hardware interlocks
Second level brunches, ~ 250m
C02
BL
Third level brunches, ~ 60m
Fouth level brunches
(plastic fibers), ~35m
SR: Storage Ring local station ,assuming 10
BR: Booster Ring local station ,assuming 2
LN: Linac local station ,assuming 1
Control Group
SSRF CN, Shanghai, 2008
EVR-OEB-200
FAN2-6
Master
499.65MHz
0dbm
~1m coaxial cables with phase stabilized
60m Multimode fiber
WME-FOUT-12
Hardware Schematic
RF Local Station
Power
devider
-3db
SR RF Local Station
Master
489.65MHz
Power
-3db devider
LPF
LVPECL
FAN2-1
TTL 50 Hz ·½²¨
WME-FOUT-12
ÕýÏÒ²¨ /
·½²¨
VME-EVG-230
(VME 64x)
310m Multimode Fiber
EVR-OEB-200
VME-EVR-230
(VME 64x)
EVR-TTB-200
(VME64x)
VME-EVR-230
(VME 64x)
Booster Ring Local Station
Control Group
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
SR-BI:H11EVR1:Srf1
SR-BI:H11EVR1:Srf1
SR-BI:H11EVR1:Sinj1
SR-BI:H11EVR1:Sinj2
SR-BI:H11EVR1:4KHz
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
SR-BI:H13EVR1:Srf1
SR-BI:H13EVR1:Srf1
SR-BI:H13EVR1:Sinj1
SR-BI:H13EVR1:Sinj2
SR-BI:H13EVR1:Sinj3
SR-BI:H13EVR1:4KHz
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
VME-EVR-230
(VME 64x)
EVR-OTB-200
(VME64x)
FAN2-8
EVR-OTB-200
(VME64x)
FAN2-5
WME-FOUT-12
EVR-OEB-200
BS-BI:H02EVR1:Brf1
BS-BI:H02EVR1:Brf2
BS-BI:H02EVR1:Binj1
BS-BI:H02EVR1:Binj2
BS-BI:H02EVR1:Binj3
FAN2-4
60m Multimode fiber
BS-CN:H02InjSept
EVR-OEB-200
VME-EVR-230
(VME 64x)
WME-FOUT-12
BS-CN:H02InjKick
EVR-TTB-200
(VME64x)
60m Multimode fiber
BS-CN:H02RF
EVR-OEB-200
VME-EVR-230
(VME 64x)
WME-FOUT-12
BS-CN:H01EVR1ExtBump3
EVR-OEB-200
EVR-OTB-200
(VME64x)
FAN1
60m Multimode fiber
BS-CN:H01EVR1ExtBump1
BS-CN:H01EVR1ExtBump2
BS-CN:H01EVR2PSB1
BS-CN:H01EVR2PSB2
BS-CN:H01EVR2PSQF
BS-CN:H01EVR2PSQD
BS-CN:H01EVR2PSSD
BS-CN:H01EVR2PSSF
BS-BI:H01EVR1:Brf1
BS-BI:H01EVR1:Brf2
BS-BI:H01EVR1:Binj1
BS-BI:H01EVR1:Binj2
BS-BI:H01EVR1:Binj3
BS-BI:H01EVR1:Binj4
BS-BI:H01EVR1:Binj5
VME-EVR-230
(VME 64x)
WME-FOUT-12
EVR-OEB-200
BS-CN:H01EVR1ExtSept2
BS-CN:H01ExtEVR1Sept3
EVR-OTB-200
(VME64x)
60m Multimode fiber
BS-CN:H01EVR1ExtKick
BS-CN:H01ExtEVR1Sept1
EVR-OTB-200
(VME64x)
FAN2-3
WME-FOUT-12
FAN2-9
WME-FOUT-12
Linac Control Local Station
250m Multimode fiber
VME-EVR-230
(VME 64x)
VME-FOUT-12
EVR-TTB-200
(VME64x)
250m Multimode fiber
EVR-OEB-200
VME-EVR-230
(VME 64x)
WME-FOUT-12
EVR-OEB-200
LA-BI:BPM-Guntrig02
LA-BI:BCM-Guntrig03
LA-BI:ADC-Guntrig04
LA-BI:CMR-Guntrig05
LA-BI:OSG-Guntrig06
EVR-OTB-200
(VME64x)
2m coaxial cable
LA-CN:EVR1PMod2
LA-CN:EVR1Mod2
EVR-OEB-200
35m plastic fiber
LA-CN:EVR1Mod1
FAN2-7
EVR-OEB-200
LA-CN:EVR1Samp2
LA-CN:EVR1Samp3
LA-CN:EVR1PMod1
FAN2-2
60m Multimode fiber
LA-CN:EVR1Samp1
1m Multimode fiber
LVPECL 499.65MHz
60m Multimode fiber 60m Multimode fiber
LA-CN:EVR1Gun
35m Multimode fiber
Gun-Tx-200
Gun-Rc
(VME64x)
-200
VME-EVR-230
(VME 64x)
A/D
LPF
50Hz 220VAC Transformer 50Hz 5VAC
Phase
Shift
D/A
60m Multimode fiber
Ö÷¶¨ ʱ»ú¹ñ
µçÔ´²å ×ù
BPF
EVR-OTB-200
(VME64x)
A/D
CPU
VME-EVR-230 +
(VME 64x)
-
EVR-OEB-200
VME-EVR-230
(VME 64x)
EVR-OEB-200
SR-BI:H01EVR1:Srf1
SR-BI:H01EVR1:Srf1
SR-BI:H01EVR1:Sinj1
SR-BI:H01EVR1:Sinj2
SR-BI:H01EVR1:Sinj3
SR-BI:H01EVR1:4KHz
SR-BI:?01EVR1:Srf1
SR-BI:?01EVR1:Srf1
SR-BI:?01EVR1:Sinj1
SR-BI:?01EVR1:Sinj2
SR-BI:?01EVR1:Sinj3
SR-BI:?01EVR1:500M
SR-BI:H03EVR1:Srf1
SR-BI:H03EVR1:Srf2
SR-BI:H03EVR1:Sinj1
SR-BI:H03EVR1:Sinj2
SR-BI:H03EVR1:4KHz
SR-BI:H05EVR1:Srf1
SR-BI:H05EVR1:Srf1
SR-BI:H05EVR1:Sinj1
SR-BI:H05EVR1:Sinj2
SR-BI:H05EVR1:Sinj3
SR-BI:H05EVR1:4KHz
SR-BI:H07EVR1:Srf1
SR-BI:H07EVR1:Srf1
SR-BI:H07EVR1:Sinj1
SR-BI:H07EVR1:Sinj2
SR-BI:H07EVR1:4KHz
SR-BI:H09EVR1:Srf1
SR-BI:H09EVR1:Srf1
SR-BI:H09EVR1:Sinj1
SR-BI:H09EVR1:Sinj2
SR-BI:H09EVR1:Sinj3
SR-BI:H09EVR1:4KHz
SR-BI:H15EVR1:Srf1
SR-BI:H15EVR1:Srf1
SR-BI:H15EVR1:Sinj1
SR-BI:H15EVR1:Sinj2
SR-BI:H15EVR1:4KHz
SR-BI:H17EVR1:Srf1
SR-BI:H17EVR1:Srf1
SR-BI:H17EVR1:Sinj1
SR-BI:H17EVR1:Sinj2
SR-BI:H17EVR1:Sinj3
SR-BI:H17EVR1:4KHz
SR-BI:H19EVR1:Srf1
SR-BI:H19EVR1:Srf1
SR-BI:H19EVR1:Sinj1
SR-BI:H19EVR1:Sinj2
SR-BI:H19EVR1:4KHz
SSRF CN, Shanghai, 2008
Storage Ring Local Stations
SR-CN:H20EVR1:InjKick
SR-CN:H20EVR1:InjKick
SR-CN:H20EVR1:InjKick
SR-CN:H20EVR1:InjKick
SR-CN:H20EVR1:InjSept
SR-CN:H20EVR1:InjSept
Performance
• The RMS jitter of gun trigger relative to RF reference is
10.72ps, which includes the jitter of e-gun and oscilloscope.
• The RMS jitters of other injection and extraction trigger are
less the 30ps.
• Performance are satisfied with the requirements of physical
design.
Control Group
SSRF CN, Shanghai, 2008
Timing System
Control Group
SSRF CN, Shanghai, 2008
MPS System
PLCÊä³ö ´¥ ·¢ ÁªËø
PLCר ÓÃͨ Ѷ·½Ê½
IOC
OPI
·ø Éä·À»¤Ïµ ͳ
MPS Switch
ÊøÏß Õ¾ÁªËøϵ ͳ
ÁªËøÐźÅ
•
3 parts：
–
–
–
•
¹« ÓÃÉèʩϵ ͳ
·½Ê½´ý ¶¨
PLC
Accelerator & beam line device interlock
Utility system
2#IP
1#IP
Safety system
IOC
Hiberarchy
–
–
–
–
The whole machine layer
Linac, boost, ring layer
Sub system layer
Device layer
¶¨ 汮 ÷
LR
2#IP
IOC
SR9
¶¨ 汮 ÷
PLC
1#IP
PLC
Ö±Ïß
IOC
¶¨ 汮 ÷
BR2
¶¨ 汮 ÷
BR1
IOC
Control Group
PLC
PLC
ÔöÇ¿Æ÷
PLC
SSRF CN , Shanghai, 2008
MPS System ,Inject&Extract control system
Control Group
SSRF CN, Shanghai, 2008
The RF System
• Turn key system except Linac RF System
• Integrated with EPICS system and can remote control at
center control room
• LLRF system
Control Group
SSRF CN, Shanghai, 2008
Linac RF Controller
RF Devices
Interface
SSRF Design
VME Controller
MVME 5500 CPU
VMIVME 2536
Digital 32 In/32 Out Ch
VMIVME 3125
Analog 32 Ch A/D
Isolated Interface
SSRF-Design EPICS Driver
Control Group
SSRF CN , Shanghai, 2008
Booster & Storage Ring RF
Display
RF Amplifier &
Klystron
Thales
Booster 180Kw
Interlock
VME
Controller
Control Group
Storage Ring
300Kw X 3
Epics IOC
MVME 5500
Hytec I/O boards
Fully Isolated Interface
SSRF CN , Shanghai, 2008
LLRF SYSTEM
Powe Meter
iPC
Local Interface
x3
SSRF Design
FPGA
Labview
EPICS
SoftIOC
LLRF Control
Unit x 3
Motor Drive x 3
Control Group
SSRF CN, Shanghai, 2008
RF & Timing Event Distribution
Master Signal
Generater
RF Signal
Distrubution
Unit
Timing & Eent
Signal
Generator
Fiber (Om3 )
Distribution
Unit
Control Group
SSRF CN Review, Shanghai, 2006
RF OPI @ Center Control room
Storage Ring
Control Group
Booster
SSRF CN, Shanghai, 2008
Remote manage & debug
•Video & Audio system based on network
•Device management
•Remote monitor: VME ,Switch,UPS etc
•Network management system
•Based onSNMP
•Email、SMS alarm system(Next)
Control Group
SSRF CN , Shanghai, 2008
IOC Manager
Control Group
SSRF CN, Shanghai, 2008
Center Control Room
• HP7700 OPI PC( 18 ) in the Control Room
• All the OPI run on the Linux Fedora 7 and in ssrf.ac.cn
domain.
• OPI system running at control system uniform runtime
environment.
• The edm file store on NFS file server and all the client can
access it by a start script.
Control Group
SSRF CN, Shanghai, 2008
Control Group
SSRF CN, Shanghai, 2008
Control Group
SSRF CN, Shanghai, 2008
Control Group
SSRF CN, Shanghai, 2007
2008
Conclusion
• Set up a distributed controls system based on EPICS.
• All device control system had finished system construct,
include install, online testing and software development.
• The Linac, Booster and Storage Ring control system were
finished and used in daily operation.
• High level physics application and control system OPI panel
can run normally.
• The control system was successful during the machine
commissioning. In general, most function of control have been
reached on design goal.
Control Group
SSRF CN, Shanghai, 2008
Thanks
Control Group
SSRF CN, Shanghai, 2008