Download Query processing

Operations Overview
- Technology
Annual Member Meeting
November 10, 2004
Boston
2004 CrossRef Annual Member Meeting
Boston
1
Operations status

System availability ~ 98%
 Downtime for database and hardware maintenance
 Co-location facility (MCI) has been very stable
(No power or network outages in 2004
 Since Aug 2002 114,319,244 transactions processed

Added one technical staff member in 2004
 Jon Stark – web programming, data quality

TWG remains very active
 Monthly teleconferences
 Webinar on XML
 In person technical meetings (Nov 11, Dec 1 London)
2004 CrossRef Annual Member Meeting
Boston
2
Deposit processing

Queue processing times (% of jobs)
 Note: deposits with references (forward links) will
take longer
2004 CrossRef Annual Member Meeting
Boston
3
Query processing

Query
load is up
Queries - Millions
25
20
15
10
5

Response
times are
down
steady
Oct-04
Sep-04
Aug-04
Jul-04
Jun-04
May-04
Apr-04
Mar-04
Feb-04
Jan-04
Dec-03
Nov-03
Oct-03
0
During peak
loading
Nov 2004
1.5 seconds
2004 CrossRef Annual Member Meeting
Boston
3.2 seconds
4
Query processing
Options to improve performance

Near term (< 3 months)
 Oracle 9i upgrade to complete by 9/18
 Improve query logic
 Add server horse power
 Load balance web requests

Long Term
 Separate system functions into scalable sub-units
2004 CrossRef Annual Member Meeting
Boston
5
2004 Accomplishments

Hardware





Software changes



Sun V440 DB server with fiber channel disk array
Upgraded network backbone to Gigabit speed
Increased tape backup capacities
Added CPUs to front end Dell servers
Completed forward linking
Modified tracking ID, improved conflict management, tweaked
query fuzzy logic, added small job Q, prepared SQL statements
Support changes



Automated reports (conflicts, failed query, resolution)
Improved Guest query (added multiple hits)
Started installation of CrossRef hosted proxy and Handle servers
2004 CrossRef Annual Member Meeting
Boston
6
www.crossref.org => members => system reports => failed query report
2004 CrossRef Annual Member Meeting
Boston
7
2005 Initiatives

Hardware
 Add redundant network connection with MCI
 Add CPUs to last front end Dell server
 Add machines for CrossRef hosted proxy and Handle
servers
 Upgrade backup database server.

Software changes
 Data quality and performance

Support changes
 Metadata and DOI link validation testing
 CrossRef query test suite
2004 CrossRef Annual Member Meeting
Boston
8
CrossRef Hosted Handle
and proxy

CrossRef is now running a Handle secondary for all
CrossRef DOIs (all DOIs are stored at CNRI and at
CrossRef)

Also running a pilot instance of the dx.doi.org proxy

Using DNS ‘tricks’ CrossRef proxy will share the load and
provide redundancy to dx.doi.org
Lessens our dependency on IDF resources
2004 CrossRef Annual Member Meeting
Boston
9
Where to get help …
http://www.crossref.org
http://doi.crossref.org
[email protected]
[email protected]
2004 CrossRef Annual Member Meeting
Boston
10