Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Concurrency control wikipedia , lookup
Entity–attribute–value model wikipedia , lookup
Open Database Connectivity wikipedia , lookup
Microsoft Jet Database Engine wikipedia , lookup
Oracle Database wikipedia , lookup
Functional Database Model wikipedia , lookup
Relational model wikipedia , lookup
The First OAIS-compliant Ingest of Digital Records Zoltán Lux The National Archives of Hungary Email: [email protected] web:www.mol.gov.hu 12-13. May 2011 DLM Forum, Budapest 1 The Task Transfer of data (ingest) from the BÜR system (data systems covering persons accused of or charged with crimes). Preparation of a format for long-term storage. Development of a suitable structure. Preparation of a format for utilization and searchable. Doing all this compatible with OAIS. Making SIP, AIP and DIP packages. Installation of frame systems at the Hungarian National Archives and the Budapest City Archives. Ensuring that further data can be incorporated as required. 12-13. May 2011 DLM Forum, Budapest 2 The OAIS Model 12-13. May 2011 DLM Forum, Budapest 3 Database of the Hungarian Prosecution Service 12-13. May 2011 DOS-based application, dBASE IV files and user program in Clipper 5 and with the development of it by the Chief Prosecutor’s Office. How digital storage suitable for long-term archiving and use can be produced from this. Results of the BÜR I. project (data systems covering persons accused of or charged with crimes): Selection of the SIARD format and planning for the upcoming SIARD SUITE application for relational databases (MSSQL, Oracle, MS Access). Preparation of submission specifications. Creating a new/modified data model Loading data into an Oracle database Using the SIARD SUITE to convert data into the SIARD format DLM Forum, Budapest 4 Submission specification 12-13. May 2011 DLM Forum, Budapest 5 Planning the ingest Creating CSV files from dBase files. Appropriate format and packaging of these for long-term preservation. Adding document files. Adding metadata in XML format. Appropriate structure. Packing in ZIP format: SIP and/or AIP. Making a searchable DIP. 12-13. May 2011 DLM Forum, Budapest 6 Implementation I Submission specification. Submission of the CSV data files along with special information on the data, other documents on software functionality, and some metadata. Loading this information into an Oracle database Applying SIARD SUITE to the database and creating a SIARD package. Creating an appropriate AIP by adding documents and metadata in specific and EAD XML format, all in an appropriate structure, and packaging them in a ZIP file. With an SQL program Manually Making an anonymous DIP by developing a web application with APEX. 12-13. May 2011 DLM Forum, Budapest 7 Implementation I 12-13. May 2011 DLM Forum, Budapest 8 Implementation II Submission specification Creating SIP packages. Loading data into an Oracle database with the information on the data from the submission specifications. With SIARD SUITE called up by BÜRke application software Creating an AIP by adding documents, metadata in specific and EAD XML format, putting them into a structure, and zipping them. With BÜRke application software Applying SIARD SUITE to the database and creating a SIARD package. With SIPka application software With SIPka application software Making an anonymous DIP with a devised APEX web application. 12-13. May 2011 DLM Forum, Budapest 9 Implementation II. 12-13. May 2011 DLM Forum, Budapest 10 Data for submission 12-13. May 2011 DLM Forum, Budapest 11 Creating an SIP 12-13. May 2011 DLM Forum, Budapest 12 Creating an SIP • Loading data into the Oracle database . • Assembly of various schemes in line with the task. Generating database schemes (META, STAGE, DW, SIARD, PUBLIC). • Preparing PL/SQL programs. • Loading data and journals, and preparing statistics. 12-13. May 2011 DLM Forum, Budapest 13 Applying the SIARD SUITE • Producing a SIARD package for preparing SIP and AIP with SIARD SUITE. 12-13. May 2011 DLM Forum, Budapest 14 Applying SIARD SUITE • Why we think SIARD FORMAT is appropriate for our task. • Well-designed database. • Tables and views. • A lot of data-connection information can be stored in the database, e. g. with foreign keys, check constraints, triggers etc. • Ability to store information about user program logic with their routines. • Ability to add comments to almost every database object. • These information vehicles can be transferred to the SIARD PACKAGE with other supplementary information on the database and user program. • The format is package-independent. 12-13. May 2011 DLM Forum, Budapest 15 From SIP to AIP • Producing the AIP with an application software (BÜRke). • SIARD package, addicional documents, metadata information in XML format, appropriate structure, ZIP format. 12-13. May 2011 DLM Forum, Budapest 16 Producing the DIP • Web-based user interface developed with APEX. 12-13. May 2011 DLM Forum, Budapest 17 Producing the DIP 12-13. May 2011 DLM Forum, Budapest 18 Producing the DIP 12-13. May 2011 DLM Forum, Budapest 19 Outcomes • Completing the ingest process. • Making the DIP searchable. • Gaining experience with the SIARD SUITE, preparing the Hungarian version of it, and making some corrections to the software. • Developing the software tools for ingest and long-term preservation of further BÜR records. • Making the software tools applicable to other relational databases. • Gaining experience with archiving digital records. • Some further tasks and remaining problems. 12-13. May 2011 DLM Forum, Budapest 20 Thank you for your attention! 12-13. May 2011 DLM Forum, Budapest 21