Download 331_OpenSourceDataSharing

Open Source Data Sharing
Frank Hilhorst
President Progressive Consulting Inc.
Introducing myself
•
•
•
•
•
•
Started working with PROGRESS version 6 in
1993
Principle Software architect
PLATON mortgage loan system
JAZZ hospitality billing system
Started Progressive Consulting Inc in 2006
Ahstanga yoga afficionado
•
•
•
•
•
Introducing Progressive
Consulting
Focus on integrating OpenEdge applications
with other technologies
UI integration
Back end integration
Motto
Making the world as open to OpenEdge as
OpenEdge is to the world
Published tools
•
•
•
•
TurboCgi
TurboComet
TurboStomp
TurboQuery
•
Download beta release from
•
http://www.progressiveconsultinginc.com/news
Dictionary meaning of data
sharing
•
The ability to share the same data resource
with multiple applications or users
Sharing data between the PROGRESS
environment and an Open Source
environment
• Copy data definitions
and data
•
•
•
•
•
From PROGRESS to Open Source environment
From Open Source environment to PROGRESS
Access and manipulate data definitions and data
From PROGRESS in Open Source DB
From Open Source enviroment in Progress DB
Structure
of
this
presentation
• Introduction to open source databases and
JDBC
•
•
•
•
•
•
Project to create a data server for open source
database
Why and how
Demo data server
Architecture of data server
Comparing Progress with other databases
How to install and use the JDBC data server
toolkit
Introduction to
open source
databases and
JDBC
Dominant open source
databases
Database
Charactaristics
Sample
applications
MySql
•Connectors supported
•JDBC
•ODBC
•ADO.NET
•Drupal
•Wordpress
Apache Derby
•Connectors supported
•JDBC
•ODBC
•ActiveMQ
•Apache service mix
PostgressQL
•Connectors supported
•JDBC
•ODBC
•HoneyBird ERP
•LedgerSMB
•
•
•
What is JDBC (Java Database
connectivity)?
OO Interface that supports
SQL standard (create, update, insert, delete)
Defines the following JAVA objects
•
•
•
•
Statement
PreparedStatement
CallableStatement
Resultset
OpenEdge support for JDBC
• Jars provided
• openedge.jar
• pool.jar
• sqlexp (SQL explorer)
• sqldump
• sqlload
• sqlschema
How to provide JDBC access to a
PROGRESS database
•
•
Create a user sysprogress
Start up database with SQL server enabled
•
•
Option 1: Use 1 broker
•
Proserve -H .. -S .. -ServerType both
Option 2: Use (separate) secondary login
broker
•
Proserver -H .. -S .. -m3 -ServerType SQL
Testing the JDBC connection with the
SQL explorer
•sqlexp -url
jdbc:datadirect:openedge://localhost:30201;databaseNa
me=sports -user sysprogress -password sysprogress
•select name, address from PUB.customer
Project to create a
data server for
open source
database
Altisource Application environment
Legacy
Application
Next Generation
Modules
RabbitMq
Progress DB
Transformation
Engine
MySql DB
Demo
•
What we are going to demo
Using the TurboQuery Dictionary
•
•
•
•
•
•
•
Create database in mySql
Copy sports database from PROGRESS to mySql DB
Add a table and fields
Copy mySql database back to a PROGRESS database
Show how to populate a progress dataset from the mySql
database
Make changes to that dataset and commit those changes to
the mySql database
Commit the changes
Architecture of
data server
Architecture of data server
Tomcat
SQL
Statement
Progress
Client
Dataset
SQL
Statement
ABL/OO
Layer
JSON
Web
Service
SQL
ResultSe
t
MySql DB
How to get data from the foreign
database
• Use TurboQuery dataset generator to get
dataset definitions
• Instantiate QueryManager class
• Use QueryManager:GetData to populate
dataset
What the code looks like
How to update the foreign
database
• Populate the dataset
• Turn on tracking changes
• Make changes
• Commit the changes
What the code looks like
Classes of the ABL/OO layer
QueryManager
•JdbcMode
•jdbcSchemaMappe
r
•GetData
•GetDataAndDefs
•CommitChanges
ProToJdbcStmntGenerator
JdbcToProStmntGenerator
•JdbcMode
•JdbcMode
•InsertInto
•DeleteFrom
•FormatBufferFieldValue
•CreateTable
•CreateIndex
•DumpTableData
JdbcSchemaMapper
•JdbcMode
ProgressSchemaMapper
•JdbcMode
•getJdbcSchemaAttrName
•TransformFieldName
•TransformTableName
•Format
•TransformFieldName
•TransformTableName
Comparing
Progress with open
source databases
High level comparison
Progress database
Open Source Databases
Strongly typed database
Weakly typed database
• Variable record length
• Block based
• Fixed record length (mostly)
• Not block based
•
•
•
•
•
•
•
•
Table & field name space rules
Hyphen allowed
Spaces not allowed
32 character maximum length
No support for foreign keys constraints
Table & field name space rules
Hyphen not allowed
Spaces allowed
Can be very long
Support for foreign keys constraints
Comparing data types
Progress
mySql
Apache Derby
Character
•
•
•
•
Date
Date
date
Integer
•
•
•
•
Smallint
Smallint unsigned
Mediumint
Mediumint unsigned
• smallint
• time
• integer
Int64
•
•
•
•
Int
Int unsigned
bigint
bigint unsigned
• bigint
• double
• real
DecimaL
•
•
•
•
float
double
decimal
numeric
• decimal
• numeric
Datetime
• timestamp
• datetime
timestamp
Raw
• binary
• varbinary
• varchar for bit data
• long varchar for bit data
blob
• tinyblob
blob
char
varchar
text
tinytext
• char
• varchar
• long varchar
How to install and
use the JDBC data
server toolkit
How to install TurboQuery beta
version
• Download TurboQuery.zip from this Url
•
http://www.progressiveconsultinginc.com/news.html
• Unzip file to c:\
• Should get the following directory
structure
How to install TurboQuery beta
version (continued)
• Make sure JAVA version 6 or higher is installed
• JAVA -version
•In C:\TurboQuery\ini\Progress.ini
•Point the DLC variable to your OpenEdge root
directory
How to install TurboQuery beta
version (continued)
•
Using the Icons in the Shortcuts directory
• Start Sports DB database server
• Start Apache Derby server
• Start Jetty Servlet engine
What is next for TurboQuery?
• Batch update for data definitions
• Paged SQL queries
• Extending support for more OpenSource
databases
•
Externalization of database specific
mappings
•
SPRING/MAVEN based JDBC driver
configuration
Questions?