Download ACS Data Import Tool

ACS Data Import Tool
By Elizabeth He
[email protected]
ACS Data
 First ACS 5 year estimates released on Dec
14 2010.
 Data is available down to tracts and block
groups level.
 Most of the data can be found from American
Factfinder.
ACS Data
 Not all the detail data can be found from
American Fact-Finder.
 There are 295 Detail tables only available as
csv file on FTP site.
 Need Excel 2007 to extract Block Groups
data.
 Individual staff download the data will
slowdown network and also resulting in
duplicate information
DVRPC ACS Database
 Centralize the data.
 Eliminate the duplicate downloads.
ACS Data on FTP site
 Data source on FTP site
 CSV data file
 Seq Excel file
CSV Data File
Sample of CSV file
Seq Files
Sample of Seq File
Data Import
 How long it takes to import entire NJ dataset
into database manually?
 5-10 min to create each table in oracle
 5-10 min to create sqlloader scripts
 1 min to run the import scripts
 Total 11 – 21 min to import one CSV file.
 21 hr -41 hr to import the 117 CSV file for one
state.
ACS Data Java Import Tool
 Read the seq file one at the time, and then
create tables into oracle
 Generate the sqlloader script base the fields
in the sql file.
 Run the sqlload commend on DOS to import
the data into oracle.
 Generate the log files for each data import.
ACS Data Java Import Tool
 Youtube : Import Census ACS Data into
Oracle
 Download the tool
ACS Web Data Mining
 http://www.dvrpc.org/asp/censusacs/
Questions