Go to most recent posting(s).
Beginning with this 2013 edition of What's New we are going to highlight many more things that are new on the MCDC web site or on related sites that we think may be of interest to our users. "New" does not necessarily mean something that just happened on the date that we report it here. It may take a little time for us to get around to or decide that something we did or saw others do is significant enough to warrant an article here. We don't want to clutter the page with trivial items, but we reserve the right to change our minds about what is worth a notification.
To be notified of new items being added here users can subscribe to the MCDC's RSS feeds which will consist of very brief headlines regarding the items, with links to the more detailed articles appearing on this page. Note that these articles will no longer (necessarily) appear on the MCDC home page as they have in the past.
It has taken us a while but we are nearly finished with our processing of the standard extraction data sets that we created based on the 2011 vintage American Community Survey (ACS) data released by the Census Bureau late in 2012. Actually, what we are talking about is a collection of data sets all based on the 5-year 2007-2011 period estimates data (as opposed to the 1-year and 3-year data released earlier which are relatively small data collections in comparison to the 5-year data and are this represented by only a single data set or two for each. With fewer than 7500 geographic areas having single-year data and fewer than 15,000 having 3-year data (based on population thresholds of 65,000 and 20,000, respectively) we provide a single pair of usmcdcprofiles and usmcdcprofiles3yr data sets to contain all of the data that most users will want to access based on the first two releases. But with the 5-year period estimates we are now dealing with over 740,000 geographic areas (including almost 21,000 in Missouri) for which we have data. For convenience we do maintain a single data set, named usmcdcprofiles5yr with all these data lumped together. But for most real-world applications users will want to access subsets of these data based on the geographic entities being summarized. This is why we have gone to the trouble of creating a collection of us (i.e. containing data for the entire country) geographic subsets, with Missouri subsets of these as well.
The best way to see what we have created as well as to access the data is via our Uexplore/Dexter software. More specifically, you can use the custom Datasets.shtml file within the acs2011 data directory.
Most of these data sets are comparable to ones we created last year (in the acs2010 data directory). But two of them are new or different:
The uszctas5yr data set is different in two special ways. First and most importantly, these data are now being provided by the Census Bureau. Last year we had to approximate them by doing our own special allocation of tract level data to ZCTAs. There were no MOE (margin of error measures) in that data set. But this year we do have _moe variables included. The other difference is that we have merged the ACS data with data stored in our zcta_master data set (in the georef data directory.)
The usbgs5yrtemp data set is our first attempt at making our profile data available at the census block group level. We have not done so in the past because of the limited data that were available at this level, and because of our comfort level (or lack thereof) with the statistical reliability of data for such small areas. We shall not make these data available via our acsprofiles web application for reasons consistent with the Census Bureau's for not allowing these data to be accessed in American FactFinder. Having said all that, we are designating this as a "temp" dataset because we are working on a revised version to be released hopefully within a few weeks. Users will note numerous variables on this dataset that have missing values for all observations. We hope to be able to fill in at least some of these values by modifying the code we use to derive these variables. There appear to be many cases where the data is available but not in the base table that we are currently referencing to define the variable. (Persons over 65 is a good example of this.) We are also planning to add two new variables with the unweighted sample counts of persons and housing units.
2011 Vintage ACS Datasets for Current Congressional and State Legislative Districts
Posted 2/7/2013 11:00:57 AM
While the Census Bureau has released geographic files that allow us to get the spatial definitions of the new 113th CD and vintage 2012 state legislative district boundaries, this information was not available in time for them to use it when tabulating the vintage 2011 American Community Survey data. This is comparable to what happened last year when they had published the geographic datasets for the new 2010 ZCTAs but no ACS data were published for the new areas. As we did last year with ZCTAs, we have created our own allocated-tract-level-data estimates of ACS data for these new districts. We are talking about three new datasets:
- one for the 113th Congressional Districts (the current congress),
- one for state legislative districts, upper chamber (Summary Level 610) and
- one for state legislative district, lower chamber (Summary Level 620).
These datasets can only be accessed via Uexplore/Dexter (for now). We recommend access via the Datasets.html file in the acs2011 data directory. The new datasets are named uscd113s5yr (113th CDs), ussldl12s5yr (the lower or, in most states, the state "House" districts), and ussldu12s5yr (the higher or, in most states, the state "Senate" districts). They are on lines 5, 16 and 17 of the table displayed on the Datasets.html page. (Subject to change if we add or delete any datasets).
These datasets were created by allocating the current tract level data (in ustracts5yr in the same acs2011 data directory), using 2010 census tract to the 3 district levels correspondence files derived from our mable12 database. We had to program around a slight glitch in the equivalency files when we discovered that the census tracts in 2 New York counties (Madison and Oneida) being used in the latest ACS data are not the same as the tracts used in the 2010 census (!).
Notice and do not be confused by the presence of the uscdslds5yr dataset where we have combined the data for the old 111th CDs and the old state legislative districts as defined prior to redistricting.
Those interested in data just for Missouri will note that we have (per our custom) created Missouri subsets of the three new datasets. Same dataset names except replace "us" with "mo" (lines 22, 28 and 29).
We made no attempt to allocate and aggregate the MOE (margin of error) data as part of our estimating process so you will not find any _moe variables on these datasets.
MCDC Web Applications Updated With Latest Population Estimates Data
Posted 2/11/2013 8:11:53 AM
Note: A slightly modified version of this update was posted to our home and Whatsnew pages last November but we have had several inquiries about it so we are repeating it here.
Following a new release of intercensal population estimates at the state and county levels for the decade 2000 to 2009 from the National Center for Health Statistics, the MCDC updated both our Estimates by Age and Poptrends web applications. Both applications now provide detailed and customizable data reports covering the period from 1990 through 2011. Demographic detail include single years of age, race (4 bridged categories), Hispanic origin, and sex (not all combinations, but many). Data are for July 1 of each year in the period. The Estimates by Age page provides a link to a Census only version that does comparable data but only for April 1, 2000 and April 1, 2010.
Note that we provide links to both of these applications in the Quick Links box, appearing on our home page.
Metadata for the nchsbri Population Estimates Data
Posted 2/14/2013 9:32:55 AM
Last fall we processed an important set of new population estimates - the "bridged race" estimates produced by the National Center for Health Statistics. While we downloaded, converted and did basic updating of Contents files to make these new data accessible via Uexplore/Dexter, we did not do a thorough job of documenting what all these new data sets were about. (Most users access these data indirectly via our two online web applications, Pop Trends and Estimates by Age). Much of the "newness" of these data was the result of the new availability of updated inter-censal estimates, which we saw as being important as being replacement alternatives for the old post-censal estimates of the prior decade (2000-2009).
There are two new files that users of these data need to know about and make use of. Point uexplore to the - popests/nchsbri subdirectory and these are the first two sets on the page, displayed in bold.
- The Readme.shtml file does what readme files are supposed to do. It provides background info and basic information intended to help the user make sense of what may seem like a bit of a data maze to be traversed.
- The Datasets.html page is one of our standard files with that special name and contains the usual matrix display of all the data sets in the directory complete with descriptions, universes, summary units, time periods coverted, etc. with links to Detailed Metadata custom pages for most of the data sets. Using the metadata won't necessarily make accessing the data trivial or even easy, but it will make it a lot more possible.
OSEDA Application Displays MCDC ACS Profile Data by Missouri Counties and Regions
Posted 2/28/2013 8:12:43 AM
Interested in viewing Missouri county-level data from a recent ACS release? Check out OSEDA's web application at http://wwwdev.oseda.missouri.edu/index.php/apptools/missouri-map. The data are the MCDC's mcdcprofiles standard collection, and are currently for the 2006-2010 5-year period estimates. The application has several key features that distinguish it from our own (MCDC's) web tools:
It displays any number of geographic areas across the screen and has a horizontal scroll bar to let you view around 7 or 8 areas at any one time.
It organizes the Missouri county data by various regions (RPC's, DED economic regions, MoDOT regions, etc.) and allows selecting, ordering and aggregating data by these regions.
The data can be chosen from and displayed upon a dynamic map of the state, by county and/or region. In "map mode" it can be used to quickly and easily generate choropleth maps of many of the key data items in the profile.
- Names and data values for a county can be displayed by placing the cursor over the county on the map.
Note: OSEDA is the Office of Social and Economic Data Analysis at the University of Missouri in Columbia. Most of the people responsible for creating the MCDC web site work at OSEDA.
Census Bureau Releases New County Estimates With Components of Change
This is the first in a series of three major sub-state estimate products to be released in the first half of this year. The key item in this set is the 2012 estimated total population for each state and county. (The state figures have actually already been published back in later December/early January but they are repeated here.) These figures contain yearly estimates (starting with July 1,2010 and going through July 1, 2012) and report components of change for each year since 2010 plus the 3-month period April-June, 2010. These data are stored in a series of data sets within the popests data directory, and the Datasets.html file for navigating though those sets has been updated to reflect the 5 new data sets (mocom12, mocom12t, uscom12, uscomcbsas12, and mocomregns12). Follow the metadata links in Datasets.html for details. They are all the same as last year but now with data for (or through) 2012 rather than 2011.
We have updated the poptrends1 web application, best accessed using applinks. We have a link to the Applinks master menu in our Quick Links box. For those interested just in Missouri we recommend using the MO County Data Map link, also in Quick Links. Would you like to see these reports and charts for every county in the state? Just replace the value of the &co parm with the word ALL instead of a county code. For example the URL http://mcdc.missouri.edu/cgi-bin/broker?_PROGRAM=websas.poptrend1.sas&_SERVICE=sasapp&st=29&co=all results in rather long report showing basic pop trends (no component detail, just total pops) for each county in Missouri going back to 2000. Change the value of the &st parm if you want it for a different state (e.g. &st=06 will generate a report for California counties.)
We have updated our Population Estimates page to reflect what's new. That page contains a link to the Reports library (bullet item 3 under Our Best Estimates), with new reports for Missouri and the nation at the county and CBSA (metro area) levels.
Updating of the Counties sheet within the Curmoests.xls file (referenced on the Population Estimates page, bullet item 1) has been completed.
(New note - 3/19/13) The metropolitan area data (CBSA) on these data sets and report are still the 2010 vintage definitions. OMB released new definitions in February, 2013 and the Bureau's published metro area estimates use the new definitions, whereas ours do not. When we are able to access the new definitions in a program-compatible format we plan to update these data sets and reports with the new definitions. Estimates using the new defintions are available at the Bureau web site or in the raw file CBSA-EST2012-alldata.csv in the /pub/data/popests directory.
Access the data as released by the Census Bureau at their Population Estimates main page, under Latest Releases.
New Metropolitan/Micropolitan Statistical Area Definitions for 2013
The Census Bureau has released the first new edition of the Core Based Statistical Area (CBSA) definitions since November of 2009. These metro areas are comprised of complete counties. In the state of Missouri there were only three changes to the definitions affecting the state. In each case a county was dropped from a CBSA. Specifically:
Howard, MO was dropped from the Columbia CBSA (leaving it as a single-county metro area consisting entirely of Boone County.)
Franklin, Kansas was dropped from the Kansas City metro area.
Washington county, MO was dropped from the St. Louis metro area.
We have created five new data sets in the georef directory of the MCDC data archive. To see what these are go to the georef data directory and click on the Datasets.html file. Look for the five data sets with creation date ("Created" column) indicating late March 2013. These sets show various combinations of county, CBSA, CSA (combined statistical areas comprised of groups of continguous CBSAs), Metropolitan Divisions (sub-areas of CBSAs) and states. Some contain population data from the 2010 census and the latest (just released, vintage 2012) estimates.
MCDC to Host Training Webinar
The Missouri Census Data Center (MCDC) will be hosting a free training webinar at 9:00 am on April 24, 2013 on the use of Missouri Census Data Center (MCDC) data sets, tools and web applications. The session will be targeted to the types of data and geographies most used by the planning, community and economic development, and local governance professionals. To attend the webinar, you will be required to register here: https://partreg1.mc.iconf.net/conf/action/expressAction?scheduleid=411207225&ba=300001210
After you register, you will receive an invitation with a link to the webinar. Register soon as space is limited to 125 participants.
New Web Application Provides Easier Access to ACS Profile Data
Posted 5-13-2013 (rev. 5-15-2013)
We have created a new web application that should make it much easier for users to access data from the American Community Survey. More specifically, the access is to the latest (vintage 2011) 5-year period estimates for the most common levels of geography, for all or selected states, or for selected counties within a state. The application provides easy access to an enhanced profile data set at the block group level with some variables that were previously unavailable at the BG level. Most of the data sets being accessed by this application have been enhanced by merging them with Summary File 1 (sf1) data from the 2010 census. Finally, the application has options for accessing three MCDC-exclusive (for this year, at least) levels of data that were created by doing tract-level (dis)aggregation to get approximate summaries. The three levels are the new 113th Congressional Districts and the 2012-vintage state legislative districts, upper and lower chambers. We do not provide margin of error measures (_moe variables) for these three data sets.
The application can be accessed using the new link ACS Profile extact app in the Quick Links box that appears on the upper-right corner of most MCDC web site pages. The URL for the application is http://mcdc.missouri.edu/cgi-bin/broker?_PROGRAM=websas.acsmcdcprofiles_extract_menu.sas&_SERVICE=appdev&st= . Users familiar with the comparable application for accesing 2010 sf1 data extracts (see the Quick Links box, SF1 Data extract app) will note that the new ACS-based application is very much modeled after its sf1-based predecessor.
Like its sf1 counterpart, this application is a front end for our Dexter data extraction module. You fill out the form and the selections are passed to a custom Dexter query form. You can then submit the form to get your extract exactly as specified, or you can use dexter to be more precise about what you want prior to submitting (add another filter; exclude certain variables from a table; add a title for a report, specify a sort order, etc.).
A video-based tutorial for the application is under development. A link will be provided from the application.
Video-based Tutorial Now Available
Per the note at the end of the previous posting, the (mostly) video-based tutorial for the acsmcdcprofiles_extract web application has been completed. Or, at least it has progressed far enough that we feel comfortable making it publicly available. We reserve the right to do retakes and especially to add more alternate extract modules. The module is linked to from the acsmcdcprofiles_extract_menu page or you can access it directly at http://mcdc.missouri.edu/tutorials/acsmcdcprofiles_extract .
Sub-county Population Estimates Thru 2012 Now Available
The Census Bureau has released a new set of their official FSCPE sub-county population estimates. These are the post-censal estimates showing July 1 estimates for all incorporated places (cities) and other sub-county governmental units for each year from 2010 through 2012. There is no other detail other than just the total population estimate. (e.g. no components of change or demographic detail such as age or race.) The MCDC has downloaded the data and stored the results in two archive data sets, ussc12 and mosc12, within the popests data directory. Based on these data we have generated a series of standard reports showing which cities have grown or shrunk the fastest over the past two years. The best way to access the reports as well as the data sets on which they are based is via the Popests Reports directory. We have now (5-29-13) incorporated these data into our Curmoests.xls Excel file, which is now complete for the 2013 estimates cycle.
New version of CAPS works with 5-year ACS Estimates
This application accesses census tract-level American Community Survey data (our standard "MCDC profile" data) and generates data for circular areas. So you can use it (for example) to get a feel for the characterisitics of persons living within a 5-mile radius of an existing or proposed site (includes not only the basic demographics, which are already available from our caps10c applicaition, but also the "good stuff" only available from the ACS - income, poverty, education, housing values, etc.) The application has a built-in limit of a 2-mile radius; so you cannot use it for circles smaller than this. The application is called caps10acs and you can access it at http://mcdc.missouri.edu/websas/caps10acs.html.
Population estimates at state and county levels with Demographic Detail for 2012
These data were released by the Bureau today. The MCDC has downloaded the data and processed it as we have for several years now. The results can be viewed in the usual standard report formats by accessing the Estimates Reports page. There are the same set of 4 reports for each state (at state, county and metro area levels), and for the United States at the state and nation levels.
The raw data can be accessed in the public archive in the usual locations. The data as downloaded and converted more or less as-is can be viewed in the casrhalt subdirectory of the popests data directory. The best way to access the new data in the main directory, where we have done our usual reshaping of the data in an attempt to make it easier to code extraction queries based on the various cominations of demographic detail, is via the Dataset.html page within the popests directory. There are 51 datasets with names such as mocasrh12, ilcasrh12, cacasrh12, etc. each with data for a specific state. Two other datasets of interest are usstatescasrh12, which contains data summarized at the state level for all the states; and us1dimsums_casrh12, which contains county-level data for the entire US. The "1dim" in the name indicates one-dimensional summaries, meaning each observation provides estimates for a single demographic dimension: one for for each race alone, one for each gender, one row for each 5-year age cohort, one row for each Hispanic/non-Hispanic.
All the county-level datasets have been enhanced by merging the latest (March, 2013) metro area ("CBSA") codes and types, making it relatively easy to aggregate queries at the metro area or metro area type (Metro, Micro or blank) levels.
Poptrend1 Web Application Updated
One of our simplest and yet quite useful dynamic web applications is the poptredn1 module. It simply displays the trends in a state or county's population year-by-year going back to 2000 and forward to the most recently available. The application has been updated to now include the two major components of change for each year: Natural Increase (births - deaths) and Net Migration. The usual 1990-style retro line-printer bar chart depicting Total Pop Change by year is still there, and is now followed by a similar chart for the Net Migration component. For those users who are not satisfied with the simplicity of these old-fashioned charts there are now more modern gif files with color charts of the same data, available via links inserted between the reports and the old line charts.
The best way to access this application is via the applinks menu pages. Start with the state of Missouri page . Look for the Population Trends 1 row/link. Use the navigation links at the top of the page to access the Missouri counties menu page, where you can choose any county in Mo. Or, you can follow the link to the US menu page from which you can select another state and then, if desired, any county within that state.
Missouri Taxable Sales Data for 2012
After a 4-year hiatus we have brought back the Missouri taxable sales data, summarized by SIC and county/state. Access new mosicst12 and mosiccnty12 data sets using Dexter web application in the taxsales data directory.
BLS Unemployment Data Thru April, 2013 Added to Data Archive
The bls_la (Local Area employment data) for state and counties was updated for the first time in 4 years. This is a time-series dataset, with data at the state level going back to 1976 and at the county level back to 1990. Counts of employed and unemployed persons as well as the unemployment rates are provided for each year. Access new usstcnty13 and mostcnty13 data sets using Dexter web application in the bls_la data directory.
County Business Patterns Data for 2010, 2011 Added to Data Archive
The county business patterns (filetype CBP) data for years 2010 and 2011 have been added. There are six datasets per years with data summarized at the nation, state, county, metro area (CBSA) and ZIP code levels. There are many observations per geographic area with detailed breakdowns by SIC-code business categories. This makes the datasets quite large (e.g. over 2 million observations for the 2011 county level data in uscos11. Access the new data via uexplore/dexter in the cbp data directory. Use the Datasets.html page.
New Housing Unit Estimates Data Thru 2012 Added to Data Archive
It took us an extra day since the Bureau changed the way they distribute the data (now using American FactFinder instead of a custom csv file). But we have created two new datasets in the popests data directory: ushuest2012 and mohuest2012. They contain data at the state, county and nation level with housing unit estimates for July 1 to 2010 thru 2012, along with 2010 census counts. Access the new data via uexplore/dexter in the popests data directory. Use the Datasets.html page, lines 5 and 42. See the original data release at the Bureau web site.
Social and Economic Profile Data/Reports Updated for 2013
The Social and Economic Profiles data and reports are an OSEDA project done at the behest of and primarily for the benefit of community development specialists working with University (MU) Extension. These data get updated at least once a year in order to keep them fresh. For example, in this 2013 update we have "refreshed" (i.e. added or replaced data items with more current values) all the 2012 vintage population estimates data, new poverty estimates from SAIPE, new economic indicators from the BEA REIS data, new indicators related to children from the Kids Count database, and the most recent unemployment figures from the BLS. Most users will want to access these data as profiles (formatted reports) and can do so using the (new) menu page at http://www.oseda.missouri.edu/countypage/county_seir13.shtml. Note that we have not (yet) updated the Narrative profiles, just the Data Tables. We also have not yet aggregated the data to UM extension regions. The links to
Additional Informationon this menu page (county_seir13.shtml) now reference the MCDC's applinks page for that county.
Uexplore/Dexter users can access the single dataset containing all the data used in these profiles. The data directory ("filetype") is cntypage and the dataset is named merged13. The direct URL for accessing this dataset is http://mcdc.missouri.edu/cgi-bin/broker?_PROGRAM=websas.uex2dex.sas&_SERVICE=appdev&path=/pub/data/cntypage&dset=merged13&view=0 ; this link has been added to the menu page. (For those purists who want to navigate to this using the Uexplore home page, you can find the link to the cntypage filetype within the Compendia Major Category section.)
MCDC-Estimated CD and State Legislative District ACS Profiles Available
The MCDC has created a new web application that works specifically with our three national datasets at the 113th Congressional District and current ("2012") state legislative district levels. To access it use the new single menu page at http://mcdc.missouri.edu/webrepts/uslegdistprofiles.html. These are very similar, especially in terms of content, to our usual ACS Profiles reports.
Note that we previously (see the Februrary, 2013 article) reported on the existence of these data and how to access them via Dexter. But having the data in the profile report format should make it accessible to a much broader audience. The profile reports contain a link (at the bottom) to that February article that deals with how to access the underlying datasets. Note that they can be easily accessed via the ACS Extract Assistant app, which did not exist back in February.
Error Found in CAPS10c Output
Our thanks to Wilson Hunter of David & Floyd (Greenway SC) who alerted us to a problem with the Percent field in the Change in Population 200-2010 item in the "1.Total Population Trends, Etc." portion of the caps10c (Circular Area Profiles - 2010 Census data) output. The calculation was being done with a utility module that handled the calculation as a weighted average of the PctChangePop variables weighted by the TotPop00 variable. The problem with this is we have blocks with 0 population in 2000 but with positive change over the decade. This causes the weighted-average approach to be off in circular areas that had blocks going from 0 to non-0 over the decade. The data needed to verify the calculation is right there in the report (just divide the Change by the 2000 population and multiply by 100.) We have fixed our code (as of approximately 10 AM CDT today) so it now correctly calculates the percentage.
Revised Version of Video-based Dexter Quick Start Guide
This new video-based tutorial can be accessed directly at http://mcdc.missouri.edu/tutorials/dexter_quickstart_video2. It covers basic examples of using the Uexplore/Dexter software to create data extracts. This tutorial replaces an earlier version. It breaks the material down into smaller video modules, and has more examples. The tutorial can also be linked to by following the link to the "Dexter Quick Start Guide" displayed at the top of the Dexter Query Form.
Two Population Estimates Web Applications Updated For 2012 Data
The Pop Estimates by Age and Pop Trend Reports (both accessible via entries in our Quick Links box) have been updated to provide access to the most recent (2012) available data. These applications both use the data from the National Center for Health Statistics in our popests/nchsbri data directory. The Pop Trend Reports now includes links to sample output (report and charts) as well as to a short video tutorial showing how the sample output was produced.
New Post-2010 Estimates Data Added to popests/nchsbri Data Directory
We have downloaded the latest bridged-race population estimates data for 2012 from the National Center for Health Statistics web site. These data are very similar to the "casrh" (county age sex race hispanic) estimates from the Census Bureau (these data sets were created by the Census Bureau for the NCHS), except that they used 4 "bridged" race categories and do single years of age. We replace the collection of "201x" data sets each year. See the Readme file (in the /pub/data/popests/nchsbri directory) for a detailed description of these data sets.
ACS Trends Report Get Major Makeover
The ACS Trend Reports application (http://mcdc.missouri.edu/acs/trends/menu.php has been substanitally modified, similar to what was done with the ACS Profile Reports back in April. The charting feature now works for both these apps (ACS Profiles and Trends). We made a few changes to the chart presentations, the biggest being to now use SVG graphics, rather than Flash (AnyCharts). This means the charts are now viewable on iPads and other recent devices that donít support Flash.
In case you missed it, we have also added an online tutorial for the ACS Profiles application. That tutorial has been significantly updated to reflect the revisions in the application.
MCDC Navigation Boxes Get Minor Revisions
Just in case you were wondering why that link to the SF1 2010 Census Profile report was no longer at the very top of the Quick Links box on the Missouri Census Data Center home page, it's because we did some minor editing of Quick Links and its companion, the "Navy Blue Navigation Box" which usually appears at the upper left of MCDC pages. We have rearranged the links and dropped just a few, hoping to create more logical grouping and to put the "hottest" links at the top.
ZCTA_master Data Set(s) Updated
The MCDC has a long history of providing special geographic reference data pertaining to ZIP Code/ZCTA geography. One of the most important resources that we provide in this area is the georef.zcta_master data set, i.e. the set named zcta_master within the /pub/dat/georef data directory (see the Datasets.html page and follow the links in the second row to access via Dexter. You can also access the zctamstr subdirectory of the georef data directory, where we have a collection of 51 state-based data sets with the same data.)
This new version replaces the one generated in September of last year and has a number of important updates. Probably the most important upgrade is that we now offer official 2007-2011 five-year period estimates for the ZCTAs as published by the Census Bureau in December, 2012. In the previous version we just had our unofficial guesstimates based on allocating/aggregating tract level data for 2006-2010. Other key updates involve geographic identifiers at the Urban Area and Congressional District (where we know have 113th - current) levels. The metadata files have been updated and enhanced to provide current and somewhat more extensive explanations. A video-based tutorial is being planned.
Version 1.2 of MABLE/Geocorr has been updated to now report the latest CBSA (metropolitan and micropolitan statistical areas) definitions as released by the OMB and the Census Bureau in February of this year. We have also incorporated the latest (July 1, 2012) county level population estimates which allow you to select the 2012 estimated population as the weight variable (which is really only useful when doing analysis at the county level and above.)
georef.zcta_master Gets Updated Metro Areas
We just updated these ZCTA reference data sets last week but at that time we did not update the CBSA, metro div and CSA data, which we get from our mable database. But we just finished updating mable12 to have the current metro definitions and we have now rerun the zcta_master creation run so that they now use the more recent definitions.
CCC Pages Updated to Provide Current Link to Current Metro Area Definitions
Each of the 51 state pages in the Cure for the Common Codes application have been updated to fix the broken link to the Census Bureau page where the latest definitions can be accessed. We also added a sub-title to the Metro Area table section of the report alerting the user to this link.
SAHIE Data for 2011 Added to Data Archive
We downloaded the latest release of Small Area Health Insurance Estimates data from the Census Bureau. We stored these, as we have done for the past several years, in the saipe data directory. We stored the downloaded fixed-format text file (sahie11all.txt - in exact same format as the 2010 file) and created the standard data sets: sahie11 (entire US, all summary types), mosahie11 (Missouri subset of sahie11), and sahietotals11 (subset of sahie11 containing just data for the total (<65) population.)
Users should note that these data can now be accessed by a new interactive data web tool at the Census Bureau's SAHIE web site.
American Community Survey Base Tables for 2012 Added to Archive
In the acs2012/basetbls data directory we have downloaded and converted the base/summary tables as released by the Census Bureau on 9/19. We have partitioned the data into the six topic-based data sets, and have stored the estimates and their corresponding MOEs in separate data sets. Consistent with what we did for 2011.
ACS Profile/Trends Reports Updated With 2012 Single-Year Data
The latest data from the American Community Survey has been converted to create the MCDC's standard profile data set for 2012 (1-year data only). The ACS Profiles and its twin application, ACS Trends have been updated to incorporate access to these new data. The data set is also accessible in the ACS public data archive, using Dexter. There is a link to the Dexter access query form within the "Other formats" box on the profile report page.
There have been substantial revisions to the code used to generate the profiles this cycle. We have looked for alternate tables with the same required information but with less data suppression (e.g. replacing reference to a "B" table with the corresponding "C" table, if one exists and has the necessary detail). The good news is that you should find fewer suppressed data items in these extracts; the bad news is that it is new code, and thus does have a greater risk of bugs and/or inconsistency with prior definitions. We suggest you run a trends report for an area you know well and compare the values to see of there are any improbable jumps in the data.
Metro Area Codes in popests Data Sets Updated
We received a heads up from a user who was working with our uscomcbsas12 data set in the popests data directory, who noticed that we were still using the CBSA definitions from 2009 rather than the new ones specified in February of this year. We traced this to our original conversion of this year's population estimates with components of change as released by the Bureau in March. At that time we still were using the old definitions (unaware that new ones had been published), so those were assigned to our popests.uscom12 / mocom12 data sets. Today we reran that conversion to update the CBSA codes (and MetroDiv and CSA related codes) to update these data sets with the 2013 vintage metro area (CBSA) codes. While we were at it we also added the ID variable cbsayr to the uscomcbsas12 data set so that the vintage is reported as part of the data.
Dexter Quick Start Guide Video Version Updated
Their was a broken link to the first module in this tutorial which has now been fixed. The orginal module has been replaced with two new modules, one providing an overview of the MCDC data archive system, with emphasis on where Dexter fits. The other new module covers the information at the top of the Dexter Query Form, and Section I of the form. The entire tutorial now runs for a total of about 52 minutes.
New Alternate Version of acs2011.usmcdcprofiles5yr
One of the largest and most important data sets in the MCDC public archvie is the data set named usmcdcprofiles5yr in the data directory /pub/data/acs2011 (i.e. as part of the acs2011 "filetype" collection). There are just under 750,000 rows and about 1000 variables in the data set. The variables represent our custom extract from the detailed ACS summary tables with the 2007-2011 5-year period estimates data. Included in the 750,000 rows are data at the census tract (both complete and split by place/county subdivision - summary levels 140 abd 080, resp). The columns/variables mostly come in triplets: an estimated count, a corresponding percentage and a corresponding margin-of-error figure. For example, we have Age0_4 (estimated count of persons under the age of 5); PctAge0_4 (percentage of the total population that is under 5); and Age0_4_moe (the margin of error associated with this estimated count). While this data set is useful as a kind of comprehensive source (especially so for SAS programmers here at the MCDC who can use it to generate custom extracts), it becomes a bit cumbersome when doing extracts from the web using Dexter. To make things a little easier for users wanting to create extracts using dexter we have created a new data set, usmcdcprofiles5yralt . This alternate version of the data set drops all the tract and block group level summaries (we keep that data seperately in the ustracts5yr and usbgs5yrtemp data sets). It also reorders the variables, moving all the _moe variables to the end of the row/observation, which users who are not planning to deal with the MOEs will find helpful. You can now choose between two versions of the data and can still access the usmcdprofiles5yr if you prefer having the moe variables intermixed with the corresponding estimates.
By defining some indices and doing some fine tuning with some of the identifier fields we make the new "alt(ernate)" version easier and faster to access. Access the new set from the acs2011 Datasets.html by following the Dexter link in the first column.
This alt data set replaces the earlier attempt at doing something like this, where we called the data set usmcdcprofiles5yr2. That data set has been deleted.
Updated the ZIPNAME field in geocorr12
User reported getting truncated names for ZIP codes using mable/geocorr12 application. We were referencing an obsolete (circa mid 90s) format table lookup to get these names, which were in all upper case and truncated to 16 characters. The new format is current, uses mixed case and has no length limit to cause truncation.
County to County Workflow Data Set Added to Archive
We have downloaded the data from the six tables (Excel spreadsheet files) referenced at http://www.census.gov/hhes/commuting/ . We saved each as a csv file which can be accessed at http://mcdc.missouri.edu/cgi-bin/uexplore?/pub/data/acs2010/workflow. We then read the Table1.csv file and created the single archive data set usbyres.sas7bdat. This data set contains one row/observation for every combination of resident/work trip at the county level. (The work level can also be a foreign country or island area, in lieu of a county). We saw no need to read and convert Table2.csv since that is just the same data in a different sort order, something dexter users can easily get by acessing the usbyres data set and specifying a sort order (Section IV of dexter query form) for their extract. This data set makes it easy to find out, for any given county in the US, where the commuters in that county travel to work (county level) and/or where the people who work in that county reside.
CBSA Codes and Related Fields Updated in acs2012.usmcdcprofiles
We found some problems with the CBSA (Core Based Statistical Area) and the related MetDiv (Metropolitan Division), and cbsatype variables on this single-year ACS data set. In the previous conversion we assigned the latest (vintage 2013) codes whenever the County variable was defined by doing a lookup. But that was inconsistent with the fact that the data summarized at the CBSA level by the Census Bureau was using the old 2009-vintage definitions. So we changed it so that all these codes are now the old vintage 2009 codes. We are doing this partly in preparation for processing similar data when we get the 2010-2012 period estimates as released by the Bureau today.
New Front End for the 2010 SF1 Profiles Application
We have replaced the menu module that provides users with access to the MCDC's 2010 SF1-based profile reports. The application now has the same look and feel of the one used as the menu module for the ACS profile reports. You'll see the new interface when you choose the 2010 Census SF1 Profile option from the Quick Links box on the MCDC home (and many other) pages.
New Video-based Tutorial for the Rankster Web Application
We have created a new tutorial that demonstrates this dexter postprocessor utility application using video-based examples and a short powerpoint presentation. Access it at mcdc.missouri.edu/tutorials/rankster.
New Bank Deposits Data for Missouri
We have created two new data sets in the time series stored in the /pub/data/bankdeps directory. These are mobrn13 (detailed data at the branch office level for MO), and mocnty13 (the county deposit totals data set).
Problem With Uexplore Software
(This problem has been fixed. Ignore the following paragraph.)
The uexplore software is currently not working properly when you try to access most non-database (SAS data set) files. The URL being generated to access these files begins with "/pub", which previously was a valid alias but no lonber. We are working on a fix to uexplore so that access to these files will be restored. In the interim, you can get around the problem by editing the URL manually, removing the "/pub" characters. For example if the URL http://mcdc.missouri.edu/pub/data/bankdeps/Datasets.html does not work, edit it to use http://mcdc.missouri.edu/data/bankdeps/Datasets.html instead.
Added Links to Tutorial Modules to MABLE/Geocorr12 Page
We added a row to the top of the geocorr12.html page containing links to two tutorial modules, one a powerpoint presentation and the other a series of video-based examples. These modules were created specifically for the geocorr2k module but they are still useful for the current version since all that has changed is basically the vintage of the geographic codes being selected.
New 2010-2012 ACS Data Added to Data Archive/ ACS Profile App Updated
We have added new data sets to the MCDC public archive based on the recently released 3-year period estimates data from the American Community Survey. The standard extract data set is named usmcdcprofiles3yr and can be accessed in the acs2012 data directory. There is a single data set with over 15,000 geographic areas summarized -- areas meeting the 20,000 population threshold. The data found here is the same as what is displayed in our acsprofile web application (see link at the top of our Quick Links box) which has been updated to allow accessing these data.
Users needing to access the more detailed table data in the Summary Files from the Bureau will find these in the basetbls subdirectory of acs2012. Data structuring and naming conventions are consistent with earlier years and with the 1-year 2012 data made available in September.
New 2010-2012 Now Available Via the ACS Trend Report
The ACS Trend report (http://mcdc.missouri.edu/acs/trends/menu.php) now works with the new 2010-2012 3-year period estimates data.
Correlation List Data/Report Show Relationship of Counties to "2012" PUMAs
We used MABLE/Geocorr12 to generate a csv file which we saved in our corrlst data directory. Access at http://mcdc.missouri.edu/cgi-bin/uexplore?/pub/data/corrlst. The new files include this csv file, uscntypuma12.csv, two dexter-accessible database files - uscntypuma12.sas7bdat and mocntypuma12.sas7bvew, and a report file of Missouri counties and PUMAs, showing the data in the Missouri portion of the equivalency file (mocntypuma12.html).
Updated Lookup Table for ZIP Code (ZCTA) Names (As Used in MABLE/Geocorr)
We noticed that the names associated with ZCTAs in our MABLE/Geocorr12 application were not optimal. We were using the ZIP code "last line" names recommended by the USPS, instead of the more useful local names that ID specific suburbs. A good example is ZIP 63119. We were providing a name of "Saint Louis, MO", but a more useful name is "Webster Groves, MO" (that is more descriptive and is the name you see if you visit the post office building.) We are now combining names from the USPS (stored in our georef.zipcodes data set) with the more useful ones (stored in georef.zcta_master) so that our lookup table now includes all ZIP codes (not just the ones that have ZCTA equivalents). The table can be viewed in the Szipname.sas file in our SAS formats library. More importantly, this table is being used by geocorr12 so when you generate an equivalency file involving 5-digit ZCTAs you will now get these enhanced values for the zipname fields on your output files.
New BEAREIS Income and Profile Data Added
We have downloaded and processed (converted) updated income and BEA economic profile data for all states and the U.S. We were unable to find any revised any new data for employment (emp/N), transfer payments (trf) or farm data (frm) so those data sets were not revised. The new data sets have added data for 2012 with revised estimates for earlier years. These data can be accessed via uexplore/dexter in the beareis data directory. (The Datasets.html page has been updated and can be used for enhanced access with metadata.)
New Datasets for the 2010 SF2 Collection
We were alerted to problems with the PCO tables (available only at the county level and above, dealing with GQ data) in our 2010 Summary File 2 collection (filetype sf22010 accessible at http://mcdc.missouri.edu/cgi-bin/uexplore?/pub/data/sf22010). We fixed the problem and did some minor redesign to make the data sets a bit more user friendly. The new state level national data set is named usstatesg1, with "g1" indicating a first group of characteristic iterations. Our intent is to create several more, and also to create comparable data sets for other geographic units. For individual states (Missouri, Illinois, Kansas and Nevada for now), we have all the "chariters" available on a single data set.
New 2008-2012 ACS Data Coming (Here) Soon
We are working on processing the mountain of ACS 5-year period estimates data released by the Census Bureau on 12-17. We hope to have our new base tables and MCDC profile data sets, as well as our profile web apps, updated within a week or so. Meanwhile, these data can be accessed via American FactFinder at the Census Bureau site.
New 2008-2012 ACS Data Accessible Via MCDC Profile Application
You can now access the latest 5-year ACS period estimates from the ACS Profile Reports web application (http://mcdc.missouri.edu/acs/profiles/menu.php - the first item in our Quick Links menu box).
Go to the top of this page.
See the whatsnew page for last year.
This file last modified Thursday January 23, 2014, 09:09:21
Site Map | Our URL |
The Missouri Census Data Center is a sponsored program of the Missouri State Library within the office of the Missouri Secretary of State. The MCDC has been a partner in the U.S. Census Bureau's State Data Center program since 1979.
Questions/Comments regarding this page or this web site are strongly encouraged and can be sent to