Little Data is a Big Idea

Even little data, such as  a list of crime incidents, locations of bus stops, or population growth estimates, is a big idea, at least according to San Diego magazine’s 25 BIG Ideas.

Data Analysis For Your Mission

Sponsor a Project in Our Student Data Analysis Contest Give your nonprofit, agency or news organization valuable data-driven insights by sponsoring a project at our student data analysis contest.  The San Diego Regional Data Library, the SDSU Society for Statisticians and Actuaries and Teradata are organizing a data analysis contest to aid nonprofits, journalists and government agencies in making … Read more

When Will Data.gov be Useful?

Data.gov is the top level data search system for the US, with references to over 130,000 datasets from federal and state agencies. And yet, I’ve never successfully used it for finding data. Here is an example search for “Diabetes Rates”:   So, we look for diabetes, and get births, 22 year old mortality data from … Read more

Tableau Workbook for SWITRS

Here is the Tableau workbook that we’ll be using for the SPJ Hacks/Hackers Data Show event tonight. You can also get links to all of the documentation from our data warehouse.

Student Data Analysis Contest

Give your nonprofit, agency or news organization valuable data-driven insights by sponsoring a project at our student data analysis contest.  The San Diego Regional Data Library, the SDSU Society for Statisticians and Actuaries and Teradata are organizing a data analysis contest to aid nonprofits, journalists and government agencies in making better use of data, develop a broader regional … Read more

Veterans Density by County

Voice of San Diego has published a story we supported, a fact-check about the density of veterans in San Diego County. You can get all of the data behind the story — including schemas and SQL queries ! — in our data warehouse.  

Learn Data Analysis Techniques

Once you’ve got the basic skills in programming and statistics, the best way to learn data analysis is to do it. So, we’re developing a practical experience program for aspiring data analysts. The program is in the pilot phase with a small set of students, but you can read about how it works on the … Read more

The Cost of Cleaning

We’ve frequently mentioned that people who work on data projects tell us that frequently, 80% of their projects are consumed by data preparation and cleaning, so it is interesting to get this data point from Kaggle: (2) How long is a typical project? When working with a top 0.5% data scientist, projects take just eight … Read more

Burglary Rhythm Maps

A Rhythm Map is a heat map that displays time in the X and Y dimensions. They are an excellent way to visualize repeating patterns in time, such as how crimes occur by hour and data of week. Here we look at some interesting patterns in burglaries in the City of San Diego. First, here is … Read more