Of That

Brandt Redd on Education, Technology, Energy, and Trust

Showing posts with label data. Show all posts
Showing posts with label data. Show all posts

20 November 2014

Education Data Standards Update

Over the last couple of years, some colleagues and I have developed several models that are useful for understanding education data standards, where they apply and how they fit together. Many thanks go to host of collaborators who have reviewed and helped with these models.

The first is the Four-Layer Framework for Data Standards. This framework has helped guide decisions about the Common Education Data Standards – what should be the scope and how CEDS should relate to other standards in the space. However, the framework is not limited to education standards. Any organization that's developing specifications for the exchange of data should think of these four layers and try to describe each part semi-independently.

Last year I developed A Taxonomy of Education Standards. This framework categorizes standards according to their purpose or the domain in which they are applied.

These education standards are not exclusively data standards. Academic Standards, which include Achievement Standards and Competency Standards describe skills that students should be able to demonstrate as they achieve certain levels of education. Nevertheless, there are data standards for describing Academic Standards and for aligning content to those standards.

In May of 2013 my friends at SETDA published Transforming Data to Information In Service of Learning. This is an enormously valuable survey of existing data standards with guidance on how organizations can apply them to improve learning and support interoperability of their learning technologies. In doing so, they used both the four-layer model and the taxonomy.

Shortly thereafter, I combined the models into a two-dimensional matrix with the four layers on the horizontal axis the taxonomy on the vertical axis. This allows us to plot existing and proposed standards against the two dimensions to see how they fit together.

At the iNACOL symposium two weeks ago Liz Glowa, Jim Goodell and I presented a workshop on "Competency Education Informed by Data". For that workshop I updated the matrix to reflect changes in the standards landscape over the last year. Here's the updated version:

For that same workshop, Jim Goodell developed a matrix plotting the layers on the vertical axis and the progression from Pre-K to primary, secondary, higher education, and workforce data on the horizontal.


And to tie these all together, here's a translation of the acronyms into the standards with links to their corresponding websites.

AIFAssessment Interoperability Framework
CCSSCommon Core State StandardsBlog Post
CEDSCommon Education Data Standards
Ed-FiEd-Fi Alliance
EDIElectronic Data Interchange
ESBEnterprise Service Bus
IMS CCIMS Common Cartridge
IMS LTIIMS Learning Tools Interoperability
IMS QTIIMS Question and Test Interoperability
LRLearning RegistryBlog Post
LRMILearning Resource Metadata InitiativeBlog Post
NGSSNext Generation Science Standards
OAI-PMHOpen Archives Initiative - Protocol for Metadata Harvesting
OBIOpen Badge Infrastructure
PESCP20W Educational Standards Council
RESTRepresentational State Transfer
SEEDState Exchange of Education Data
SIFSIF Association
SOAPSOAP Protocol
xAPIExperience API (AKA Tin-Can API)

Updated: 25 Nov 2014 to add the OAI-PMH protocol.

11 June 2013

Data Standards in Service of Learning

My friends at SETDA have published a new paper, "Transforming Data to Information in Service of Learning". It represents a movement that I favor. Historically, educational data has been used primarily for accountability purposes. But, properly reported, data can guide instruction and learning and personalize the experience. The result is significant improvement to student achievement.

The SETDA paper incorporates two models that I've used to categorize standards. The Four-Layer Framework for Data Standards divides data standards into four layers of work that build upon each other. The more recent Taxonomy of Education Standards looks at categories of data within the education sector. Shortly before I changed jobs, one of my Gates Foundation colleagues asked if I could make a chart placing existing standards efforts against these two models. I decided to do it all at once by merging the models into a matrix. Here's the result:


To understand the chart better, I recommend reading the descriptions of the two models. The Four-Layer Framework for Data Standards and the Taxonomy of Education Standards.

There's a lot of crowding in the area of student data. The standards in this area don't compete as much as it would appear. While there's some overlap, most fill complimentary roles. Details of all of these standards efforts and how they relate to each other are in the SETDA paper.

Here are links to the official websites and, in some cases, my writing related to each of the above standards.

CCSSCommon Core State StandardsBlog Post
CEDSCommon Education Data Standards
SEEDSoutheast Education Data Exchange (Digital Passport)
Ed-FiEd-Fi Alliance
EDIElectronic Data Interchange
ESBEnterprise Service Bus
GIM-CCSSGranular Identifiers and Metadata for CCSSBlog Post
IMSIMS Global Learning Consortium
IMS LTIIMS Learning Tools Interoperability
inBloominBloom
LRLearning RegistryBlog Post
LRMILearning Resource Metadata InitiativeBlog Post
OBIOpen Badge Infrastructure
PESCP20W Educational Standards Council
RESTRepresentational State Transfer
SIFSIF Association
SOAPSOAP Protocol
TCAPITin Can API (AKA Experience API)

Like most everything on this blog, these models and this chart are free to reuse under a CC-BY license. I hope they're helpful to your efforts.

30 November 2012

Learning from Data - An Automotive Example

Monday saw me driving 800 miles home from a family Thanksgiving celebration. Due to my wife's change in plans, my only companion for the drive was our small dog (who had a narrow escape the day before). I needed something to keep my attention. So I decided to perform an experiment in data collection. I learned a lot even from a small data sample.

The vehicle I was driving was a 2010 Subaru Forester. Some friends have the same vehicle and have been pleased with getting around 27 MPG on the highway. We typically get only 23-24 MPG on the highway and I had been wondering why.

Among the features of this car is an average gas mileage display that's tied to the trip odometer. So, sampling the gas mileage is as simple as setting the cruise control, resetting the trip odometer, driving a set distance and reading out the result. As I was crossing the relatively flat plains of Idaho (speed limit 75) this seemed to be a good opportunity to gather some data.

Over a period of several hours, I took a bunch of samples following the above method and using my GPS to track altitude changes. I abandoned samples where the altitude change was more than a few hundred feet. The result is 27 good samples. I've posted the raw data here in case you want to play with them. Most of the samples are for 20 mile segments but some are as long as 40 and some are as short as 5 miles.

As you can imagine, the lower-speed samples got a bit tedious. But I was curious enough that I even took a side trip on a remote road (off the freeway) to get samples below 45 MPH. There's considerable variability in those results as you can see in the plot below. Halfway through the trip I refilled with fuel. I switched from regular (87 octane) to premium (92 octane) to see how that might affect mileage.

2010 Subaru Forester Fuel Economy vs. Speed
The results certainly aren't what I expected. EPA city and highway ratings have always led me to expect relatively flat miles per gallon with city being much poorer due to stop-and-go driving. Instead, I got a nearly linear downward slope. Using Excel's curve-fitting feature and found that a polynomial curve worked better than a line. The formula is embedded in the graph above.

More data points would be required to really validate this curve but it certainly fits within the margin of error of my samples. Therefore we can make some cost estimates using this formula. Notable is that peak economy is between 40 and 45 MPH – much slower than I had expected. From this I was able calculate the cost of each hour saved on this long drive.

Here's a table of results for a 800 mile drive in a 2010 Subaru Forester with average fuel cost of $3.759 per gallon. Time saved and additional cost are from a baseline speed of 55 MPH. Note that the distance is cancelled out in the Cost Per Hour Saved so those numbers are accurate regardless of the length of the trip.

SpeedMPGFuelCostTime  Hrs
Saved
Addl
Cost
Cost Per
Hr Saved
5533.1$90.8314.55
6032.1$93.7113:331.21$2.89$2.38
6530.7$97.8812.312.24$7.05$3.15
7029.0$103.6511.433.12$12.82$4.11
7527.0$111.5510.673.88$20.72$5.34
8024.6$122.4510.004.55$31.62$6.96
8422.4$134.319.525.02$43.48$8.66

Here are a few things I've learned from this:

  • My friend with the other Forester drives slower on the highway than I do.
  • I had not known how sensitive vehicle gas mileage is to speed.
  • Everything I have read led me to expect no benefit from higher octane fuel once the vehicle's requirements have been met. In the case of the Forester, higher octane actually reduced fuel economy. This observation is confirmed by the official EPA ratings.
  • I would love to see tables like the one above before purchasing my next car.
I learned a lot from this tiny data sample and my future driving habits will be changed accordingly. Now imagine what we could learn if there were a large public database of fuel economy data. Car manufacturers could optimize for specific driving patterns. Consumers would be better informed about fuel economies to expect. There are fleet tracking devices like this one that are already reporting that data but it's locked up in private databases. If anonymous fuel economy data (speed, distance, altitude and MPG) were released there's a lot we could learn about fuel economy under a variety of conditions.

I can't wrap this post up without relating it to education. A relatively small data sample taught me a lot and will impact my future driving behavior. In the same way, it doesn't take a lot of data fed back to students and teachers before they see opportunities to improve. And when we grow from little data to big data, revolutionary changes are on the horizon.

04 October 2012

CEDS and the Four-Layer Framework for Data Standards - Updated

About a year ago I posted a Four-Layer Framework for Data Standards. It was developed as Common Education Data Standards (CEDS) working groups were discussing the space in which CEDS operates and what makes its contribution unique. Today I'm updating the framework document – adding some clarity but mostly reconciling terminology with that used by CEDS.

In the June CEDS stakeholders' meeting the group emphasized that CEDS works strictly at layers 1 and 2 (Data Dictionary and Logical Data Model) leaving serialization and protocol to other standards organizations. This leads a unique approach (at least unique to the education standards space) in which the focus is on alignment instead of compliance.

To support this strategy, CEDS has posted the Align and Connect tools. The Align tool allows State Education Agencies, software vendors and other organizations to post their data models and show how their elements align to CEDS. Organizations can choose to make their data models public; in which case Align can be used to report the degree of alignment between two data models. The new Connect tool addresses the sharing of metric definitions like graduation rate, student financial aid repayment or college-going rate. Metrics like these are not in the data model, they are derived from that data. And different organizations may combine the data in different ways. Connect supports the sharing and eventual standardization of these metric definitions.

Another question I've gotten is how the four-layer framework overlaps with the OSI 7-layer model. Layers 1-3 (Data Dictionary, Logical Data Model and Serialization) in the four layer model map to the Application layer (layer 7) which is at the top of the OSI model. All other layers in OSI are combined into the Protocol layer in the four-layer model.

The latest four-layer document is here. It's released into the public domain under a CC0 disclaimer.