Month: December 2014

Launching the Open Education Handbook

This morning I am taking part in a hangout to launch The Open Education Handbook, a collaboratively written document published by Open Knowledge Foundation for which I acted as the editor for the most recent edition.

Lots of people were involved in putting together the manual, both directly (in book ‘sprints’ and through a working group) and indirectly through their support of the LinkedUp project.  Originally the focus of the project was open data but this quickly expanded to areas relevant to open data (including OER, policy, education).  Open research data and open educational data have much potential for influencing education and the working group opens up a space to think and collaborate around this.

The Open Education Working Group takes an open approach to collaboration, which has also been applied to the handbook.  The LinkedUp project was required to produce a handbook as a project deliverable and it was decided that an open, collaborative and community based approach would be appropriate.  The idea of using ‘book sprints‘ was new to the team, and was slightly watered down so that instead of trying to write the whole thing in three days there would be working groups and multiple sprints which attempted to improve the existing version.  The sprints were held at conferences and workshops with a ‘question and answer’ approach used to structure the content.  Around the time of the second sprint the workspace moved from Google Docs to BookType which helped the organisation of the materials as well as version control.  The working group would regularly meet to chat about the project.

Translating the book into Portuguese allowed for further refinement of the draft as the translators queried the structure of the book as well as the possible Eurocentric quality of the earlier drafts. My own contribution was to try and pull in the shape the rather fragmentary draft and apply a consistent editorial tone across the manuscript.  This involved moving away from the ‘question & answer’ model originally used to generate content to reassemble and rephrase content more like a structured narrative but also leaving open the possibility of reading sections in no particular order.

The latest version is still available for editing and there will undoubtedly be new versions as we move forward.

  • Martin Poulter reported that the book content is being imported into WikiBooks for ongoing wiki style editing and improvement;
  • Jo Paulger spoke about the FLOSS manuals site as another possible home for the handbook (and possibly the more ‘official’ versions as they are produced.

Here are Marieke Guy‘s slides from the hangout:

Workshop Notes: #Ethics and #LearningAnalytics

This morning I’m attending a talk given by Sharon Slade about the ethical dimensions of learning analytics (LA), part of a larger workshop devoted to LA at The Open University’s library on the Walton Hall campus.

I was a bit late from a previous meeting but Sharon’s slides are pretty clear so I’m just going to crack on with trying to capture the essence of the talk.  Here are the guidelines currently influencing thinking in this area (with my comment in parentheses).

  1. LA as a moral practice (I guess people need to be reminded of this!)
  2. OU has a responsibility to use data for student benefit
  3. Students are not wholly defined by their data (Ergo partially defined by data?)
  4. Purpose and boundaries should be well defined and visible (transparency)
  5. Students should have the facility to update their own data
  6. Students as active agents
  7. Modelling approaches and interventions should be free from bias (Is this possible? What kind of bias should be avoided?)
  8. Adoptions of LA requires broad acceptance of the values and benefits the development of appropriate skills (Not sure I fully grasped this one)

Sharon was mainly outlining the results of some qualitative research done with OU staff and students. The most emotive discussion was around whether or not this use of student data was appropriate at all – many students expressed dismay that their data was being looked at, much less used to potentially determine their service provision and educational future (progress, funding, etc.). Many felt that LA itself is a rather intrusive approach which may not be justified by the benevolent intention to improve student support.

While there are clear policies in place around data protection (like most universities) there were concerns about the use of raw data and information derived from data patterns. There was lots of concern about the ability of the analysts to adequately understand the data they were looking at and treat it responsibly.

Students want to have a 1:1 relationship with tutors, and feel that LA can undermine this; although at the OU there are particular challenges around distance education at scale.

The most dominant issue surrounded the idea of being able to opt-out of having their data collected without this having an impact on their future studies or how they are treated by the university. The default position is one of ‘informed consent’, where students are currently expected to opt out if they wish. The policy will be explained to students at the point of registration and well as providing case studies and guidance for staff and students.

Another round of consultation is expected around the issue of whether students should have an opt-out or opt-in model.

There is an underlying paternalistic attitude here – the university believes that it knows best with regard to the interests of the students – though it seems to me that this potentially runs against the idea of a student centred approach.

Some further thoughts/comments:

  • Someone like Simon Buckingham-Shum will argue that the LA *is* the pedagogy – this is not the view being taken by the OU but we can perhaps identify a potential ‘mission creep’
  • Can we be sure that the analyses we create through LA are reliable?  How?
  • The more data we collect and the more open it is then the more effective LA can be – and the greater the ethical complexity
  • New legislation requires that everyone will have the right to opt-out but it’s not clear that this will necessarily apply to education
  • Commercialisation of data has already taken place in some initiatives

Doug Clow then took the floor and spoke about other LA initiatives.  He noted that the drivers behind interest in LA are very diverse (research, retention, support, business intelligence, etc).  Some projects of note include:

Many projects are attempting to produce the correct kind of ‘dashboard’ for LA.  Another theme is around the extent to which LA initiatives can be scaled up to form a larger infrastructure.  There is a risk that with LA we focus only on the data we have access to and everything follows from there – Doug used the metaphor of darkness/illumination/blinding light. Doug also noted that machine learning stands to benefit greatly from LA data, and LA generally should be understood within the context of trends towards informal and blended learning as well as MOOC provision.

Overall, though, it seems that evidence for the effectiveness of LA is still pretty thin with very few rigorous evaluations. This could reflect the age of the field (a lot of work has yet to be published) or alternatively the idea that LA isn’t really as effective as some hope.  For instance, it could be that any intervention is effective regardless of whether it has some foundation in data that has been collected (nb. ‘Hawthorne effect‘).

Featured Image -- 1436

Why is Openness such a Closed Subject?

Interesting thoughts from Adam Heidebrink-Bruno on the purported neutrality as a value base and movement within education. I have heard many times from people in these circles that there is something non-ideological behind openness; of course like any good critic of ideology I would note that this probably involves some level of self-deception (or at least self-censorship). My own view is that the open education movement is at a point where it really needs to engage with its own assumptions about what it stands for: both to set a bulwark against commercial abuse of the language but also to help us orientate, re-orientate, and focus efforts.