Last Wednesday Helene Fournier and I gave a presentation to CIDER, the Canadian Institute for Distance Education Research in which we elaborated on our research related to Personal Learning Environments. You will be able to find the Elluminate recording and files here. As the sound quality was not super, I tidied up the file and you will be able to find the slidecast here.
Monday, May 9, 2011
Wednesday, April 27, 2011
Problems with commercial enterprises dominating the 'cloud'
Did you notice the last couple of weeks that things are changing with those nifty cool Web2.0 and social media applications that not so long ago were a novelty and made lots of waves in the learning technology field? Yes, exactly, first Delicious was not interesting anymore to Yahoo, then last week Google decided to stop their Google video service, now this week Friendster tells us to save our files.
In the case of Delicious, after a public outcry, they have reversed their decision. Google is after widespread protests looking into moving the videos to YouTube, while they re-instated the position of their RSS reader, Google Reader, in their navigation to its original position after protests by RSS aggregators when they moved it.
What can we conclude from this? Clearly, the web-surfers and users are not the customers of these commercial enterprises; their advertisers and share-holders are, the behavior of users are merely the by-product of the money-making enterprise, required to produce the 'social graph' needed for advertisers to sell their stuff. Any application that is not profitable will be disconnected, how successful it might be in supporting people's lives and learning.
Another important point to draw from this is that we as users can collectively influence the behavior of the new Web monopolies to ensure that the services important to us are not cut just like that. These companies have to understand that we can walk with our feet and that they will have to perhaps provide some services that are vital to the lives of users at a loss to on the other hand make lots of money in other ones, very much like commercial bus or postal service operators are required by governements to run not such profitable routes in order to provide a balanced service. Of course there is no global government to take on these companies, bar perhaps the European Union who is not afraid to fine the Microsoft, Apple or Google of this world if they breach monopoly laws.
The final point I would like to make is that it might be time for new public services to safeguard what is vital for education and tp people's learning. We have public libraries, why not public search engines, as was suggested by White. These would not be guided by commercial interests, but would be available to safeguard our social and cultural heritage. It is clear that the way the Cloud is ruled does nothing to ensure that what is important to its users is maintained, rather it is like everywhere else in the world, it is greed that makes the Cloud go round.
In the case of Delicious, after a public outcry, they have reversed their decision. Google is after widespread protests looking into moving the videos to YouTube, while they re-instated the position of their RSS reader, Google Reader, in their navigation to its original position after protests by RSS aggregators when they moved it.
What can we conclude from this? Clearly, the web-surfers and users are not the customers of these commercial enterprises; their advertisers and share-holders are, the behavior of users are merely the by-product of the money-making enterprise, required to produce the 'social graph' needed for advertisers to sell their stuff. Any application that is not profitable will be disconnected, how successful it might be in supporting people's lives and learning.
Another important point to draw from this is that we as users can collectively influence the behavior of the new Web monopolies to ensure that the services important to us are not cut just like that. These companies have to understand that we can walk with our feet and that they will have to perhaps provide some services that are vital to the lives of users at a loss to on the other hand make lots of money in other ones, very much like commercial bus or postal service operators are required by governements to run not such profitable routes in order to provide a balanced service. Of course there is no global government to take on these companies, bar perhaps the European Union who is not afraid to fine the Microsoft, Apple or Google of this world if they breach monopoly laws.
The final point I would like to make is that it might be time for new public services to safeguard what is vital for education and tp people's learning. We have public libraries, why not public search engines, as was suggested by White. These would not be guided by commercial interests, but would be available to safeguard our social and cultural heritage. It is clear that the way the Cloud is ruled does nothing to ensure that what is important to its users is maintained, rather it is like everywhere else in the world, it is greed that makes the Cloud go round.
Friday, March 4, 2011
The value of analytics in an educational and learning context
I had some time to reflect on the presentations and conversations at the 1st International Learning Analytics and Knowledge Conference in Banff. There were many thought provoking presentations that gave an inkling as to the direction people interested in education, or interested in educational technology, might take analytics in the coming years. One of the figures I found most interesting, came from Abelardo Pardo, who worked with Carlos Delgado Kloos on a 'virtual machine' that they used in their research. They asked their students to install the file on their regular computer and use it for their course work, while Abelardo and Carlos could track student activity. When they looked at the browsing behavior, only 28.51% of students accessed LMS-related pages for their learning activities, while all other pages accessed were outside this institutionally controlled environment. Now of course it is quite likely that there are contextual factors that influenced this behavior, but still, it clearly points towards a finding that students only make a limited use of the institutional LMS for their learning and that if analytics are to be meaningful, they will have to include student learning activities outside the LMS. Quite some analytics presented at the conference were related to the institutional LMS. Of course this begs the question: if students only use the LMS for such a limited amount of their learning, and data on the other learning is not collected, what will be the relevance and value of carrying out analytics on this LMS environment?
Some presentations showed that analytics might be used to enhance the effectiveness and streamlining of the processes taking place in educational institutions in four ways:
1. To support the administration
2. To adapt the learning support services to make up for deficiencies in student performance.
3. To show learners their analytics in order for them to reflect on their performance and perhaps adapt their learning and learning behavior in certain ways.
4. To adapt teaching to analytics findings about student learning and learning behavior
What do I think of these four?
1. Analytics to support the bureaucracy must always be a bad thing, as analysis of data always means inputting of data, from which follows that learners and educators will have to engage in this added burden. There is enough evidence to support that the bureaucratization of university is a negative, rather than a positive development (Foucault, Reading, Delanty).
2.I like the idea that analytics might make it possible for student support services to be better matched to student needs, but coming from a background in adult education and widening access to Higher Education, I have seen my fair share of problems with using the deficiency model to support learners. I feel more comfortable with
3. the analytics model promoted by Erik Duval who runs analytics on student activities and shows the students the results. This seems more empowering to learners as it involves a need for reflection on their learning.
4. Analytics can also be run as a research tool, so teaching staff might get a better understanding of the learner experience and the problems learners might come across in order to better match their teaching. Caroline Haythornthwaite showed us some of her visualizations of communication and group forming, which highlighted insights that analytics might provide in the ties between learners in learning settings.
If the analytics are solely run on the LMS related activity and the 28.51% figure is in any way generalizable to other institutions, of course all these analytics will only tell roughly a quarter of the story. It means that people will have to start using analytics outside the institution, on the network, as Helene Fournier and I have done here at NRC in Moncton. Of course carrying out analytics on networks is not easy as people access services in a distributed environment and the analytics would be most meaningful if these could somehow be linked, perhaps by using the same identification for all of them. It would be cool, though, and could enhance the learning experience of self-directed learners, if they would be able to quickly check if they would meet their learning goals through visualizations of their activity. As that is one thing I have learned engaging in analytics: visualisation does clarify activity pretty well.
Some other developments related to linked data are the research and design of recommender systems for learning. Currently there are problems with the testing of these as large data-sets are required to ensure reliability and consistency of results as Katrien Verbert highlighted in her talk. Some other analytics-related systems are currently under development at the Open University in the UK, such as Cohere, a discourse argumentation tool that aims for depth in discussion, and iSpot, related to BBC nature programmes, that uses a novel ranking system.
A theme running throughout the conference in several of the presentations, was the ethical dimension. analytics is about human behavior and of course there are some important ethical considerations to the collection of human data. This will be another post before long.
Learning Analytics is clearly a developing field and there is still a lot to learn for all involved! Thanks again George for bringing us all together in such a wonderful location.
Some presentations showed that analytics might be used to enhance the effectiveness and streamlining of the processes taking place in educational institutions in four ways:
1. To support the administration
2. To adapt the learning support services to make up for deficiencies in student performance.
3. To show learners their analytics in order for them to reflect on their performance and perhaps adapt their learning and learning behavior in certain ways.
4. To adapt teaching to analytics findings about student learning and learning behavior
What do I think of these four?
1. Analytics to support the bureaucracy must always be a bad thing, as analysis of data always means inputting of data, from which follows that learners and educators will have to engage in this added burden. There is enough evidence to support that the bureaucratization of university is a negative, rather than a positive development (Foucault, Reading, Delanty).
2.I like the idea that analytics might make it possible for student support services to be better matched to student needs, but coming from a background in adult education and widening access to Higher Education, I have seen my fair share of problems with using the deficiency model to support learners. I feel more comfortable with
3. the analytics model promoted by Erik Duval who runs analytics on student activities and shows the students the results. This seems more empowering to learners as it involves a need for reflection on their learning.
4. Analytics can also be run as a research tool, so teaching staff might get a better understanding of the learner experience and the problems learners might come across in order to better match their teaching. Caroline Haythornthwaite showed us some of her visualizations of communication and group forming, which highlighted insights that analytics might provide in the ties between learners in learning settings.
If the analytics are solely run on the LMS related activity and the 28.51% figure is in any way generalizable to other institutions, of course all these analytics will only tell roughly a quarter of the story. It means that people will have to start using analytics outside the institution, on the network, as Helene Fournier and I have done here at NRC in Moncton. Of course carrying out analytics on networks is not easy as people access services in a distributed environment and the analytics would be most meaningful if these could somehow be linked, perhaps by using the same identification for all of them. It would be cool, though, and could enhance the learning experience of self-directed learners, if they would be able to quickly check if they would meet their learning goals through visualizations of their activity. As that is one thing I have learned engaging in analytics: visualisation does clarify activity pretty well.
Some other developments related to linked data are the research and design of recommender systems for learning. Currently there are problems with the testing of these as large data-sets are required to ensure reliability and consistency of results as Katrien Verbert highlighted in her talk. Some other analytics-related systems are currently under development at the Open University in the UK, such as Cohere, a discourse argumentation tool that aims for depth in discussion, and iSpot, related to BBC nature programmes, that uses a novel ranking system.
A theme running throughout the conference in several of the presentations, was the ethical dimension. analytics is about human behavior and of course there are some important ethical considerations to the collection of human data. This will be another post before long.
Learning Analytics is clearly a developing field and there is still a lot to learn for all involved! Thanks again George for bringing us all together in such a wonderful location.
Wednesday, March 2, 2011
Learning about learning analytics
I have been at the 1st International Learning Analytics conference in Banff over the past two days and it has been an eye opener to the power of analytics. Not just to enhance efficiency of educational institutions, but also to help learners in their learning and researchers and educators in getting an understanding in the dynamics in class rooms and on networks. I will write more about the most interesting points later.
For now I have included the link to the presentation at the conference by Helene Fournier and me that tells a bit more about our use of analytics in our MOOC research. If you prefer a different format, Doug Clow has been tapping away on his live-blog and given a near verbatim account of the event.You can find the link here.
For now I have included the link to the presentation at the conference by Helene Fournier and me that tells a bit more about our use of analytics in our MOOC research. If you prefer a different format, Doug Clow has been tapping away on his live-blog and given a near verbatim account of the event.You can find the link here.
Thursday, February 24, 2011
Learning on MOOCs
Back to writing my blog after some time writing different types of papers and having been 'up to my elbows' in data, yes MOOC data, to make sense of the learning processes on PLENK2010. Helene Fournier and I have been quite busy over the past months analysing data and writing papers and preparing presentations, which we will post here as they are being published.
The post by Martin Weller on the responsibility of learners in a MOOC, and the comments to it, has made that it seems time to write some of the findings of our research here. The issues I found most interesting in the PLENK data relate to Martin's point on responsibility of the learner, the nature of active participation on MOOCs, the factors affecting active participation and how people on PLENK experienced their participation.
From the data (that we collected using qualitative and quantitative methods) it was clear that there are a number of issues that stand out.
I have included here a link to the slidecast of a presentation I gave of a paper on New Dimensions to Selfdirected Learning on Open Networked Learning Environments, that Helene Fournier and I prepared for the 25th International Self-directed Learning Symposium that was held in Cocoa Beach, Florida earlier in February.
The post by Martin Weller on the responsibility of learners in a MOOC, and the comments to it, has made that it seems time to write some of the findings of our research here. The issues I found most interesting in the PLENK data relate to Martin's point on responsibility of the learner, the nature of active participation on MOOCs, the factors affecting active participation and how people on PLENK experienced their participation.
From the data (that we collected using qualitative and quantitative methods) it was clear that there are a number of issues that stand out.
- Power relations on the MOOC
- Confidence levels of novice MOOCers
- The level of presence of participants and facilitators
- The willingness to help by all involved.
I have included here a link to the slidecast of a presentation I gave of a paper on New Dimensions to Selfdirected Learning on Open Networked Learning Environments, that Helene Fournier and I prepared for the 25th International Self-directed Learning Symposium that was held in Cocoa Beach, Florida earlier in February.
Thursday, December 16, 2010
Who is to say what is active participation?
The online discussion that George started by his post on lurking on #PLENK2010 made that Helene and me at NRC wanted to know a little more on how people perceived themselves to be: 'lurkers' or 'active producers', what determined their choice and how important lurking or actively producing has been for their learning as this really goes to the heart of learning on MOOCs. That’s why we produced the surveys.
People who have read my blog posts and earlier comments on George's and Jenny's blogs know that I researched 'lurking' in the past and already know that especially self-directed learners will fall into the lurking category. Of course we should not forget that the majority of PLENK participants are mature adults with a high level of education and a predisposition to self-directed learning through their natural development as human beings, so it is not surprising that only 40-60 people chose to be active producers on the course and all others (around 1550) chose not to during the 10 weeks that PLENK ran. I also found the paper by Nielsen (reference by Eduardo Peirano as one of the comments on George's blog post) on lurking on the Web illuminating as it confirmed that the numbers of 'lurkers' in PLENK are no different from the numbers in other online networked engagement.
The basis of MOOCs has always been four activities: 1. Actively aggregating, 2. Actively relating these aggregated resources to earlier experiences and knowledge, what Stephen Downes calls remixing, 3. Actively repurposing; producing a digital artifact with this mix of thoughts, and 4. An actively sharing stage.
If it is true that people don't require the producing activity for their learning, we might have to reconsider if it is necessarily to promote it as strongly as it has been done at the start of MOOCsin the past. Of course as some people mentioned in the discussion, if nobody is an active producer, there is not much to base the remixing stage on. It also takes away a lot of the creativity that people showed through the artifacts they produced and that we all discussed, admired and used to develop our own ideas and thoughts.
Ctscho (commenting on Jenny's blog), I agree with you that George was wrong to add negative connotations to the activities of most of the PLENK participants, as of course the ‘lurkers’ have been actively engaged in the course through the other three activities: aggregating, remixing and sharing. And our research so far shows that people were actively engaged in these activities, although the sharing took mostly place outside the PLENK course structure and sometimes after the course had finished because people needed time to think about the high level of resources and information they had to digest during the course. It would not surprise me if George did this to provoke the discussion ;-)
If the majority of PLENKers think that their active participation, without the producing stage, is legitimate (and the empirical evidence that we collected so far clearly points in that direction) it might be that George has to eat his hat ;-), and reconsider his ideas, beliefs and feelings regarding what type of activity is required for learning on a course of this nature. Current theories of learning show that activity is conductive to learning, but luckily they do not prescribe what type of activity this would have to be!
Another issue that needs to be considered is if the format of the course, which has not changed much since the initial MOOC CCK08, is really conductive to people actively engaging and producing. It came up throughout the course that the active producing and engagement in the course might be stimulated by a higher level of ‘strong’ rather than ‘weak’ ties amongst participants. Of course this will always be challenging in a course with this high number of participants (1614). People suggested for instance a ‘buddy’ system, where old-timers would be encouraged by facilitators at the start of the course to form some groups to support new-comers. It was also highlighted that the latter were least likely to have the confidence to produce, and the closer ties might create an atmosphere of trust that would make people feel more at ease than on the wide open open course. The Second Life group also turned out to be perceived as a place to make people feel comfortable. Of course it cannot be denied that in a course like this there were some strong characters and power-plays between participants (and facilitators) as in any other place where humans congregate that might have influenced engagement and participation.
For the development of our PLE, it is important to get as much feedback from you as possible on this as we have to decide what features we can or should build into our PLE to create the best possible environment to support learning. The surveys are still open and so far 68 people have filled out the lurking one and 28 the active producer one. Comments on other issues are also welcome, in the surveys or on any of the blogs and discussion forums with the #PLENK2010 tag.
Thursday, December 9, 2010
Active participation - lurking on PLENK
It is a while that we had the last PLENK2010 session, but quite an interesting debate has flared up about the importance (or not) of active participation in Massive Open Online courses such as #PLENK2010. You might have seen George Siemens' blog post and comments, and the ones that followed by Jenny Mackness and John Mak .To learn more from PLENK participants on this issue, Helene Fournier and I hoped participants would not be quite 'surveyed out' yet and would be willing to fill out one of the two surveys below.
NRC researchers would like to invite Active Participants in PLENK2010 to fill out a survey on their experiences in this Massive Open Online Course. Active participants include learners who actively contributed to discussion forums in the course Moodle, blogs, twitter, social networking sites, and in the sharing and production of artifacts. The Active Participant Survey can be found here http://www.surveymonkey.com/s/JDC58ZM.
NRC researchers would like to invite PLENK2010 Lurkers to fill out a survey on their experiences in this Massive Open Online Course. Lurking is defined in this context as passive attention, silent participation, and/or self-directed learning. There has been a lot of interesting discussion on the topic of lurking on the BlogSphere so we would like to explore the issues a bit more through this survey. The PLENK2010 Lurker survey can be found here http://www.surveymonkey.com/s/JJ8ZXMC.
The research team thanks you in advance for your invaluable contribution to the research! Contact Helene Fournier (helene.fournier@nrc-cnrc.gc.ca) for any further inquiries about the surveys or the research.
Subscribe to:
Posts (Atom)