Bitly link for this pad: http://bit.ly/CC2016-Mar-9
Audio recording: https://archive.org/details/OpenBadgesCommunityCall20160309
WELCOME TO THE OPEN BADGES COMMUNITY CALL
Wednesdays, 12 pm ET / 9 am PT / 5pm UTC & GMT
Conference Number: https://www.uberconference.com/badgealliance
Optional dial in number: 207-645-1621 (no PIN required)
Please keep your line muted when you're not speaking and announce your name when you speak up. if you've dialed in from a browser, you can control your mute setting there. If you've dialed in by phone, hit * * to unmute.
The call moderator can also unmute you from uberconference as well. Send a message in the chat if you are trying to speak and we can't hear you.
Open Badges: http://openbadges.org
Badge Alliance: https://www.badgealliance.org
Google Group: https://bit.ly/OpenBadgesGroup
Join our channel on Slack: http://bit.ly/badgealliance-slack-register
MEETING: March 9, 2016
Please state your name each time you speak to help everyone out!
Please include your name when you write notes in the etherpad.
Roll Call: Who's here?
Please add your name / Affiliation / Twitter handle / email address / Org & intention for your involvement in the wider badges community:
- Doug Belshaw / Independent Consultant / @dajbelshaw / email@example.com / Evangelist
- Alan Levine / Itinerant Web Geek / @cogdog / firstname.lastname@example.org / Up in the air
- James Willis / researcher / Indiana University / @Willis3James / email@example.com
- Julia Green / Pioneer of Something/ FIRSTinMIchigan/ @FIRSTBadgesfirstname.lastname@example.org/ http://FIRSTBadges.com - listening only, no microphone today
- Don Presant / Learning Agents / @donpresant / email@example.com / Open Badges in Canada
- Nate Otto / @ottonomy / firstname.lastname@example.org / Badge Alliance
- Federico Giacanelli / @bolsoblog /@joinbestr / https://bestr.it / email@example.com
- Katie Woodmansee/ Colorado Community College System/ firstname.lastname@example.org
- Randy Macdonald/@email@example.com/Innovation Academy-InnovateOregon
- Simone Ravaioli / @psykoreactor /firstname.lastname@example.org / Bestr
- Daniel Hickey/@email@example.com/@dthickey
- Serge Ravet / @szerge / Open Badge Passport
- Johannes Konert / @jkwebtech / Beuth Univ. Berlin / firstname.lastname@example.org
- Bryan Mathers / @bryanmmathers / Visual Thinkery
- Rich Dixon/ @RichEdTech / email@example.com / PD Learning Network / We work with badging K12 educators in edtech skills
- Matt Rogers / DigitalMe / @mattdigitalme
- Dan Hoffman / RedCritter / www.redcritterteacher.com / www.redcritterconnecter.com / firstname.lastname@example.org
- Robert Bajor / Digital Promise Educator micro-credentials / @misterbajor / http://www.digitalpromise.org/initiatives/educator-micro-credentials / Our OB platform: http://www.bloomboard.com/digitalpromise / Robert@digitalpromise.org
- Ian O'Byrne / @wiobyrne / College of Charleston
First time introductions:
- Johannes: I work on OpenBadge extension for competency alignment (criteria-field & alignmentObject) using InLOC linked data (JSON-LD)+1 in european erasmus+ project http://www.openbadgenetwork.COM
REMINDER: these calls are recorded for future review, published CC-BY on archive.org
What are you working on this week?
- Chris Crytzer: Follow up to March 2 call: The IMS Global Open Badge Extensions for Education meetings are for IMS members; however, sessions may be opened up to invited experts as needed for information and consultation purposes. IMS will notify the Badge Alliance team for recommendations. boo
- James: Great higher ed call yesterday featuring Ben Roome from Badge List. Presentation, recording, and etherpad link available here: https://sites.google.com/site/openbadgesinhighereducation/working-group
- 22 March higher ed call will feature Ian O'Byrne speaking about blockchain + badges in an alternative format... http://badgechain.com / https://medium.com/badge-chain
- 5 April higher ed call will feature roundtable of folks to discuss Canvas integration of badges: Mark Leuba (IMS Global), Nate Otto (Badgr), Eric Korb (Accreditrust), and Jonathan Finklestein (Credly)
- Don: my 10th blog post (wordpress.com awarded me a badge; not an open one, but it felt good - worth reaching out to them?)(not sure it's worth it for this..people can count posts, but perhaps as part of other things...see E-Learning Provocateur https://ryan2point0.wordpress.com/): Recognizing Self-Directed Learners with Open Badge eCredentials http://bit.ly/littoraly10 will discuss on Stephen Downes' Personal Learning MOOC right after this call
- 10 weeks, 10 blog posts, doing new years resolutions right!
- Doug: building out resources section of OB101 [ http://badges.thinkoutloudclub.com / https://github.com/thinkoutloudclub/badge-course ], keynoting #openbadgesHE [ https://goo.gl/Pneycm ], working on badge-related stuff with City & Guilds.
- Nate: Standard WG launches 2016 cycle https://medium.com/badge-alliance/badge-alliance-standard-working-group-launches-2016-cycle-9b2fb3e0fae9#.sgciq31mc
- Simone: just playing around to become a Futurist of Education on http://www.learningisearning2026.org/ by the Institute For the Future (IFT) ... keynote by Jane McGonigal at SXSWEdu.
- Dan: lots of stuff, met with the IMS Global OBEE Analytics group on monday, had a very satifying round of discussion and convinced the group to add the word "evidence" to the mission statement. Also getting lots of interesting paper to review from journals and reviewing that literature as part of a major literature review on motivation and digital badges. << Open access? Who needs open access when Sci-Hub has pirated That's like saying who needs Netflix when we've got PopcornTime ;) +1 to a question of how we can structure funding opportunities to make sure this work is open. Explicit open access is better than #icanhaspdf access+1xThese are great points. I have tenure, I just made full, so not such an issue for me. It is remarkable how my departmental colleagues are still utterly dismissive of anything outside of the formal print-based peer reviewed mostly commercial system. it does not help that there are so many utterly terrible vampire press journals in education. So I am taking both paths, getting stuff through rigrous peer review process and then putting up pre-prints at Research Gate and sending people to Sci-Hub
- Matt: Planning Naace Keynote, working on Badge The World Updates And setting up the Go2B exchange program badges project for a meeting in Helsinki next week
- Federico: internal discussion about the right way to connect Bestr platform to a LRS, considered read/write permissions and identity reconciliation
- Supporting our first Bestr Webinar, next Friday, targeted to italian universities to onboard on Bestr as Issuers *and* Endorsers
- Julia: Continuing to spread open badges through an after school activity community - FIRST Robotics and doing a presentation with Michigan Department of Ed to technology teachers
Panel Discussion: Evidence in Open Badges
Alan Levine, James Willis, Doug Belshaw, Dan Hickey
Alan Levine recently posted Seeking Evidence of Badge Evidence (http://cogdogblog.com/2016/02/badge-evidence/ ) on the Cogdogblog, featuring some found examples of how evidence links are being used in badges in the wild. Make sure to read this post and dig into the comments. We'll continue the discussion on the community call tomorrow.
Doug's post in reply to questions below: http://dougbelshaw.com/blog/2016/03/09/open-badges-evidence/
- Alan has long history working with Maricopa Community college system and the open education community.
- Currently investigating a digital credentialing project for Creative Commons.
- Made a post on an investigation of badge evidence and threw out some comments to try to investigate what was linked from evidence field of badges that he found in the wild. A call to stir things up and teach about what is going on in this field.
- Not every badge needs evidence, but when they do include evidence, there are open questions about whether the evidence included has value?
- FIRSTBadges - 4 levels of badges, Level 1 Apprentice (tasks are yes/no, low level) to Level 4 Expert (tasks require a portfolio with any type of electronic media - presentation, video, audio, etc). Value of evidence for earning high school credit (eventually - outside of a brick and mortar classroom)
- What type of evidence are issuers collecting and including in badges today?
- In a first foray into badges that were easy to find (found some on linkedin profiles). The examples that jumped out to Alan included some EDUCAUSE badges that had almost useless links in them (just to the ELI website).
- Another badge was for giving a presentation and linked to the schedule of the event. Is that really evidence?
- What do you want to put into the badge as evidence, and moving toward some of the power of portfolios?
- It will definitely be a mixed bag in any survey: There will be badges with good evidence, and badges with poor evidence. https://en.wikipedia.org/wiki/Sturgeon%27s_law
- Someone tweeted an example of a Houston School district where there appeared to be an example of good design and implementation process built around the badging.
- Doug: I've been doing badging for 5 years, and I don't think I've seen _any_ really good uses of evidence.
- An example Don shared for immigrants from Asia coming to Canada and pointing to ePortfolios ?! OR DID I DREAM IT? let me dig...
- Here's an example of a badge that I applied (OBF Badge Application) for with evidence and the evidence is linked out of the badge statement:
- Online adult learning promoter (5 pieces of evidence): https://openbadgepassport.com/en/badges/badge_info/142/52
- Screenshots work well with cases of public speaking/social networking/etc. AND with people, like Don, that usually publishes a lot (so easily aknoledgeable). If a student that never tweets or blogs, posts as an evidence a screenshot, a paranoid Employer could not validate it.
- Use of http://amberlink.org ?+1 will investigate
- Self-promotion alert: we issue very compelling evidence rich badges in the assessment booc that contain all of the badges students earned and each of those badges contain all the work the student did along with the peer discussion, endorsement, and promotion: https://eabooc.appspot.com/badges/expert_evidence?id=6483309370540032
- Alan: What is the evidence we're talking about? In some of these examples, what was linked as evidence, looks more like criteria.
- Rich D: What we've been able to gather so far is evidence from teachers (who create their own evidence of learning or choose their own task from a list of suggestions of how evidence of learning could be generated). Still at an early phase in this work.
- Got some suggestions/feedback/concerns from teachers & unions that they'd not want their EOL to be publicly displayed
- Don: I speculate in my blog about the possibility of individuals ("punters") claiming badges via self-assessment and providing evidence to support it. In the future, endorsements could validate this after the fact. This would reduce cost and actually respects the earner+1 (in fact, that should be encouraged as it is the main way to make badges "learner centred"!)
- Doug: difficulty of transferaility of evidence beyond original context (me: But also, increased need for badges to help person build social capital in new context)
- Bryan M: I think Evidence (or lack thereof) is a "necessity is the mother of all invention" problem. As soon as an external judge of a badge requires there to be evidence - it may change things.
- Alan: ~There's a lot of reluctance to share evidence, because people often feel their evidence is not yet "perfect". What's the incentive for a badge-recipient to put evidence out there? Evidence can be mis-used, there is risk involved. +1 people need to be willing to share v0.1 (or we need to have more granular permissions around evidence)
- John Udell wrote about blogging: It's about narrating the work we do as we do it.+1
- A lot of current publishing ends up "discarding our whole path" -- it's not about the end product being this "show piece"+1
- Dan: You just described two different views of learning: Conventional based on static artifacts, vs newer cultural theories of learning that emphasize participation. Evidence is really evidence of successful participation. This is why I think many badges haven't had evidence in them (because the models are demanding these high level of evidence) .. Newer conceptions of applicable evidence would be things like forum posts. Reflections not on what people know, but of their engagement. Not appreciating these theories of learning (the hegemony of the other approaches and tensions between these approaches) is not nearly acknowledged enough.
- Don: evidence need not be frozen, static, retrospective; can maintain currency of knowledge (the other "currency"). Can also be part of learning portfolios in HE, as students cross thresholds and grow into understanding - emergent learning, that can also be part of CPD after
- What are challenges and barriers to effectively using evidence with badges?
- Doug: Maybe the decision to make evidence optional kind of "loads the deck" in favor of not including evidence in any badges.
- Doug: Sometimes evidence is locked within some LMS, where it's very hard to link to the specific evidence -- permalinks are shaky, etc.
- Julia: Roadblocks from FirstBadges system include people asking "great; where's the certificate?". One of the driving forces of this is to give students high school credit out of the "sit & get" model, and outside of the certified teacher setting.
- Having a difficult time because most of the people who can successfully assess are not certified teachers. (Engineers, etc)
- Some state laws need to change before credit can be awarded for this model, but some progress and some commitments have been made.
- Alan: A lot of evidence means "a lot of stuff to look through"+1
- was it Dan H that said 1st time viewing a badge class: drill, drill, drill 2nd time: drill; 3rd time, accept
- Nate: A lot of evidence means "a lot of stuff to collect"Right, we may also need to roll things up into useful proxies
- Doug: The value of a badge is constructed from all different kinds of things. (-Bryan Mathers et. al.)
- Alan: Issuer/endorser institutional reputation is an important factor of badge value just as evidence can be.
- Doug: We have a utopian vision that people can emerge as trusted issuers even if they're not relying on a extand brand reputation
- What services and capabilities could be solutions to these challenges?
- Rich: Evidence at a neutral site. We want earners/learners to "own" their learning in perpetuity. It shouldn't be bound up in a subscription service. +1 (personal learning locker) How can we make the hosting of that evidence closer to that value? That's an ideal I have, but we're certainly not there yet.
- A very tiny thing: I use pinboard.. it would be helpful to know whether a link will work before we click it.
- oEmbed for media (videos, slideshare, etc)
- Don: ePortfolio, where you can add other evidence around the badge and make it suitable for various rhetorical purposes
- Nate: New vocabulary for describing criteria and evidence beyond just a URL
- Doug: Many of the problems that exist involve locking people into silos. Yes, your badge is portable, but your evidence isn't.
- Nate: endorse badges to connect the relevant evidence to them.
- meaningful endorsements! I have one on LinkedIn for okrafolding ;-)
- Who should hold and control badge evidence? Issuers? Earners?
- James: We've got a lot of work to do
- Dan: Thanks to Alan and Doug for getting this conversation going. There are some reasons the initial rounds of badges didn't embrace this function. We should acknowledge that and point toward major effort to make evidence more useful in the future.
- Alan: Thanks for including this. I got a lot of reading to do
- Doug: Thanks.
- Don: Do we always need evidence?+1 (is everyting about competency badges?) If there is assertion, the badge is valid/valued without evidence the evidence can be the badge itself (self-referential) — an endorsement, is a badge endorsing a badge; doesn't necessarily have new evidence to produce, so the evidence could be the badge itself.
- Don: To what extent are trusted badges useful (indirect) evidence in themselves in other evidence packages, such as ePortfolios?
- Serge: (reversing the original question) Do we need a badge? Should all evidence be linked to badges in order to have any value? Aren't some piece of evidence their own "badge"? Is evidence not connected to a badge lost (or of less value)?
- Serge: shouldn't we make a clear distinction between "behaviourist badges" (there are plenty of them) and "connectivist badges" (much less developed!) — in reference to Stephen Downes? Is that something to bake into metadata (e.g. tags) or something that can be inferred?I'm more on the "connect data to inform inference engines" side, so we can have more freedom and creativity, make people the "connectors."I'm planning on quoting you in the Hangout, partly because today's MOOC topic is mostly about connections (I liked the "connectiviton" as a new concept: " the elementary particule of connectivity" ;-)
- Just to copy/paste from my post, some reasons why evidence in badges currently problematic:
- Organisations are still largely using badges in a ‘command and control’ top-down kind of way+1. In other words, creating one badge that is issued to many different individuals. This makes adding evidence onerous.
- Badges are being issued for relatively low-level things such as participation in workshops and conferences, rather than credentialing more high-stakes knowledge/skills/behaviours.
- People are misusing the criteria field as they are inexperienced (as we are all are, initially) in badge system design. +1 that's why semantic enrichment of this information might be of value (of course we need good editors for badge creation that are assisting in this)
- There’s a lack of understanding about the best ways to deal with the evidence that sits behind badges. Whether due to privacy concerns, fears around cost or compliance, or institutional policies, adding evidence is seen as a burden rather than a gamechanger.
- Rob Bajor: If the evidence is open/accessible at all times, do we risk violating badge-earners privacy? +1 it needs access restriction / "ask for access" Also, we should make the case for working openly a lot more. After all, they're *open* badges... ;):) I thought open referred to the interoperability aspect? Open is a term used in a slippery way. For example, the image used in slidedecks for 'open' is often a door sign effectively saying 'open for business' - which kind of *isn't* what we mean... I agree. The optics aren't clearly defined, nor understood by most badge issuers. (In my opinion) It's the same kind of problem that the whole Open Education movement suffers from.
- @Rob ... some of us are beginning to explore the ethical implications of having educational data "out there" in the wild; potential vulnerabilities, etc., FERPA concerns,+1 +1
- If you're interested in some of the preliminary ethical work, we wrote up this paper: http://ceur-ws.org/Vol-1358/paper6.pdf << Can anyone join this group?
- Rob Bajor: James, I think that the onus is on the assessor/issuer of badges (we use the term "micro-credentials") to ensure rigorous assessment of all badge submissions. QC remains an open/evolving question.
- Agreed, but how do we know about the competence of the assessor / issuer? Trust vs / with power is a powerful duality that can shape (mis-shape?) education in powerful ways
- Shouldn't the evidence be inspected by the badge issuer only? On our platform the badge submission is assessed by assessors (selected by the issuer) and the issuer always has a final say (there's a handoff mechanism).+1 so it is not visible to everybody? the assessment is visible to the assessors/issuers while the evidence is being assessed. The Earner gets a form with comments and scores associated with a rubric that is always visible. The assessment form is attached to the badge along with the original evidence submitted.
- Good points here, though I wonder about the 'narrative' of badge evidence: does it make a compelling point or does the learning data merely float off into the ether and we become data bits? I don't understand what you mean by data bits? Meaning, disconnected data that can be stripped of the learner's agency: the data is out there, so it's mine-able by third parties, and thus the concrete person who earned the badge is removed from the equation...potentially. Security becomes a key concern. There's some work going on around the use of the blockchain. Aside from expensive server-side or even P2P crypto solutions, there really isn't any way around this issue. Correct - but even then, there are some emerging questions with having everything open in a ledger true. definitely a flawed solution since it's going to contain very private information (potentially). Then again, banking information is pretty sensitive too. This is certainly a focus area for us.
- Serge: IMO, the main "evidence" we should be looking for is whether a person is a member of not of a community of practice. "hard core" evidence might be necessary to be recognised by the community, and this could be translated by "endorsement.". I don't think anyone is in a position to say that something does or does not 'count' as evidence for a badge, other than the badge issuer. Whether that has value to other people than the issuer and earner is secondary. We might want to displace the question to: what kind of evidence do we need to make informed decisions? If a "badge" has no evidence, but is endorsed by a large number of members of the community (peer, clients, etc.) then the "evidence" (for the consumer) is the endorsements.
- There are a lot of epistemological questions here: how do we know what we think we know? Does evidence provide the necessary 'blocks' of data to really measure / display / compel what we think (or want to think) we know? EVERYTHING IS A CONSTRUCT.
- Our conversations are always centered around badges as credentials. I believe the greater opportunity for badges is as motivation/encouragement. Is there a need for evidence for the latter? Is there value in giving an "effort" badge? Problematic for growth mindset approaches ;)
- Suggestions from my post:
- Provide appropriate levels of credibility
- Put learners/users at the centre of your system
- Ask employers what they want
- A side question: in case of level badges (bronze/silver/gold) a silver badge could be awarded after a grade from 80 to 90. If a student gets 85 we would like to write that number, 85, in the badge. Could this be an evidence from the Issuer on the badge award?
Agenda: Badge Alliance Community Manager
Devin Lally, our Community Manager has moved on. We'll be filling this position again in the coming weeks. Adjusting the job description for reposting Friday.
Questions: please contact email@example.com
Moving Forward: Topics for the weekly Community Call
This is your community call. Suggestions for topics and presenters are welcome, and Badge Alliance staff will follow up to schedule.
Please add topics for discussion / your name
Accepted topics (by interest):
- Employer engagement: national, regional, local - strategies, case studies
- Success Stories, examples, and case studies (OpenBadging in credentialing & workforce devlelopment
- Defining learning pathways with badge endorsement
- Strategies for integration with new workforce initiatives of WIOA statute
- Open Badge Services: what services could we built on top of Open Badges?
- Scenarios for the future
- Global activities: where are things happening and who's doing them
Contribute your ideas! Put a +1 next to the topics that you would like to discuss on this call. Those topics with the most +1 will be hosted.
Catch up from 2015/2016
A listing of the community calls from 2015 will soon be consolidated on openbadges.org, but until then, here are the recent records.
Community Call: 2 March 2016
Community Call: 24 February 2016
Community Call: 17 February 2016
Community Call: 10 February 2016
Community Call: 3 February 2016
Community Call: 27 January 2016
Community Call: 20 January 2016
Community Call: 13 January 2016
Community Call: 6 January 2016
Community Call: December 16 2015:
Community Call: December 2 2015:
Community Call: November 25 2015:
Canceled for the American Thanksgiving Holiday
Community Call: November 18 2015:
Community Call: November 11 2015:
Community Call: November 4 2015:
Community Call: October 28 2015:
Community Call: October 21 2015:
Community Call: October 14 2015:
Community Call: October 7 2015:
Community Call: September 30 2015:
Community Call: September 23 2015:
Community Call: September 16 2015:
Community Call: September 9 2015:
Community Call: September 2 2015:
Community Call: August 26 2015:
Reading List/Additional notes for the community
Please add what you've been reading below. We'll soon be staffed up to curate this list more regularly.
Upcoming conferences and events
Let us know where you're going to be, especially if you're giving - or attending - a badges presentation!
OLC Innovate: Innovations in Blended and Online Learning: New Orleans -
Carey Hamburg: "has sessions on Badges - and good excuse to visit New Orleans"
AAEEBL Midwest Regional at Notre Dame: May 12-13
"The Association for Authentic, Experiential and Evidence-Based Learning"
Badges Summit pre-ISTE Conference Denver, CO: June 24 - Aurora Public Schools
Registration Open Now. $100 earlybird
Keynotes: Doug Belshaw, Kylie Peppler
AAEEBL Annual Conference 2016: August 1 - 4, 2016
"Beyond the Box: Liberating Pedagogical Creativity with ePortfolios (Innovations in Learning, Assessment, Endorsement of Learning, and Career Building)"
ePIC 2016, Bologna, Italy: October 27-29
the 14th conference on ePortfolios, Open Badges, Personal Ledgers, Identities, Trust, Blockchains
Badge issuing platform options: https://www.badgealliance.org/badge-issuing-platforms/
Open Badges Speakers List: http://www.badgealliance.org/speakers/ (Update coming at the end of the month)
If you want to be on the Open Badges Speakers List, located off the Badge Alliance website, please complete this form: https://docs.google.com/a/badgealliance.org/forms/d/1YTxiFqdUnoXVOTsHcyoE1Q0blQWzPeTUboTEcaqKJ4I/viewform
Contact Badge Alliance staff directly at firstname.lastname@example.org
Thank you for joining us!