"Evaluation" Working Group
Yesterday afternoon about 40 participants of the Berkman@10 conference met up to workshop a proposed WGBH transmedia TV show / online game. WGBH Project Director Blyth Lord set the scene with an overview of the project’s goals:

The series will show kids how to think more deeply and creatively about the world they live in, and to make choices based on what they discover.
We have three curricular objectives:

  1. To develop in children an understanding of systems and the pathways to environmental sustainability
  2. To model and encourage positive attitudes and scientific inquiry skills
  3. To connect children to nature

With that set of goals in mind, the workshop broke up into small teams to tackle the project’s big questions. Our brainstorms after the break…

(Big props to Shenja van der Graaf and all the conference organizers at Berkman; Gary Goldberger of Fablevision; Josh Diaz, Eitan Glinert, Marleigh Norton, Peter Rauch, Doris Rusch, and Jaroslav Svelch of GAMBIT Game Labs; Sam Gilbert of the Goodplay Project; and especially Blyth Lord and Marisa Wolsky of WGBH for making this workshop possible!)

- Gene Koo

"Affect" Working Group

Engaging players with nature

How to resolve the apparent conflict between a TV show / video game (indoors) and a regard for nature (outdoors)?

  • Technology assumed: Web + phone cameras
  • Gameplay:
    • grow a plant + pictures, profile that build up a virtual forest within the game
    • offer a challenge the entire group tries to achieve (once the forest is successfully grown)
    • looking at clouds — taking pictures, comments
    • adopt a tree
    • what’s in your fridge?
      • what’s in there, where did it come from, what was the env. impact to get there
    • what’s in your school lunch?
    • community maps
      • where does your water come from
      • where are your parks
      • geocaching
  • Organized events

Evaluation

How will we know what kids have learned, both in terms of scientific understanding but also in terms of their regard for nature?

  • problem of unexpected player behavior
  • a need for qualitative and quantitative evaluation
  • passive observation of how players engage in game
    • length of play session, what were they doing, etc.
  • playtesting & player observation
  • What is it that you’re trying to figure out that they learned
    • Systems understanding of the game
      • Regardless of their actual play (e.g. destroying stuff)
      • Cheat codes as a way to demonstrate how the game works
        • (Breaking rules as a way to demonstrate knowledge of rules)
      • ONLY “saving” the ecosystem doesn’t show knowledge of system
        • Maybe killing everything is perhaps better for understanding how system works
      • Show impact of system, not inculcate environmentalism
      • A double SimCity setting in which you build your own and sabotage them, but if you do that you might destroy yourself…
  • Parent-accessible data from game backend
    • Show parents why game beneficial to kids’ learning
    • Caveat: privacy concerns

Affect

This game takes on the task of not just teaching understanding of a complex system (e.g. the water cycle within an ecosystem), but tries to lead players to care about them. Can a game accomplish that, and how?

  • Emotional hook for the story
  • Entry point: the emotional point, or the cognitive engagement?
  • Style: less photorealistic for kids to accept as “real”
  • How to teach how systems are interconnected?
  • What’s the overall goal?
    • Not to create environmentalists: Good vs. Bad
    • But maybe to be Very Good or Very Bad?
      • ,.. and hard to achieve either
      • This encourages reflection & understanding
      • Systems are complex : just turning off a power plant doesn’t solve the problem
  • Interlinking of micro and macrosystems so that levels are interconnected
    • How solving one game affects other games or meta-game
    • Choices affect your character, character evolution, “points”
  • Not a win/lose game, but to consider outcomes
    • Looking at interaction between two decisions (food fertilizer, clear water)
  • Moral decisions require caring, anger
  • A need for optimism to foster a sense of agency
  • How to convey that these actions have consequences?
    • A very difficult way of thinking
    • But this gives you a sense of agency

Motivation

What will lead viewers of the TV show to play the game?

  • Look to successful commercial games’ motivational hooks
  • Narrative won’t be enough to pull players into the game
  • Maybe the characters are what involve players
  • While being careful around representation

Transmedia

What special capabilities are possible because this project will bridge across media (TV, Web, game)

  • What platforms are available, and how games can relate to them
  • Assume for accessibility, stick to Flash-based Web games
  • TV show encourages engaging in game and vice versa (positive feedback loops)
  • Game comprises mini-games, each playing with a system
    • As every episode airs, a parallel game is published on the Website
    • Play as the character from the show to try different outcomes (e.g. destroy rather than fix the system)
  • How can TV show help gameplay
    • Cheat codes in the show
    • Or solution sets
  • Have winning the game expose episode content
    • Outtakes?
    • Trailer for next show

Game of Games

  • Kids are increasingly good at deconstructing systems
  • Thus mini-games should tie into a larger systems that interact
  • So not self-evident that pushing this will affect that

FUNNNNNNNN

Business Models

How will the project be financially sustainable over time?

  • Initial funding
  • Commercial partnerships?
    • Maybe some cross-branding: as family-friendly
  • Advertising tie-ins?
    • Underwriting
    • Product placements
  • Make an expensive awesome game that provides the footage for the show: machinima
    • See Japan’s shows
    • Actual in-game footage