Creative Media Alliance, Amazon Science
2017-2018, 2020-2022

Alexa Prize Taskbot Challenge

Audiovisual Live Production Multi-Camera
The Alexa Prize Challenge required building a full production studio on-site, including a primary capture stage, control room, video village, and remote contributor stations. Punch Drunk provided the technical infrastructure, while CMA led cinematography and creative in collaboration with the Amazon Science team.

Overview

"Launched in 2021, the Alexa Prize TaskBot Challenge is a competition for university students to develop bots that could assist customers in completing cooking or do-it-yourself home improvement tasks that required multiple steps and decisions. The teams’ goal: build taskbots that assist customers in multi-step tasks, and adapt those instructions based on the resources and tools available to the customer. Customers interacted with one of ten taskbots and rated the interaction—on a scale from 1 to 5—on how helpful that taskbot was with the task."

(Overview summary from Amazon Science on YouTube, the source of the video embedded above)

Scope of work

CMA led the overall production – crew, cinematography, lighting, and direction – while Punch Drunk delivered the technical backbone: 

  • Built the multi-camera workflow with multiple layers of recording redundancy
  • Provided live switching capabilities so a PGM line cut could expedite the post-production process
  • Captured all editorial decisions from live switching in a non-destructive manner so that all live edits could be seen in a post-production workflow immediately after filming, further expanding the editing capabilities and reducing delivery time
  • Provided technical systems engineering for live capture, audio, recording, intercom, and file management

The project evolved from its origins in 2017 into what is now the Alexa Prize TaskBot Challenge.

Press: WIRED

Inside the Alexa Prize

Amazon is in a pitched battle with its rivals to bring truly conversational AI into our homes. So the company is staging a contest—a mad dash toward an outlandish goal: Cook up a bot capable of small talk.

The first interactor—a muscular man in his fifties with a shaved head and a black V-neck sweater—walks into a conference room and sits in a low-slung blue armchair before a phalanx of video cameras and studio lights. He’s brightly lit. The rest of the room is totally dark. He gazes at a black, hockey-­puck-shaped object—an Amazon Echo—on a small table in front of him. “Alexa,” he says, “let’s chat.”

James Vlahos, WIRED

Press: Amazon Science

Three top performers emerge in inaugural Alexa Prize TaskBot Challenge—the first conversational AI challenge to incorporate multimodal (voice and vision) customer experiences.

Amazon Science

Screenshot from Alexa Prize Taskbot Challenge Video
Screenshot from Alexa Prize Taskbot Challenge Video
Screenshot from Alexa Prize Taskbot Challenge Video
Screenshot from Alexa Prize Taskbot Challenge Video
Screenshot from Alexa Prize Taskbot Challenge Video
Screenshot from Alexa Prize Taskbot Challenge Video
Wired magazine - Inside the Alexa Prize article header
Wired magazine - BTS photo showing the team in 2018
Initial whiteboard sketch from 2017
Initial zone distribution whiteboard sketch from 2017
Control room behind the scenes 2018
Control room behind the scenes 2022