The Columbia-Stanford Brown Institute For Media Innovation Announces its 2018 Magic Grants
The Brown Institute for Media Innovation, a collaboration between Columbia Journalism School and Stanford University’s School of Engineering, announced today the 2018 Magic Grant Winners. This year’s winning proposals reflect the institute’s mission of building new technologies that shift the way we find and tell stories in the public interest.
“Each project addresses an important contemporary issue, be it political, cultural, or technical,” said Mark Hansen, director of Columbia Journalism’s Brown Institute. “We’re excited to support a diverse group of projects including a database that tracks deaths stemming from U.S. deportations. Another will conduct algorithmic audits of forensic DNA software used for criminal prosecution. There’s also a project that pairs a documentary filmmaker and a theater director to examine African-American voter suppression during the 2016 Presidential election.”
The Brown Institute awards close to $1M in funding every year to foster new tools and modes of expression, and to create stories that escape the bounds of page and screen. The institute is committed to radical experimentation with the potential to define new priorities and practices for both engineering and journalism.
2018-2019 Magic Grants
Lineage: Automatic Art + Design Context for Fashion Reporters. Historically, fashion stories were a specialized type of consumer reporting focused on innovation and trends in clothing, accessories and beauty products. Today, social media and online retail allow fashion designers and marketers direct communication with consumers, putting fashion reporting in somewhat of a crossroad. Lineage is a research tool that promotes better understanding of the cultural context and history of contemporary fashion. It uses the publicly available databases of art and design institutions such as the Met and its Costume Institute. When a reporter uploads a new fashion image, Lineage will display similar items from its database: clothing, craft, furniture, architecture, and visual arts. The tool, to be designed by journalist and data scientist Noya Kohavi, is not meant to find identical images but rather images that evoke the same visual language in a more playful and serendipitous way, like a reverse-engineered mood board that tells the story of the item or collection the reporter is covering.
Artistic Vision: Providing Context for Capture-Time Decisions. The crucial footage for breaking news reports often comes from eye witnesses/citizen journalists using their smartphones. While these videos often do not meet the quality standards set by news organizations, there is a hesitation to perform much post-processing to improve the content — in the spirit of being accurate and truthful. With their Magic Grant, two computer scientists, Jane E and Ohad Fried, will help people capture higher quality content and contribute more impactful, immediate, on-scene documentation of breaking events. E and Fried will create tools that overlay directly on the screen of a traditional camera, dynamically augmenting the current view of a scene with information that will help people make better photo capture decisions. “Our hope is that such interfaces will empower users to be more intentional about their storytelling and artistic decisions while taking photos.”
Democracy Fighters, a Living Archive. Since 2000, ninety-two journalists have been killed in Mexico. Contrary to popular belief, these reporters did not die as the result of generalized violence. Instead, they were targeted. Their deaths cannot be understood without reading and listening to their work. Consequently, the worth of their journalism — and the risks they undertook — cannot be fully comprehended without understanding the rich context and history of the places where they lived and reported, the social forces they faced, and the stories they told. Alejandra Ibarra Chaoul, a journalist, and Rigel Jarabo, a student in urban planning, want to give these reporters’ work a home and provide that context so that “through this repository, their fight for democracy will continue.”
Audiovisual Analysis of 10 Years of TV News. Ten years of U.S. TV News — Since 2009, the Internet Archive has been actively curating a collection of news broadcasts from across the country, assembling over 200,000 hours of video. Computer scientists, Will Crichton and Haotian Zhang, will perform an in-depth longitudinal study of this video collection, scanning for audio and visual trends. How has coverage of different topics changed over the years? How often do women get cut off in conversation versus men? What is the relationship between still images and subject? How does clothing and fashion differ across networks and shows? This project will tackle these and many other difficult questions, demonstrating the new potential for large-scale video analysis. This Magic Grant will build on a previous grant from Brown, also led by Crichton, called Esper. That project created an open-source software infrastructure that helped journalists and researchers scale their investigations, to analyze, visualize and query extremely large video collections.
When Deportation is a Death Sentence: An Investigative Database. Sarah Stillman, staff writer at The New Yorker, will lead a team to build the first-ever searchable database of deaths-by-deportation, in a manner that is empirically rigorous, narratively engaging and visually stunning. The team will merge cutting-edge data journalism (pursued alongside foreign correspondence in refugee camps, migrant shelters, mortuaries) with technological innovation (focusing on the aesthetic power of the mobile experience) to build a practical but elegant database that turns their massive spreadsheet into an unshakable story. The team includes the powerful data visualization expertise of Giorgia Lupi, co-founder of Accurat, a data-driven research and design firm. They will make their findings and ongoing investigation accessible through a website that amplifies the very best of what Lupi calls “data humanism.” In Stillman’s words, “Absent this new effort to bring these data to light, the stories will remain buried, unspoken, and unaccounted-for in the public record.”
NeverEnding 360: Ensuring Story Coherence and Immersion in 360 Videos. News organizations like The New York Times and The Guardian have experimented with fast-paced, serial production schedules for 360-degree videos, hoping to prove out the medium. While 360 videos offer viewers more freedom to explore scenes in a story, that freedom also poses an added challenge to directors and creators. Because users can be looking anywhere at any time, they might be looking in the wrong direction while important events or actions in a story take place, outside the user’s field of view. By contrast, Virtual Reality environments can address this problem by controlling the animation of objects, perhaps having a scene pause or loop until the user is looking in the right direction. With her Magic Grant, computer scientist Sean Liu will consider how to adapt these strategies to 360 videos, providing better storytelling without compromising the immersive feeling of these videos.
Decoding Differences in Forensic DNA Software. Imagine testing the fingernail scrapings of a murder victim to determine if a suspect could be the killer, only to have one DNA interpretation software program incriminate the suspect and a different program absolve them. Such a scenario played out two years ago in the widely-publicized murder trial of Oral Nicholas Hillary, raising questions that the criminal justice system still cannot answer: why, when, and by how much do these programs differ from one another? To answer these questions, this Magic Grant assembles a multi-disciplinary team — Jeanna Matthews is a computer scientist; Nathan Adams, a DNA investigations specialist; Jessica Goldthwaite with The Legal Aid Society; Dan Krane, a biologist; Surya Mattu, a journalist; and David Madigan, a statistician. This Magic Grant project will systematically compare forensic DNA software, moving the story beyond anecdotal examples to a systematic investigative strategy. In the process, they will explore important issues of algorithmic transparency, and the role of complex software systems in the criminal justice system and beyond.
Paraframe. Stories come in many forms, and in a wide range of detail — from casual anecdotes told among friends, to epic Hollywood blockbusters, heavily engineered and rendered in vivid high-definition. But regardless of how they are told, great stories do not simply appear fully formed in the mind; they are inspired by the work of others, crafted with familiar tools, and refined through iteration. The Magic Grant team of computer scientists, Abe Davis and Mackenzie Leake, will provide users with tools that focus on the construction of a narrative (specifically, through the writing of a script or the posing of rough character sketches) and use algorithms to search the Internet for visuals that can be repurposed or remixed to fit that narrative. In doing so, their work will offer an accessible way for untrained users to learn from and build on the work of experts.
Hacking Voter Suppression. Barack Obama’s two Presidential campaigns were defined in part by the black voters they brought to the polls. In both 2008 and 2012, African-American women voted at a higher rate than any other demographic group in the country. But the latest analyses show that in 2016, African-Americans voted at a lower rate than any other group. Magic Grantees June Cross, a documentary filmmaker, and Charlotte Brathwaite, a theater director, will explore how foreign interference, gerrymandering and domestic legal challenges like including voter ID laws combined to suppress the black vote in 2016. They will use big data to inform shoe leather reporting, with the results presented as projected data, pre-recorded audio interviews and some re-enacted interviews in a theatrical setting. The team will include historical video archives and develop a production design for five three-to-five-minute videos. Their aim is to educate the larger African-American community to the impact voter suppression campaigns waged on social media, in the courts, in state legislatures and in the election of the President.
BigLocal News (Bi-Coastal). State patrols stop and search drivers in every state, but until recently it has been nearly impossible to understand what they’ve been doing — and whether these searches discriminate against certain drivers. The data was scattered across jurisdictions, public but not online, and in a dizzying variety of formats. In 2014, Cheryl Phillips began the Stanford Open Policing Project to provide open, ongoing and consistent access to police stop data in 31 states, and created a new statistical test for discrimination. This is just one example of how sharing local data can improve local journalism. Phillips — together with Columbia Journalism’s Jonathan Stray, Stanford Electrical Engineering PhD student Irena Fischer-Hwang, and Erin Riglin, a Columbia Journalism dual-degree M.S. student — was awarded a Magic Grant to build on this success, creating a pipeline that will enable more local accountability journalism and boost the likelihood of big policy impact. The team will collect, clean, archive and distribute data that can be used to tell important journalistic stories. Their work will also extend Columbia Journalism’s Workbench, a platform that facilitates data journalism modules for non-coders and helps the analysis of local data broadly available to even novice data journalists.
Learning to Engage in Conversations to Train AI Systems. People are interacting with artificial intelligence (AI) systems more every day. AI systems play roles in call centers, mental health support, and workplace team structures. Most AI systems to date, however, have focused entirely on performance and rarely, if at all, on social interactions with people. Success requires learning quickly how to interact with people in the real world. Stanford computer scientists, Ranjay Krishna and Apoorva Dornadula, were awarded a Magic Grant to create a conversational AI agent on Instagram, where it will learn to ask engaging questions of people about the photos they upload. Its goal will be to simultaneously learn new facts about the visual world by asking questions and learn how to interact with people around their photos in order to expand its knowledge of those concepts.
Charleston Reconstructed (Bi-Coastal). Particularly in the American South, historical memory is distorted by outdated structures in public spaces. Antebellum and Confederate era monuments celebrate the oppressive legacy of white men and exclude the contributions of women and people of color to American society, complicating claims to equality in the present. White supremacists gather around them, local governments fight over whether to remove them, and activists tear them down. It’s a slow-moving process toward creating a physical space that reflects more current ideas about the past and present. With a seed grant, Columbia documentary journalism student, Robert Tokanel and Stanford undergraduates Kyle Qian, Khoi Le and Hope Schroeder, will help audiences imagine a powerful new reality. The team will work toward digitally transforming public spaces in Charleston, South Carolina, using narrative film techniques and augmented reality to flip the power structures of the past, exposing users to a range of perspectives about the value of monuments as they currently stand.
The institute was established in 2012 with a generous endowment gift from longtime Cosmopolitan magazine editor and author Helen Gurley Brown. It is inspired by the memory of Ms. Brown’s late husband, David Brown, a graduate of both Stanford University and the Columbia School of Journalism. David Brown, who along with partners Richard Zanuck and Steven Spielberg created such classic American films as Driving Miss Daisy, The Verdict and Jaws, was also a former journalist, publisher and, late in his career, a stage producer whose credits included the musicals Sweet Smell of Success and Dirty Rotten Scoundrels.
David and Helen Gurley Brown believed that magic happens when innovative technology is combined with great content and talented people are given the opportunity to explore and create new ways to inform and entertain. The Brown Institute awards fellowships, grants and scholarships, and designs public events and novel educational experiences in digital storytelling.
This year the Magic Grants are also supported through a longstanding partnership with PBS FRONTLINE.
About Columbia Journalism School
For more than a century, the school has been preparing journalists in programs that stress academic rigor, ethics, journalistic inquiry and professional practice. Founded with a gift from Joseph Pulitzer, the school opened its doors in 1912 and offers Master of Science, Master of Arts, Master of Science in Data Journalism, a joint Master of Science degree in Computer Science and Journalism, and a Doctor of Philosophy in Communications. It houses the Columbia Journalism Review, the Brown Institute for Media Innovation, The Tow Center for Digital Journalism, The Ira A. Lipman Center for Journalism and Civil and Human Rights and the Dart Center for Journalism and Trauma. The school also administers many of the leading journalism awards, including the Alfred I. DuPont-Columbia University Awards, the Maria Moors Cabot Prizes, the John Chancellor Award, the John B. Oakes Award for Distinguished Environmental Journalism, Dart Awards for Excellence in Coverage of Trauma, Paul Tobenkin Memorial Award, and the Mike Berger Awards. journalism.columbia.edu
About the Stanford University School of Engineering
Stanford Engineering has been at the forefront of innovation for nearly a century, creating pivotal technologies that have transformed the worlds of information technology, communications, medicine, energy, business and beyond. The school’s faculty, students and alumni have established thousands of companies and laid the technological and business foundations for Silicon Valley. Today, the school continues to seek solutions to important global problems and educate leaders who will make the world a better place. engineering.stanford.edu