Towards aiming to bridge the difficult gap between research and policy makers: "audiovisual data" - such as film can be - a boundary object, to not only translate research into another language, but also a further step into new ways of collaboration between science, film and policy makers.
Preliminary film screening of "Inequality and Conflict" in Geneva with SDC experts from all over the world. The purpose was to get feedback for the final editing of the synthesis film.
Two short videos from Guatemala, Nigeria and Switzerland.
Do we value fairtrade chocolate more through Virtual Reality experiences? Planned experiment with VR-360 videos on consumer behaviour, with the University Osnabrück forthcoming.
Design Session for the video production of the transdisciplinary tool "Three Types of Knowledge", a project with the td.net and tdlab ETH Zurich.
What audiovisual data bias do we have in todays AI stories? How can we gain transparency and trust at the borderline between bot and human? We strongly need storytelling for a positive future with „Extended Intelligence“. Fintech Hackathon Zurich
My keynote on "Videos as another language" in Worms, Germany. We need to fundamentally change on how we reflect, think and produce videos in science and teaching. It's just a different language, and we need to understand how to work with it. > go to presentation slides
Being a mentor at the Science Film Hackathon in Basel was a blast. Looking forward to the Zurich event!
Final micro script changes of the voice-over for our VR-360 experience about the method of "Remote Sensing". Co-Design project of the Centre for Innovation with Dr. Joris Timmermans, Institute of Environmental Studies, Leiden University. Our talented voice-over speaker is Assistant Professor Paul Behrens, Energy and Environmental Change. He certainly shares some vocal genetics with David Attenborough!
Around 25 terabytes of film material in the editing process. The research documentary is taking shape.
Synthesis meeting and further postproduction planning with scholars from the University of Lausanne, ETH Zurich and University of Geneva at SNF in Bern.
We've designed a massive role play game about the future, climate change, robopocalypse, immortality and space travel from scratch. Mitigation, adaptation, investment in AI robots or basic research? Dependent on the choices of the different countries, the future of our planet drastically changes over the next 100 years. Facilitated at Brave New World conference in Leiden.
Intense and deeply insightful week with the Gender Dimension team of the University of Geneva, colleagues from Indonesia and the local team in Nigeria for a research documentary synthesis project.
A small Nigerian "fairytale": On the road with local colleagues, hunting for images about inequality. First meeting with the chief of Durumi 1 - he accepts and sends his (handsome) prince with us. A little later, meeting with the chief of Durumi 5 - he accepts and sends another prince to join our journey. Stuffed in a car with two Nigerian princes sharing the front seat, visiting a Internally Deplaced Person Camp of refugees from the Northern states. These images will stay in my head for a while.
Field notes: Nigeria is officially a "post-conflict" state. However, the trip to Nigeria in November was our second, as we've been there in July already for only two days. One week before we arrived in Abuja, there was another genocide in Jos, excatly the place where we've planned to go. So much for post-conflict status.
We're experiencing a turmoil, a collective global crisis of mistrust in the digital world with nudging, uncertainty of data policy,
#EvilCorporations, facial recognition. #Deepfakes add to the prevalent #FakeNews #AlternativeFacts. Presentation 'The Future of Trust in Images' at the multidisciplinary Brave New World Conference, Leiden Netherlands. A research
video on these challenging topic will follow soon.
Have a look at the ongoing course with students from the Leiden University, TUDelt and Erasmus Rotterdam University on critical Audiovisual data in the digital world
The ongoing fight for the rights of ethnic minorities. Mayan guerilla movement, political and economic inqualities, state reactions: On the road for the research film and VR 360-Video experience in Guatemala, with the fantastic team of the Prof. Ricardo Saenz de Tejada, Prof. Marta Juana López and students of the USAC. Project of the ETH Zurich, under the umbrella of the 'Research for Development' program of the Swiss National Science Foundation.
Many see intelligent robots in the future as evil – taking over our livelihoods and eventually even taking our lives. Can it be the sci-fi stories that make us think this way? What do these stories, especially movies, tell us and make us believe?
What do you do over the weekend? The professional dancer, choreographer and lecturer Sarah Keusch and me took some time and initiative to follow our passion and create a short dance performance music video with some amazing dancers and kind helpers – after almost ten years again!
As part of the full-lenght research documentary on social conflicts, we've put our researchers in front of the camera. They all did a fantastic job! Filmstills (not colour graded), from left top on; Nils Rosemann (DEZA), Lars-Erik Cederman (ETH Zurich), Steve Reichert (Expert in collaboration with University of Lausanne); Elizabeth Pruegl (University of Geneva); Christelle Rigual (University of Geneva).
A Novel Approach Towards Anatomy Learning! Whereas other MR-productions for anatomy focus on 3D-visualization only, we assume that the involvement of the whole body of the user in the experience leads to more playful learning, and can be particularly helpful for concepts difficult to understand such as the movement dynamics of the lower feet. Moreover, the pure representation of a 3D-model in MR is consider an instance of a classical media fallacy of the affordances (see image comparison of anatomy learning in 1935 and the MR-app from 2015). While such pure visualizations add a spatial factor to the experience of traditional moving images, they do not play towards the strengths of MR, as they only marginally interact with the body of the learners.
Through recent advanced technological development, media formats such as VR360-videos for Virtual
Reality (VR) seem promising and enter the educational sector rapidly. Although VR360-videos resemble
traditional videography in some of their affordances, innovative storytelling, playful elements and
strategies for directing the gaze-attention of the recipient are genuinely different and still need to be
explored. In fact, standard VR360-videos are a rather passive medium besides the option to turn the
head. We at the Centre for Innovation at Leiden University believe, that a majority of educational topics could benefit from more interaction and playful elements in VR360. Hence, we’re currently developing several projects with playful interactivity in VR in which we try to overcome the passiveness. You can find the MIT presentation here
Newspaper article on the keynote:
A new collection of some critical statements on videos in higher education. The expert interviews were conducted as part of an earlier research project: "Media Design for Videos in Higher Education".
1. To Tease Somebody – Advertised Educational Intro vs. Lecture Videos: a quantiative study on the siginificant differences between advertisment videos and actual lecture videos.
2. Framing the Talking Head Challenges of Academic Broadcast Studios: on the challenges of video performance for academics.
Design session for a VR experiment on sustainable chocolate in Ghana, University Osnabrück.
Presentation of the Manifesto for Videos in Higher Education, @Utrecht University; LERU conference.
Presentation and Workshop with scientists, REASON program, Ludwig-Maximillians Universität Munich.
Teaching session with history and anthropology fellows and students of the Universidad San Carlos, Guatemala on the tricky situation of expert interviews with camera for research documentaries. Half-structured interview meets camera documentary interview style.
What challenges does a lecturer face in front of the camera? Embodiment theory meets studio practice.
Excited to be at the AWE USA, Santa Clara, California. Takeaway paraphrased: "You only need a pen and paper [and a strong character] for good storytelling" Keynote Jason Katz from Pixar.
My climate finance expert/ political economist/ speculative futurist/ lifetime partner published his first sci-fi speculative design novel based on todays technologies (including crazy citations of inspiration sources).
The main character, Daniel, an fairly aged Professor of Evolution-Philosophy takes us on a phantasy-full journey of our lives in, waking up from a coma in 2051. Topics include: liquiddemocracy; mixedreality; limitstowealth; privacy; AI; addiction; terrorism; hacking; anarchy; frogconservation and many more...
Workshop at the Festival of Free Speech: 'When Mixed Reality meets Deep Fake: 3rd Millennium Challenges for Audiovisual Data in Journalism', Beeld en Geluid.
Abstract: On the one hand, we have new promising technologies such as mixed reality (virtual reality, augmented reality and anything in between) in journalism, and indeed, various news platforms such as The Guardian, NYT or BBC increasingly produce mixed reality formats, currently mainly VR-360 videos. The immersion of mixed reality storytelling seems promising to bring the story to the recipients and therefore let them experience current issues or conflicts closer than ever before. On the other hand, we have the latest development of deep fake videos. Already today artificial intelligence can generate video-realistic fakes, increasing the strain to detect forgery on truth-committed organizations such as the World Press Photo Award. Now imagine how the extreme immersion of mixed reality could affect the recipients in the near future, when it meets deep fake technology.
»We never see the same thing when we also hear;
we don‘t hearthe same thing when we see as well.«
Michel Chion ›The Voice in the Cinema‹