KUKA robotics in an encounter with the Bunraku puppetry: interactions between entities of distinct ‘worlds – Stepan Laštuvka

Self-supplied. Interaction between Madama Butterfly puppet and the large Kuka robot.

December 2023

The overarching theme in which the ELRAT group is engaged in the first half of 2023-2024 is interaction; specifically, between KUKA robotics and puppetry as well as other entities. In the first sprint event of this year, we explored how a puppet named Madama Butterfly interacts with two KUKA robotic arms of distinct sizes. More specifically, the puppet and the way it is puppeteered is based on the Ningyo Johruri Bunraku theatre, which in roughly 1600 established a new artistic style combining puppetry, instrumental accompaniment and singing (UNESCO n.d.). Nowadays, the Bunraku technique is enlisted in Unesco’s Intangible Cultural Heritage of Humanity (UNESCO n.d.). KUKA Robotics, on the other hand, is an international automation corporation based in Germany, providing technologies such as “robots and cells” and “fully automated systems” in various contemporary markets (Kuka n.d.).

In this event, it was, therefore, two entities from distinct social and cultural backgrounds with correspondingly unique features that were situated to interact with each other. Moreover, since the Bunraku technique requires three puppeteers and one life-sized puppet, the puppeteers, Tim Hammer, Suze van Miltenburg and Joris de Jong, were invited to perform with the puppet Madama Butterfly and respond to the two present Kuka robots. Rick van Dugteren joined as a ‘puppeteer’ of the robots and took the position behind a laptop with a remote control and code giving instructions to them. In this composition, the participants then engaged in an exploratory performance to raise new questions and insights concerning interaction between the present performers.

The manner of interaction between the puppet and the robot was brought up in a discussion that took place in response to the performance, offering a further exchange between distinct observations, ideas or questions. An idea of equality between a puppet and the puppeteer as conceived in the tradition of Bunraku offered a point of departure. In particular, equality concerns here the manner of performance between the puppet and the puppeteer and how that directs attention of the audience as a result. Moreover, the contrast between the two KUKA’s of different sizes offered room for a comparative reflection. In this light, the matters of scale, time/pace, movement and visual characteristics became the key concerns. The puppet Madama Butterfly and the KUKA arms carry unique and contrasting characteristics on these levels. Furthermore, the two robotic arms also differ in scale, thereby, the puppet, in interaction with either one of them conveyed a different expression as well. For example, the distinct expressive quality of movement between the entities stimulated questions concerning temporality.

Similarly, the difference in scale between the robots invited questions about how the visual features of the entities correspond to specific conventions. In particular, the smaller KUKA, in relation to the puppet, was discussed as expressing the conventional position of a property. Whereas, the larger Kuka had been seen as creating a ‘world’ constituting an environment that carries particular rules to which the puppet becomes forced to respond. In this way, in light of the starting point concerning equality, it had been redirected towards that between the puppet and the two distinct robotic arms. In particular, the difference in size became recognized as the key denominator, distinguishing between a distinct expression and its narrative potential.

In summary, the performance and subsequent discussion put forth a number of points concerning the manner of interaction between visually distinct entities that relate to specific artistic traditions, as well as social and cultural contexts. In this way, the event offered a starting point and a reference for upcoming sprints as well as the overarching concern of interaction between robotics, humans and other entities in specific social contexts.
References 

UNESCO. n.d. “Ningyo Johruri Bunraku puppet theatre.” Accessed September 19, 2023.  https://ich.unesco.org/en/RL/ningyo-johruri-bunraku-puppet-theatre-00064

KUKA. n.d. “About KUKA.” Accessed September 19, 2023. https://www.kuka.com/en-be/company/about-kuka.