Multimodality is an innovative approach to representation, communication and interaction which looks beyond language to investigate the multitude of ways we communicate: through images, sound and music to gestures, body posture and the use of space.
The Routledge Handbook of Multimodal Analysis, Second Edition provides a comprehensive ‘research tool kit’ for multimodal analysis, with thirty-four chapters written by leading figures in the field on a wide range of theoretical and methodological issues. This new edition includes twelve new chapters on theoretical and mathodological developments, and multimodal research on digitally mediated texts and interaction.
The Handbook includes chapters on key themes within multimodality such as technology, culture, notions of identity, social justice and power, and macro issues such as literacy policy. Taking a broad look at multimodality, the contributors engage with how a variety of other theoretical approaches have looked at multimodal communication and representation, including visual studies, anthropology, conversation analysis, socio-cultural theory, sociolinguistics, new literacy studies, multimodal corpora studies, critical discourse, semiotics and eye-tracking.
Detailed multimodal analysis case studies are also included, along with an extensive updated glossary of key terms, to support those new to multimodality and to allow those already engaged in multimodal research to explore the fundamentals further.
The Routledge Handbook of Multimodal Analysis is essential reading for undergraduate and postgraduate students as well as researchers involved in the study of multimodal communication.
Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodality 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Part 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape: From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21.Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimodal Case Studies 24. Practical function and meaning: a case study of Ikea tables 25. The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 27. The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality – the case of film and video 30. Music and designed sound 31. Space and communication in exhibitions: Unravelling the nexus 32. Image in the Multimodal Ensemble: Children’s Drawing 33. Online newspapers: Structure and layout 34.What next for multimodality?
Biography
Carey Jewitt is Professor of Technology and Learning at University College London, Institute of Education.
Praise for the first edition:
'The Routledge Handbook of Multimodal Analysis provides much tasty food for thought and shows that useful tools and promising approaches are being developed. But more than anything else it makes clear the need for further subdivision of work, for systematic rigour, and for many, many more corpus-based case studies.'
Charles Forceville, Journal of Pragmatics
