ideas

From
Lim, F.V. (2002) The Analysis of Language and Visual Images—An Integrative Multisemiotic Approach. Unpublished masters thesis. National University of Singapore.Analysis of a Multimodal Text– Picture Book (Dominic Duck Goes to School)

Theorisation of Multi-directional Reading Path to show the different paths which the reading of a multimodal text can take being sequential but not necessarily linear.

Theorisation of Semiotic Community as community which shares the same context of situation and context of culture for semiotic resources
Extension of O’Toole’s (1995) visual grammar for images.

From
Lim, F.V. (2004) Developing an Integrative Multisemiotic Model. In K. L. O’Halloran, (Ed.). (2004). Multimodal Discourse Analysis. London & New York: Continuum International Publishing Group.Proposal of an Integrative Multisemiotic Model (IMM) as a unifying framework for a comprehensive and overarching framework for multimodal discourse analysis between language and images.

Theorisation on the Expression Plane for Language (Written) through the system network of Typography

Theorisation of the Expression Plane for Images through the system network of Design/Graphics and the following concepts
Homospatiality (Interaction and integration of language and images on the expression plane”)

Theorisation of the Space of Integration (Dynamics of Intersemiosis between language and images) and the following concepts
- Co-contextualising Relations, where meaning converges and are reinforced leading to multiplication of meanings
- Re-Contextualising Relations, where meaning diverges and are recast and re-modified leading to multiplication of meanings

Theorisation of System Meta-Function Fidelity as the dedication of system to the particular meta-function. Images have low system meta-function fidelity as for instance, the system of colour can serve the ideational, interpersonal and textual meta-function in the same text.

Theorisation of Critical Impetus as the necessary condition for a particular meta-function to be served eg. Salience realised by the system of colour could serve the interpersonal meta-function.

Theorisation of the Visual Co-text as the surrounding text of an image which comprises of the parts of a whole image.

From
Lim, F.V. (2005). Problematising Semiotic Resource. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on Multimodality Amsterdam: John Benjamins.

Theorisation of Images as a Semiotic Resource with an expression and stratified content plane with a grammar as well as a semantics stratum, following Halliday’s (1978) understanding of semiotics resource

Theorisation of Colour as a system with meaning potential and not a semiotic resource

Extended the claim of arbitrariness as relationship between language and images on the expression plane.
High degree of arbitrariness- Abstraction eg. Mathematical symbol
Low degree of arbitrariness (high in iconicity)- Analogon (Barthes’ view of photograph as perfect analogon)

Theorisation of codification as a form of grammaticalisation linking the signifier to the signified

From
Lim, F.V. (2006) The Visual Semantics Stratum: Making Meaning in a Sequential Series of Visual Images. In T. Royce, & W. Bowcher. eds. New Directions in the Analysis of Multimodal Discourse. New Jersey: Lawrence Erlbaum Associates.Analysis of a Multimodal Text—2 Comic Strip (Baby Blues)

Theorisation of the Discourse Semantics Stratum for Images, following Martin’s (1992) conceptualisation of discourse semantics for language and the following concepts:
Visual Taxonomy
- Associating Element
Visual Configuration
- Flow
Visual Reference
- Visual Linking Device
Visual Taxis
- Transition Relations

From
Lim, F.V. (submitted for publication) Multimodal Literacy: Reading an Advertisement” in Australian Journal of Language and Literacy

Analysis of a Multimodal Text— Advertisement (Cartier Jewelry)