Cognitive Aspects of Programming in Pictures

Programming in pictures is an approach supported by a special programming environment where pictures and moving pictures are systematically used for direct representation of features of computational algorithms and data structures. Within this approach some "data space" is traversed by a "front of computation" and necessary operations are performed during this traversal process. There are compound pictures to define algorithmic steps (called Algorithmic CyberFrames) and generic pictures to define the contents of compound pictures. Compound pictures are assembled into special series to represent some predefined algorithmic features. A number of the series is assembled into an Algorithmic Cyber-Film. The environment helps to follow a cognitive model where success of users' perception, comprehension and cognition depend on interaction with, at least, a few different but mutually supplementing features of a picture or a set of pictures. In this paper, we survey a number of techniques that are used with programming in pictures to enhance perception and cognition of people working on developing computational application models and corresponding algorithms.

[1]  Françoise Détienne,et al.  Software Design — Cognitive Aspects , 2001, Practitioner Series.

[2]  John M. Carroll,et al.  Human-Computer Interaction in the New Millennium , 2001 .

[3]  Dieter Fensel,et al.  Ontologies: A silver bullet for knowledge management and electronic commerce , 2002 .

[4]  Nikolay N. Mirenkov,et al.  Visual computing within environment of self-explanatory components , 2002, Soft Comput..

[5]  Florent Becker Pictures worth a thousand tiles, a geometrical programming language for self-assembly , 2009, Theor. Comput. Sci..

[6]  Nikolay N. Mirenkov,et al.  Self-Explanatory Components: A New Programming Paradigm , 2001, Int. J. Softw. Eng. Knowl. Eng..

[7]  Kevin McGee,et al.  Visual programming with analogical representations: Inspirations from a semiotic analysis of comics , 2007, J. Vis. Lang. Comput..

[8]  Yutaka Watanobe,et al.  Algorithm library based on algorithmic cyberFilms , 2007, Knowl. Based Syst..

[9]  Henrik Danielsson,et al.  Pictures as language , 2001 .

[10]  Ben Shneiderman,et al.  Leonardo's laptop: human needs and the new computing technologies , 2005, CIKM '05.

[11]  Yutaka Watanobe,et al.  Open set of algorithmic characters , 2010 .

[12]  Nikolay N. Mirenkov,et al.  Filmification Of Methods And An Example Of Its Applications , 2005, Int. J. Softw. Eng. Knowl. Eng..

[13]  N. Hari Narayanan,et al.  Diagrammatic Reasoning: Cognitive and Computational Perspectives , 1995 .

[14]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[15]  Yutaka Watanobe,et al.  Filmification of methods: Convex Hull algorithms , 2009, TENCON 2009 - 2009 IEEE Region 10 Conference.

[16]  Jens Rasmussen,et al.  Cognitive Systems Engineering , 2022 .