Jusletter IT

Distributive Multimedia and Multisensory Legal Machines

  • Authors: Friedrich Lachmayer / Vytautas Čyras
  • Category: Short Articles
  • Region: Austria
  • Field of law: Legal Visualisation
  • Collection: Conference proceedings IRIS 2011
  • Citation: Friedrich Lachmayer / Vytautas Čyras, Distributive Multimedia and Multisensory Legal Machines, in: Jusletter IT 24 February 2011
Since Aristotle, legal philosophy explores and develops its concept of the iustitia distributiva. Currently, a trend in legal informatics both transforms and adopts long-established traditional cognitive patterns of (legal) philosophy. For example, it reveals the antique and medieval roots of (legal) ontologies. Similarly, new concepts of societal distribution can be elaborated in the context of multimedia and therefore multisensory legal machines. By reference to automats performing legal transactions, traffic lights, and ticket machines, we will explain new concepts of legal procedures. These concepts base on algorithms governing these procedures. Such distributive multimedia and hence multisensory legal machines are not only applications of legal informatics and e-government, but they can also be adequately analysed within the theoretical and practical framework of multisensory law. This new legal discipline in the making particularly focuses on the uni- and multisensory aspects and implications of the new ICT to which the machines at issue belong.

Inhaltsverzeichnis

  • 1. Human beings and machines
  • 2. Two stages: real life and its representation
  • 3. Legal machines in multisensory jurisprudence
  • 4. Conclusions
  • 5. References

1.

Human beings and machines ^

[1]

This paper addresses human beings and machines in the role of legal actors. A transition from factual acts (or facts) to legal acts is explored. Factual acts are in the Is world whereas legal acts are in the Ought-to-Be world [Kelsen 2000]. Hence the point of departure is that an actor makes an action with an effect and this is under a condition . Examples are «Alice puts a coin in a piggybank», «Bob takes his shoes off and drops them in the room» (though this makes him rude), etc. Hence we assume the factual act model that is depicted in Fig. 1.

Fig. 1: Elements of the factual act

[2]
A notation for the factual act type is a tuple:
[3]
Following is an instance,factualAct1 :
[4]
The actor can be of different types: a human being, a machine, goodness, a text, or somethingx .
[5]
The meaning of factual acts above is pure facts which have no legal importance. Legal importance is observed, for instance, in conduct implying an intent (konkludentes Verhalten ), such as Chris putting coins in a ticket machine to buy a train ticket, a policeman raising a hand, etc. These are treated aslegal acts . You commit a fraud when dropping fake coins in a vending machine whereas a child may put old coins in his piggybank, etc.; cf. [McCormick & Weinberger 1992]. The importance of legal acts is different from factual acts but the structure is the same – a tuple – though worded differently (Fig. 2):
[6]
Visualizations in this paper form a step to formalisation. They are influenced by Florian Holzer (2010) and his situational legal visualization.
Fig. 2: From factual acts to legal acts

[7]
Factual acts can be lifted to the legal acts category by the actor’s role. For example, you are obliged to stand up when the judge enters a courtroom, though you sit when ordinary people come in.
[8]
Both factual and legal acts can be represented in propositional logic in the form of statements which are true or false, for example:
[9]
The difference is that legal acts have legal consequences. For instance,factualAct3 above has no legal consequences, whereaslegalAct3 implies, that the drivers are obliged to stop. This can be expressed in deontic logic:
[10]
Important are legal effects of legal acts. The types of legal acts – speech acts or implications – are not so important. As an example assume a vending machine. Persons putting coins into it engage in sales contracts. In this sense we view the vending machine as a legal machine. Another example is a traffic lights. It distributes rights to cross the road. The third example is FinanzOnline1 form proceedings in the e-Government domain in Austria that serves in tax law issues.
[11]
The condition can have legal importance, too. For example, road radars make photos when the vehicle’s speed exceeds a certain value. Thus each element – the legal condition, the legal actor, the legal action and the legal effect – are qualified to have legal importance.
[12]
Organisations, legal acts and legal machines. Organisations are essential in discussing legal acts (Fig. 3). An organisation is viewed on three levels. The first is a legal entity (juristische Person ) as a whole, such as a company with limited liability, a university, etc. The second level is an organ of the organisation, and the third, an administrator of the organ, which can be an official or a machine, too. For example, when you buy a train ticket, the contract is established with the railway company, not the cashier. The company (with recourse the official, too) is held liable. Here the cashier can be replaced by a ticket machine.
Fig. 3: Organisation

[13]
In this respect differences between legal machines and human beings are not so large (Fig. 4). Of course, they have to be considered when speaking about rights, duties and liability. This leads to legal analyses of human and electronic agents which were already accomplished decades ago; cf. [Schweighofer 2001; Sartor 2002; Wettig & Zehendner 2004; Sorge 2006], the whole Issue 1-2 of Artificial Intelligence and Law, Vol. 12 (2004), etc. The concept of electronic person (e-Person) [Schweighofer 2007] regarding e-Government has to be taken into consideration, too.
Fig. 4: Replacing human beings with machines in a legal person’s organ

[14]
Horizontal and vertical effect. In the contract example above, the relationships condition-actor-action-effect have horizontal – individual – effect as they concern private law (Fig. 2 and 4). Traffic lights have vertical – general – effect as regulated by administrative law (Fig. 5). Traffic lights serve as a legal machine: you are prohibited to go on a red light,F(go) , and permitted on green,P(go) , though you can wait on the pavement, too. The traffic lights algorithm in terms of a finite state automaton is shown in Fig. 5. Its states are turned from red to green or vice versa. The algorithm changes permissions and obligations and distributes legal time and space between pedestrians and drivers. The regulation of pedestrian traffic lights can be expressed by the following formula:
[15]
whereO = obligation ,T = transition ,P = permission ,A = go-action . Prohibition to doA ,F(A) , is interpreted as obligation not to doA ,O(¬A) .
Fig. 5: Vertical effect of administrative law regulation by traffic lights. Thus legal time and space is distributed. The algorithm is represented in the form of state machine. On a pedestrian red light they are obliged not to go,O(¬A ), and drivers are obliged to go. On a pedestrian green light they are permitted to go,P(A )

[16]
The algorithms, which are embedded in legal machines, are out of scope of this paper. Operational implementations of norms are dealt by software engineers. Different approaches are explored; cf. [Vázquez-Salceda et al. 2008]. Mathematical formalisations and computational models are investigated by JURIX, DEON and Normative Multi-Agent Systems communities.2
[17]
Traffic lights colours are legally indifferent substratum, cf. [Kelsen 2000]. The same colours are exhibited, for example, by discotheque lights machines. However, the latter act in the Is world contrary to the traffic lights that act in the Ought-to-Be world.
Fig. 6: Human/machine in a workflow. Decisions can be made by machines, too.

[18]
Workflow and legal machines. Example 3 is about form proceedings workflows, such as FinanzOnline in Austria. Data input to a workflow is a legally binding act. Declaring your income and other data has legal qualification and you are obliged to input truthful data. Decision making actors in the workflow are comprised of both humans and machines (Fig. 6). You are not allowed to excuse machines saying that you were joking with false data. Before making decisions machines also check for your input correctness. Hence, apart human-machine also machine-machine communication of legal importance is observed. The workflow enables you to skip tax advisers.
[19]
In communication, as the workflow above shows, all the relationship combinations are observed: human → human, human → machine, machine → human, and machine → machine.
[20]
Machines replace organisation officials. Example 4 is about machines in the role of official. In this case, a machine is not a legal entity and also not e-Person, shortly:
[21]
As noted above, legal persons can be viewed on three layers: (1) a legal person as a whole, (2) an office within it, and (3) an official within the office. An example is an official selling tickets. Assume officials being replaced by ticket-machines (Fig. 7). Similar examples include airport check-in machines, car parking payments via mobile phone, etc. Here you communicate with machines and skip humans.
Fig. 7: (a) Three layers within an organisation (legal person). An example illustrates a machine which is auxiliary to officials and is not a legal person yet. Here machine ( legal person. (b) Communication relationships.

[22]
Boundaries: machines as e-Persons. In summary, we have identified four cases which involve legal machines:
Case 1. Vending machines, such as slot machines, used for selling drinks
Case 2. Traffic lights
Case 3. Form proceedings, such as FinanzOnline
Case 4. Machines auxiliary to officials. Here machines are not legal persons.
[23]
In Case 4, machines replace physical persons – officials. Thus machines can have the aura of physical persons but still do not reach the level of legal persons. They are treated as things, tools. They lack characteristics of legal subjects, such as legal capacity (Rechtsfähigkeit ) and contractual capacity (Geschäftsfähigkeit ).
[24]
Case 4 draws a boundary of today. Imagine a situation (in future) in which a machine replaces the whole organisation. Assume national register organisations such as immobility register, register of personal data handlers, etc. Today registers operate as legal persons according to the Case 4 model depicted in Fig. 7. However, imagine a register which is operated by a legal machine (Fig. 8). Thus the machine becomes a kind of e-Person. This is not reality yet.
Fig. 8: A situation in the future: a machine replaces an organisation and becomes a kind of e-Person

[25]
A paradigm shift for the future can be expressed as follows. Today’s paradigm is that legal actors are comprised of physical persons and legal persons. In the set theory notation, the legal actor category is the union:legal_actor =physical_person (legal_person .
[26]
or in predicate logic:
[27]
Future paradigms should complement legal actors with legal machines:
[28]
or shortly:legal_actor =physical_person (legal_person (legal_machine .
[29]
In summary, the context of legal machines is comprised by the four cases above.

2.

Two stages: real life and its representation ^

[30]
We distinguish between the real life stage (real space) and representation stages (virtual space). Machines can serve as representation stages. Examples are three-dimensional online virtual worlds such as Second Life3 . Avatars in a virtual world are representations of and are manipulated by physical persons. However, misbehaviour in virtual space is qualified differently than in real life.4
[31]
It makes sense to regulate avatars’ behaviour by the so called «virtual law». Regulation would prevent two kinds of misbehaviour. First come acts (criminal, civil, etc.) which are qualified as illegal in the real world, such as copyright infringements, indecent content, etc. Second, come acts on the representation stage. An example of so called virtual crime is an avatar making virtual harm to other avatars, e.g. hitting them. Virtual space regulation is aimed by two ways, cf. the VirtualLife5 project and [Čyras & Lachmayer 2010]. The first way is regulation through virtual world’s software that implements the method «[Computer] code is law»; cf. [Lessig 2006]. The second way is regulation through norms – making the virtual law part of end user license agreement (EULA) and enforcing it on the contractual level. The virtual law in EULA as being an ordinary contract can be implemented by way of click-wrap agreements. In result, computers which run the virtual world become legal machines. They distribute (1) real time/space for human users, and (2) virtual space for avatars.

3.

Legal machines in multisensory jurisprudence ^

[32]
Machines are able to issue commands which are perceived by all of our senses (sight, hearing, smell, taste and touch). As advocated by Colette R. Brunschwig (2003; 2009), multisensory jurisprudence is about multimodal (visual, audiovisual, etc.) representation and communication of valid legal content (geltendrechtliche Inhalt6 ). Traditionally legal actors are comprised of lawyers, judges, administration officials, parliament members, etc. [2003, p. 411]. In this paper we explore on supplementing the concept of legal actors with legal machines – at least in certain tasks.
[33]
Machines can also serve for multimodal representation and communication. In this way, normativity is transmitted to be perceived by all senses – by both humans and machines. The traffic lights illustrate perception by sight. Road and airport radars are examples of visual and radio communication between machines with machine vision producing legal effects. Traffic lights which are intended to blind people are equipped with sound devices and touch panels. A voice example is when you hear commands in your phone «In case of ... press 1, in case of ... press 2, etc.» A thermostat is a machine perceiving temperature changes and turning the heating system on. Prescriptive and prohibitive gestures can be performed by machines, too. Examples are automatic barriers in parking places.
[34]
Multisensory production and perception are distinguished. A variety of modes is shown in Fig. 9.
Fig. 9: A variety of modes in the production and perception of legal content

[35]
The reasons for the lack of pictures in law and the reluctance of jurists to admit multimodal forms of law («Law is text») were seriously explored; see [Brunschwig 2003; Röhl & Ulbrich 2007]. Representation and communication of legal contents can be viewed from different perspectives. In our research we focus on the production of legal acts by machines. We aim to identify machine-aided production tasks within the phenomenon of law that has several functions and is rich of tasks.

4.

Conclusions ^

[36]
This paper reflects on legal machines. Patterns to produce legal acts are sketched out. Further research is required to develop a complete classification of the patterns and a stricter notation. Semantic networks form the first attempt to formalise the visualizations above. Legal issues tackle the concept of e-Person. Construction issues such as operational implementation tackle software agents.

Acknowledgements. We thank Colette R. Brunschwig. Her work and comments contribute to positioning our research within the context of legal informatics.

V. Čyras was partially supported by EU FP7 ICT VirtualLife project.

5.

References ^

Brunschwig, Colette R., Tabuzone juristischer Reflexion. Zum Mangel an Bildern, die geltendrechtliche Inhalte visualisieren. In: Schweighofer, E. & Lachmayer, F. (Hrsg.) Zwischen Rechtstheorie und e-Government: aktuelle Fragen der Rechtsinformatik, Schriftenreihe Rechtsinformatik, Bd. 7. Verlag Österreich, Wien, pp. 411–420 (2003).
Brunschwig, Colette R., Rechtsvisualisierung – Skizze eines nahezu unbekannten Feldes. In: Zeitschrift für Informations-, Telekommunikations- und Medienrecht (MultiMedia und Recht MMR), Nr. 1, hrsg. v. Dietrich Beese [u.a.], Verlag C.H. Beck, München 2009, pp. IX–XII.http://rsw.beck.de/rsw/shop/default.asp?docid=272992 accessed January 15, 2011 (2009).
Čyras, Vytautas; Lachmayer, Friedrich, Technical rules and legal rules in online virtual worlds, European Journal of Law and Technology, vol. 1, no. 3.http://ejlt.org//article/view/27 (2010).
Holzer, Florian, Rechtsvisualisierung, Quo Vadis? Von der schematisch-logischen zur szenisch-situativen Rechtsvisualisierung. In: Schweighofer, E., Geist, A., & Staufer, I. (eds.) Globale Sicherheit und proaktiver Staat – Die Rolle der Rechtsinformatik, Tagungsband des 13. Internationalen Rechtsinformatik Symposions IRIS 2010, pp. 549–552. Österreichische Computer Gesellschaft, Wien (2010).
Kelsen, Hans, Reine Rechtslehre, Verlag Österreich, Wien (2000).
Lessig, Lawrence, Code version 2.0, Basic Books, New York.http://codev2.cc/ accessed January 15, 2011 (2006).
MacCormick, Neil; Weinberger, Ota, An institutional theory of law: new approaches to legal positivism. D. Reidel Publishing Company, Dordrecht, Holland (1992).
Röhl, Klaus F.; Ulbrich, Stefan , Recht anschaulich. Visualisierung in der Juristenausbildung (edition medienpraxis, 3) Halem, Köln (2007).
Sartor, Giovanni (ed.), The Law of Electronic Agents: Selected Revised Papers, Proceedings of the Workshop on the Law of electronic Agents (LEA 2002), CIRSFID, University of Bologna, Bologna.www.cirfid.unibo.it/~agsw/lea02/online.html accessed January 15, 2011 (2002)
Schweighofer, Erich, Vorüberlegungen zu künstlichen Personen: autonome Roboter und intelligente Softwaareagenten. In: Schweighofer, E., Menzel, T. & Kreuzbauer, G. (Hrsg.) Auf dem Weg zur ePerson, Schriftenreihe Rechtsinformatik, Bd. 3, Verlag Österreich, Wien, pp. 45–54 (2001).
Schweighofer, Erich, e-Governance in the information society. In: Schweighofer, E. (ed.) Legal Informatics and e-Governance as tools for the Knowledge Society, pp. 13–23. LEFIS Series 2.www.lefis.org/images/documents/outcomes/lefis_series/lefis_series_2/capitulo1.pdf accessed January 15, 2011 (2007).
Sorge, Christoph, Softwareagenten. Vertragsschluss, Vertragsstrafe, Reugeld. Schriften des Zentrums für angewandte Rechtswissenschaft, Universität Karlsruhe.http://digbib.ubka.uni-karlsruhe.de/volltexte/documents/2523 accessed January 15, 2011 (2006).
Vázquez-Salceda, J., Aldewereld, H., Grossi, D., Dignum, F., From human regulations to regulated software agents behavior. Connecting the abstract declarative norms with the concrete operational implementation. Artificial Intelligence and Law 16(1), 73–87 (2008).
Wettig, Steffen; Zehendner, Eberhard, A legal analysis of human and electronic agents. Artificial Intelligence and Law 12(1-2), 111-135 (2004).



Vytautas Čyras, Docent, Vilnius University, Faculty of Mathematics and Informatics, Naugarduko 24, 03225 Vilnius, LT
Vytautas.Cyras@mif.vu.lt ;www.mif.vu.lt/~cyras/

Friedrich Lachmayer, Professor, University of Innsbruck, Innrain 47, 6020 Innsbruck, AT
Friedrich.Lachmayer@uibk.ac.at ;www.legalvisualization.com


  1. 1 https://finanzonline.bmf.gv.at accessed January 15, 2011
  2. 2 See a whole Issue 1 of Artificial Intelligence and Law, Vol. 16 (2008) which is devoted to agents and AI & Law.
  3. 3 A virtual world developed by Linden Lab,http://secondlife.com .
  4. 4 «… there is a difference between writing about rape and raping» [Lessig 2006, p. 20]. Examples concern sexual violence against avatars in textual and 3D MMORPGs (massively multiplayer online role-playing game). This appeared in the rise of cyberspace [p. 17-20, 98-99].
  5. 5 EU FP7 ICT VirtualLife project «Secure, Trusted and Legally Ruled Collaboration Environment in Virtual Life», FP7-ICT-2007-1, 216064, 2008-2010,www.ict-virtuallife.eu .
  6. 6 The valid legal content denotes the content of valid law and also the content, which is significant for it («Mit ‹geltendrechtlichen Inhalten› meine ich Inhalte des geltenden rechts, aber auch inhalte, die für das geltende Recht bedeutsam sind» [Brunschwig 2003, p. 413]).