# Hands-on¶

## Shell basics¶

### Directory tree¶

Directory tree is hierarchical way to organize files in operating systems. A typical (reduced) tree in linux looks like this:

/            Root
├──boot        System startup
├──bin         Low-level programs
├──lib         Low-level libraries
├──dev         Hardware access
├──proc        System information
├──var         Files modified by system services
├──etc         Configuration files
├──media       External drives
├──tmp         Temporary files
├──usr         Everything for normal operation (usr = UNIX system resources)
│    ├──bin       User programs
│    ├──include   Header files for c/c++
│    ├──lib       Libraries
│    ├──local     Locally installed software
│    └──doc       Documentation
└──home        Contains the user's home directories
├──user      Home directory for user
└──user1     Home directory for user1


Note that there is a single root /; all other disks (such as USB sticks) attach to some point in the tree (e.g. in /media).

Shell is the UNIX command-line, interface for conversation with the machine. Don’t be afraid.

#### Moving around¶

The shell is always operated by some user, at some concrete machine; these two are constant. We can move in the directory structure, and the current place where we are is current directory. By default, it is the home directory which contains all files belonging to the respective user:

user@machine:~$# user operating at machine, in the directory ~ (= user's home directory) user@machine:~$ ls .                    # list contents of the current directory
user@machine:~$ls foo # list contents of directory foo, relative to the dcurrent directory ~ (= ls ~/foo = ls /home/user/foo) user@machine:~$ ls /tmp                 # list contents of /tmp
user@machine:~$cd foo # change directory to foo user@machine:~/foo$ ls ~                # list home directory (= ls /home/user)
user@machine:~/foo$cd bar # change to bar (= cd ~/foo/bar) user@machine:~/foo/bar$ cd ../../foo2   # go to the parent directory twice, then to foo2 (cd ~/foo/bar/../../foo2 = cd ~/foo2 = cd /home/user/foo2)
user@machine:~/foo2$cd # go to the home directory (= ls ~ = ls /home/user) user@machine:~$


Users typically have only permissions to write (i.e. modify files) only in their home directory (abbreviated ~, usually is /home/user) and /tmp, and permissions to read files in most other parts of the system:

user@machine:~$ls /root # see what files the administrator has ls: cannot open directory /root: Permission denied  #### Keys¶ Useful keys on the command-line are:  show possible completions of what is being typed (use abundantly!) ^C (=Ctrl+C) delete current line ^D exit the shell ↑↓ move up and down in the command history ^C interrupt currently running program ^\ kill currently running program Shift-PgUp scroll the screen up (show past output) Shift-PgDown scroll the screen down (show future output; works only on quantum computers) #### Running programs¶ When a program is being run (without giving its full path), several directories are searched for program of that name; those directories are given by $PATH:

user@machine:~$echo$PATH     # show the value of $PATH /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games user@machine:~$ which ls       # say what is the real path of ls


The first part of the command-line is the program to be run (which), the remaining parts are arguments (ls in this case). It is up to the program which arguments it understands. Many programs can take special arguments called options starting with - (followed by a single letter) or -- (followed by words); one of the common options is -h or --help, which displays how to use the program (try ls --help).

Full documentation for each program usually exists as manual page (or man page), which can be shown using e.g. man ls (q to exit)

If yade is installed on the machine, it can be (roughly speaking) run as any other program; without any arguments, it runs in the “dialog mode”, where a command-line is presented:

user@machine:~$yade Welcome to Yade 2019.01a TCP python prompt on localhost:9002, auth cookie adcusk' XMLRPC info provider on http://localhost:21002 [[ ^L clears screen, ^U kills line. F12 controller, F11 3d view, F10 both, F9 generator, F8 plot. ]] Yade [1]: #### hit ^D to exit Do you really want to exit ([y]/n)? Yade: normal exit.  The command-line is in fact python, enriched with some yade-specific features. (Pure python interpreter can be run with python or ipython commands). Instead of typing commands on-by-one on the command line, they can be be written in a file (with the .py extension) and given as argument to Yade: user@machine:~$ yade simulation.py


For a complete help, see man yade

Exercises

1. Open the terminal, navigate to your home directory
2. Create a new empty file and save it in ~/first.py
3. Change directory to /tmp; delete the file ~/first.py
4. Run program xeyes
5. Look at the help of Yade.
6. Look at the manual page of Yade
7. Run Yade, exit and run it again.

## Python basics¶

We assume the reader is familar with Python tutorial and only briefly review some of the basic capabilities. The following will run in pure-python interpreter (python or ipython), but also inside Yade, which is a super-set of Python.

Numerical operations and modules:

Yade [1]: (1+3*4)**2        # usual rules for operator precedence, ** is exponentiation
Out[1]: 169

Yade [3]: math.sqrt(2)      # use a function from that module
Out[3]: 1.4142135623730951

Yade [4]: import math as m  # use the module under a different name

Out[5]: -1.0

Yade [6]: from math import *  # import everything so that it can be used without module name

Out[7]: -1.0


Variables:

Yade [8]: a=1; b,c=2,3       # multiple commands separated with ;, multiple assignment

Out[9]: 6


### Sequences¶

#### Lists¶

Lists are variable-length sequences, which can be modified; they are written with braces [...], and their elements are accessed with numerical indices:

Yade [10]: a=[1,2,3]          # list of numbers

Yade [11]: a[0]               # first element has index 0
Out[11]: 1

Yade [12]: a[-1]              # negative counts from the end
Out[12]: 3

---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
----> 1 a[3]               # error

IndexError: list index out of range

Yade [14]: len(a)             # number of elements
Out[14]: 3

Yade [15]: a[1:]              # from second element to the end
Out[15]: [2, 3]

Yade [16]: a+=[4,5]           # extend the list

Yade [17]: a+=[6]; a.append(7) # extend with single value, both have the same effect

Yade [18]: 9 in a             # test presence of an element
Out[18]: False


Lists can be created in various ways:

Yade [19]: range(10)
Out[19]: range(0, 10)

Out[20]: 9


List of squares of even number smaller than 20, i.e. $$\left\{a^2\;\forall a\in \{0,\cdots,19\} \;\middle|\; 2 \| a\right\}$$ (note the similarity):

Yade [21]: [a**2 for a in range(20) if a%2==0]
Out[21]: [0, 4, 16, 36, 64, 100, 144, 196, 256, 324]


#### Tuples¶

Tuples are constant sequences:

Yade [22]: b=(1,2,3)

Out[23]: 1

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
----> 1 b[0]=4              # error

TypeError: 'tuple' object does not support item assignment


#### Dictionaries¶

Mapping from keys to values:

Yade [25]: ende={'one':'ein' , 'two':'zwei' , 'three':'drei'}

Yade [26]: de={1:'ein' , 2:'zwei' , 3:'drei'}; en={1:'one' , 2:'two' , 3:'three'}

Yade [27]: ende['one']         ## access values
Out[27]: 'ein'

Out[28]: ('ein', 'two')


### Functions, conditionals¶

Yade [29]: 4==5
Out[29]: False

....:     b=-2          # conditional statement
....: else:
....:     b=3
....:

Yade [32]: c=0 if a<1 else 1      # trenary conditional expression

Out[33]: (-2, 1)

Yade [34]: def square(x): return x**2    # define a new function
....:

Yade [35]: square(2)                     # and call that function
Out[35]: 4


Exercises

1. Read the following code and say what wil be the values of a and b:

a=range(5)
b=[(aa**2 if aa%2==0 else -aa**2) for aa in a]


Yade objects are constructed in the following manner (this process is also called “instantiation”, since we create concrete instances of abstract classes: one individual sphere is an instance of the abstract Sphere, like Socrates is an instance of “man”):

Yade [36]: Sphere           # try also Sphere?

Yade [37]: s=Sphere()       # create a Sphere, without specifying any attributes

Yade [38]: s.radius         # 'nan' is a special value meaning "not a number" (i.e. not defined)
Out[38]: nan

Out[40]: 2.0

Out[42]: (2.0, 3.0)


### Particles¶

Particles are the “data” component of simulation; they are the objects that will undergo some processes, though do not define those processes yet.

#### Singles¶

There is a number of pre-defined functions to create particles of certain type; in order to create a sphere, one has to (see the source of utils.sphere for instance):

1. Create Body
2. Set Body.shape to be an instance of Sphere with some given radius
3. Set Body.material (last-defined material is used, otherwise a default material is created)
4. Set position and orientation in Body.state, compute mass and moment of inertia based on Material and Shape

In order to avoid such tasks, shorthand functions are defined in the utils module; to mention a few of them, they are utils.sphere, utils.facet, utils.wall.

Yade [43]: s=utils.sphere((0,0,0),radius=1)    # create sphere particle centered at (0,0,0) with radius=1

Yade [44]: s.shape                       # s.shape describes the geometry of the particle
Out[44]: <Sphere instance at 0x36aa880>

Out[45]: 1.0

Yade [46]: s.state.mass, s.state.inertia # inertia is computed from density and geometry
Out[46]:
(4188.790204786391,
Vector3(1675.516081914556253,1675.516081914556253,1675.516081914556253))

Yade [47]: s.state.pos                   # position is the one we prescribed
Out[47]: Vector3(0,0,0)



In the last example, the particle was fixed in space by the fixed=True parameter to utils.sphere; such a particle will not move, creating a primitive boundary condition.

A particle object is not yet part of the simulation; in order to do so, a special function O.bodies.append (also see Omega::bodies and Scene) is called:

Yade [49]: O.bodies.append(s)            # adds particle s to the simulation; returns id of the particle(s) added
Out[49]: 24


#### Packs¶

There are functions to generate a specific arrangement of particles in the pack module; for instance, cloud (random loose packing) of spheres can be generated with the pack.SpherePack class:

Yade [50]: from yade import pack

Yade [51]: sp=pack.SpherePack()                   # create an empty cloud; SpherePack contains only geometrical information

Yade [52]: sp.makeCloud((1,1,1),(2,2,2),rMean=.2) # put spheres with defined radius inside box given by corners (1,1,1) and (2,2,2)
Out[52]: 7

Yade [53]: for c,r in sp: print(c,r)               # print center and radius of all particles (SpherePack is a sequence which can be iterated over)
....:
Vector3(1.263084634978451914,1.547535725174272736,1.717504207492063673) 0.2
Vector3(1.616167565196613198,1.787364708984240602,1.356709818275309232) 0.2
Vector3(1.311706749789810056,1.357213959194646602,1.237234887211978052) 0.2
Vector3(1.782623812411513686,1.30640365709264783,1.777322430996170155) 0.2
Vector3(1.63096915233182016,1.723889393176488705,1.779302913042148715) 0.2
Vector3(1.732721588122112966,1.358997701040535633,1.230828650040311834) 0.2
Vector3(1.201689916439862227,1.785112550198633574,1.399026986700488973) 0.2

Yade [54]: sp.toSimulation()                      # create particles and add them to the simulation
Out[54]: [25, 26, 27, 28, 29, 30, 31]


#### Boundaries¶

utils.facet (triangle Facet) and utils.wall (infinite axes-aligned plane Wall) geometries are typically used to define boundaries. For instance, a “floor” for the simulation can be created like this:

Yade [55]: O.bodies.append(utils.wall(-1,axis=2))
Out[55]: 32


There are other conveinence functions (like utils.facetBox for creating closed or open rectangular box, or family of ymport functions)

### Look inside¶

The simulation can be inspected in several ways. All data can be accessed from python directly:

Yade [56]: len(O.bodies)
Out[56]: 33

Out[57]: 0.16

Yade [58]: O.bodies[12].state.pos      # position of body #12
Out[58]: Vector3(1.697751944776628719,1.756906422650426514,1.08442049136606733)


Besides that, Yade says this at startup (the line preceding the command-line):

[[ ^L clears screen, ^U kills line. F12 controller, F11 3d view, F10 both, F9 generator, F8 plot. ]]

Controller
Pressing F12 brings up a window for controlling the simulation. Although typically no human intervention is done in large simulations (which run “headless”, without any graphical interaction), it can be handy in small examples. There are basic information on the simulation (will be used later).
3d view
The 3d view can be opened with F11 (or by clicking on button in the Controller – see below). There is a number of keyboard shortcuts to manipulate it (press h to get basic help), and it can be moved, rotated and zoomed using mouse. Display-related settings can be set in the “Display” tab of the controller (such as whether particles are drawn).
Inspector
Inspector is opened by clicking on the appropriate button in the Controller. It shows (and updates) internal data of the current simulation. In particular, one can have a look at engines, particles (Bodies) and interactions (Interactions). Clicking at each of the attribute names links to the appropriate section in the documentation.

Exercises

1. What is this code going to do?

Yade [59]: O.bodies.append([utils.sphere((2*i,0,0),1) for i in range(1,20)])
Out[59]: [33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51]

2. Create a simple simulation with cloud of spheres enclosed in the box (0,0,0) and (1,1,1) with mean radius .1. (hint: pack.SpherePack.makeCloud)

3. Enclose the cloud created above in box with corners (0,0,0) and (1,1,1); keep the top of the box open. (hint: utils.facetBox; type utils.facetBox? or utils.facetBox?? to get help on the command line)

4. Open the 3D view, try zooming in/out; position axes so that $$z$$ is upwards, $$y$$ goes to the right and $$x$$ towards you.

### Engines¶

Engines define processes undertaken by particles. As we know from the theoretical introduction, the sequence of engines is called simulation loop. Let us define a simple interaction loop:

Yade [60]: O.engines=[                   # newlines and indentations are not important until the brace is closed
....:    ForceResetter(),
....:    InsertionSortCollider([Bo1_Sphere_Aabb(),Bo1_Wall_Aabb()]),
....:    InteractionLoop(           # dtto for the parenthesis here
....:        [Ig2_Sphere_Sphere_ScGeom(),Ig2_Wall_Sphere_ScGeom()],
....:        [Ip2_FrictMat_FrictMat_FrictPhys()],
....:        [Law2_ScGeom_FrictPhys_CundallStrack()]
....:    ),
....:    NewtonIntegrator(damping=.2,label='newtonCustomLabel')      # define a label newtonCustomLabel under which we can access this engine easily
....: ]
....:

Out[61]:
[<ForceResetter instance at 0x33dccc0>,
<InsertionSortCollider instance at 0x37485a0>,
<InteractionLoop instance at 0x36b40e0>,
<NewtonIntegrator instance at 0x1fee800>]

Yade [62]: O.engines[-1]==newtonCustomLabel    # is it the same object?
Out[62]: True

Out[63]: 0.2


Instead of typing everything into the command-line, one can describe simulation in a file (script) and then run yade with that file as an argument. We will therefore no longer show the command-line unless necessary; instead, only the script part will be shown. Like this:

O.engines=[                   # newlines and indentations are not important until the brace is closed
ForceResetter(),
InsertionSortCollider([Bo1_Sphere_Aabb(),Bo1_Wall_Aabb()]),
InteractionLoop(           # dtto for the parenthesis here
[Ig2_Sphere_Sphere_ScGeom(),Ig2_Wall_Sphere_ScGeom()],
[Ip2_FrictMat_FrictMat_FrictPhys()],
[Law2_ScGeom_FrictPhys_CundallStrack()]
),
GravityEngine(gravity=(0,0,-9.81)),                    # 9.81 is the gravity acceleration, and we say that
NewtonIntegrator(damping=.2,label='newtonCustomLabel') # define a label under which we can access this engine easily
]


Besides engines being run, it is likewise important to define how often they will run. Some engines can run only sometimes (we will see this later), while most of them will run always; the time between two successive runs of engines is timestep ($$\Dt$$). There is a mathematical limit on the timestep value, called critical timestep, which is computed from properties of particles. Since there is a function for that, we can just set timestep using utils.PWaveTimeStep:

O.dt=utils.PWaveTimeStep()


Each time when the simulation loop finishes, time O.time is advanced by the timestep O.dt:

Yade [64]: O.dt=0.01

Out[65]: 0.0

Out[67]: 0.01


For experimenting with a single simulations, it is handy to save it to memory; this can be achieved, once everything is defined, with:

O.saveTmp()
`

Exercises

1. Define engines as in the above example, run the Inspector and click through the engines to see their sequence.
2. Write a simple script which will
1. define particles as in the previous exercise (cloud of spheres inside a box open from the top)
2. define a simple simulation loop, as the one given above
3. set $$\Dt$$ equal to the critical P-Wave $$\Dt$$
4. save the initial simulation state to memory
3. Run the previously-defined simulation multiple times, while changing the value of timestep (use the button to reload the initial configuration).
1. See what happens as you increase $$\Dt$$ above the P-Wave value.
2. Try changing the gravity parameter, before running the simulation.
3. Try changing damping
4. Reload the simulation, open the 3d view, open the Inspector, select a particle in the 3d view (shift-click). Then run the simulation and watch how forces on that particle change; pause the simulation somewhere in the middle, look at interactions of this particle.
5. At which point can we say that the deposition is done, so that the simulation can be stopped?