blob: 24198ffdf791020ac2371b501a312cc3e5f6437a (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
|
## Overview System Tests
System tests for thin-edge in this folder are written in Python with
the PySys system test framework.
See also:
* [https://pysys-test.github.io/pysys-test/](https://pysys-test.github.io/pysys-test/)
* [https://github.com/pysys-test/](https://github.com/pysys-test/)
### Folders for tests
- Folder: analytics : Tests that generate analytics
- Folder: cloud\_c8y : Related to Cumulocity
- Folder: environments : Used to keep our PySys BaseTest extesions
- Folder: misc\_features : Test for miscellaneous features
- Folder: monitoring : Related to collect monitoring
- Folder: mqtt\_port : Related to MQTT port switching
- Folder: plugin\_apt : For apt plugin tests
- Folder: plugin\_docker : For docker plugin tests
- Folder: smoketests : For smoketests
- Folder: software\_management\_end\_to\_end :
For tests that simulate software management actions from an end to end
perspective by accessing the devie via the C8y REST interface
- Folder: tedge : Generally related to tedge commands
- Folder: tedge\_connect : Related to connecting with tedge
- Folder: tedge\_mapper\_az : Related to our Azure mapper
- Folder: tedge\_mapper\_c8y : Related to our Cumulocity mapper
#### Running System tests manually on your device / Linux PC
The system tests can be executed manually. In advance, you need a tenant in
Cumulocity as well as a previously generated device certificate. The device
needs to be able to connect to Cumulocity successfully.
The test configuration is located in environment variables, which need to be
set in in advance.
These environment variables need to be exported in your shell:
export TEBASEDIR=~/thin-edge.io/
export EXAMPLEDIR=$HOME/thin-edge.io/target/debug
export C8YUSERNAME= <your tenant>
export C8YPASS= <your password>
export C8YDEVICE= <dev name>
export C8YTENANT= <tenant id>
export C8YDEVICEID= <numeric c8y device id>
export C8YURL=<your url> e.g. : https://thin-edge-io.eu-latest.cumulocity.com
Quickstart to run the tests:
ci/ci_run_all_tests.sh
Run the tests in your own Python environment:
python3 -m venv ~/env-pysys
source ~/env-pysys/bin/activate
pip3 install -r tests/requirements.txt
cd tests/PySys/
pysys.py run
deactivate
You can selectively run tests based on their folder names:
pysys.py run c8y_restart_bridge
With debugging enabled:
pysys.py run -v DEBUG c8y_restart_bridge
Also with some wildcards:
pysys.py run 'monitoring_*'
### Environments to derive tests from
Tests can be simplified by moving common parts to environments. Currently,
available environments are:
* `environment_az.py`:
Environment to manage automated connect and disconnect to Microsoft Azure.
* `environment_c8y.py`:
Environment to manage automated connect and disconnect to Cumulocity.
* `environment_roundtrip_c8y.py`:
Environment to manage automated roundtrip tests for Cumulocity.
### Software Management End To End
See folder [software-management-end-to-end](/software-management-end-to-end/).
These tests are disabled by default as they will install and de-install packages.
Better run them in a VM or a container.
To run the tests:
pysys.py run 'sm-apt*' -XmyPlatform='smcontainer'
To run the tests with another tenant url:
pysys.py run 'sm-apt*' -XmyPlatform='smcontainer' -Xtenant_url='thin-edge-io.eu-latest.cumulocity.com'
### Apt Plugin Tests
See folder [apt_plugin](/apt_plugin/).
These tests are disabled by default as they will install and de-install packages.
Better run them in a VM or a container.
To run the tests:
pysys.py run 'apt_*' -XmyPlatform='container'
Some of the tests desire a configured fakeplugin to simulate fruits.
To run the tests on a platform with fake plugin:
pysys.py run -v DEBUG 'sm-fake*' -Xfakeplugin=fakeplugin -XmyPlatform=smcontainer
See file software-management-end-to-end/dummy-plugin-configuration/Info.md
on how to setup and configure the fake plugin.
|
