Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 1 | Runtime Instrumentation Testing - N1SDP |
| 2 | ======================================= |
| 3 | |
| 4 | For this test we used the N1 System Development Platform (`N1SDP`_), which |
| 5 | contains an SoC consisting of two dual-core Arm N1 clusters. |
| 6 | |
Boyan Karatotev | d885590 | 2025-05-07 15:46:36 +0100 | [diff] [blame] | 7 | The following source trees were used: |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 8 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 9 | - `TF-A v2.12-rc0`_ |
| 10 | - `TFTF v2.12-rc0`_ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 11 | |
Thaddeus Serna | 8709cc9 | 2023-08-14 13:28:59 -0500 | [diff] [blame] | 12 | Please see the Runtime Instrumentation :ref:`Testing Methodology |
Boyan Karatotev | d885590 | 2025-05-07 15:46:36 +0100 | [diff] [blame] | 13 | <Runtime Instrumentation Methodology>` page for more details. The tests were ran |
| 14 | using the |
| 15 | `tf-psci-lava-instr/n1sdp-runtime-instrumentation,n1sdp-runtime-instrumentation:n1sdp-fip.tftf-firmware` |
| 16 | configuration in CI. |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 17 | |
| 18 | Results |
| 19 | ------- |
| 20 | |
| 21 | ``CPU_SUSPEND`` to deepest power level |
| 22 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 23 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 24 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in parallel (v2.12) |
| 25 | |
| 26 | +---------+------+----------------+--------+----------------+ |
| 27 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 28 | +---------+------+----------------+--------+----------------+ |
| 29 | | 0 | 0 | 2.58 | 24.14 | 0.28 (-69.57%) | |
| 30 | +---------+------+----------------+--------+----------------+ |
| 31 | | 0 | 0 | 4.24 (-32.27%) | 40.1 | 0.3 | |
| 32 | +---------+------+----------------+--------+----------------+ |
| 33 | | 1 | 0 | 3.58 | 35.54 | 0.28 | |
| 34 | +---------+------+----------------+--------+----------------+ |
| 35 | | 1 | 0 | 3.28 | 42.36 | 0.3 | |
| 36 | +---------+------+----------------+--------+----------------+ |
| 37 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 38 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in parallel (v2.11) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 39 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 40 | +---------+------+----------------+--------+----------------+ |
| 41 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 42 | +---------+------+----------------+--------+----------------+ |
| 43 | | 0 | 0 | 3.0 (+41.51%) | 23.14 | 1.2 (+185.71%) | |
| 44 | +---------+------+----------------+--------+----------------+ |
| 45 | | 0 | 0 | 4.6 | 35.86 | 0.3 | |
| 46 | +---------+------+----------------+--------+----------------+ |
| 47 | | 1 | 0 | 3.68 (+33.33%) | 33.36 | 0.3 | |
| 48 | +---------+------+----------------+--------+----------------+ |
| 49 | | 1 | 0 | 3.7 (+40.15%) | 38.1 | 0.28 | |
| 50 | +---------+------+----------------+--------+----------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 51 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 52 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in serial (v2.12) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 53 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 54 | +---------+------+-----------+--------+-------------+ |
| 55 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 56 | +---------+------+-----------+--------+-------------+ |
| 57 | | 0 | 0 | 1.9 | 23.8 | 0.36 | |
| 58 | +---------+------+-----------+--------+-------------+ |
| 59 | | 0 | 0 | 2.26 | 23.86 | 0.34 | |
| 60 | +---------+------+-----------+--------+-------------+ |
| 61 | | 1 | 0 | 2.02 | 23.4 | 0.36 | |
| 62 | +---------+------+-----------+--------+-------------+ |
| 63 | | 1 | 0 | 2.24 | 23.84 | 0.36 | |
| 64 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 65 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 66 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in serial (v2.11) |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 67 | |
| 68 | +---------+------+-----------+--------+-------------+ |
| 69 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 70 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 71 | | 0 | 0 | 1.7 | 22.46 | 0.3 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 72 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 73 | | 0 | 0 | 2.28 | 22.5 | 0.3 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 74 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 75 | | 1 | 0 | 2.14 | 21.5 | 0.32 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 76 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 77 | | 1 | 0 | 2.24 | 22.66 | 0.3 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 78 | +---------+------+-----------+--------+-------------+ |
| 79 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 80 | ``CPU_SUSPEND`` to power level 0 |
| 81 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 82 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 83 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in parallel (v2.12) |
| 84 | |
| 85 | +---------+------+-----------+--------+----------------+ |
| 86 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 87 | +---------+------+-----------+--------+----------------+ |
| 88 | | 0 | 0 | 1.46 | 31.7 | 0.32 | |
| 89 | +---------+------+-----------+--------+----------------+ |
| 90 | | 0 | 0 | 2.06 | 35.5 | 0.48 (+60.00%) | |
| 91 | +---------+------+-----------+--------+----------------+ |
| 92 | | 1 | 0 | 1.96 | 35.7 | 0.32 | |
| 93 | +---------+------+-----------+--------+----------------+ |
| 94 | | 1 | 0 | 2.08 | 23.38 | 0.28 | |
| 95 | +---------+------+-----------+--------+----------------+ |
| 96 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 97 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in parallel (v2.11) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 98 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 99 | +---------+------+----------------+--------+-------------+ |
| 100 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 101 | +---------+------+----------------+--------+-------------+ |
| 102 | | 0 | 0 | 0.94 (-37.33%) | 30.36 | 0.3 | |
| 103 | +---------+------+----------------+--------+-------------+ |
| 104 | | 0 | 0 | 2.12 | 33.12 | 0.28 | |
| 105 | +---------+------+----------------+--------+-------------+ |
| 106 | | 1 | 0 | 2.08 | 32.56 | 0.3 | |
| 107 | +---------+------+----------------+--------+-------------+ |
| 108 | | 1 | 0 | 2.14 | 21.92 | 0.28 | |
| 109 | +---------+------+----------------+--------+-------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 110 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 111 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in serial (v2.12) |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 112 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 113 | +---------+------+-----------+--------+----------------+ |
| 114 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 115 | +---------+------+-----------+--------+----------------+ |
| 116 | | 0 | 0 | 1.66 | 23.22 | 0.36 | |
| 117 | +---------+------+-----------+--------+----------------+ |
| 118 | | 0 | 0 | 2.58 | 23.72 | 0.78 (+85.71%) | |
| 119 | +---------+------+-----------+--------+----------------+ |
| 120 | | 1 | 0 | 2.02 | 23.84 | 0.38 | |
| 121 | +---------+------+-----------+--------+----------------+ |
| 122 | | 1 | 0 | 2.16 | 23.92 | 0.34 | |
| 123 | +---------+------+-----------+--------+----------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 124 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 125 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in serial (v2.11) |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 126 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 127 | +---------+------+-----------+--------+-------------+ |
| 128 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 129 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 130 | | 0 | 0 | 1.64 | 21.88 | 0.34 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 131 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 132 | | 0 | 0 | 2.42 | 21.76 | 0.34 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 133 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 134 | | 1 | 0 | 2.02 | 21.14 | 0.32 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 135 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 136 | | 1 | 0 | 2.18 | 22.3 | 0.34 | |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 137 | +---------+------+-----------+--------+-------------+ |
| 138 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 139 | ``CPU_OFF`` on all non-lead CPUs |
| 140 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 141 | |
| 142 | ``CPU_OFF`` on all non-lead CPUs in sequence then, ``CPU_SUSPEND`` on the lead |
| 143 | core to the deepest power level. |
| 144 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 145 | .. table:: ``CPU_OFF`` latencies (µs) on all non-lead CPUs (v2.12) |
| 146 | |
| 147 | +---------+------+-----------+--------+----------------+ |
| 148 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 149 | +---------+------+-----------+--------+----------------+ |
| 150 | | 0 | 0 | 1.84 | 23.82 | 0.36 | |
| 151 | +---------+------+-----------+--------+----------------+ |
| 152 | | 0 | 0 | 14.18 | 31.78 | 0.56 (+86.67%) | |
| 153 | +---------+------+-----------+--------+----------------+ |
| 154 | | 1 | 0 | 13.64 | 30.54 | 0.36 | |
| 155 | +---------+------+-----------+--------+----------------+ |
| 156 | | 1 | 0 | 14.18 | 31.82 | 0.68 | |
| 157 | +---------+------+-----------+--------+----------------+ |
| 158 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 159 | .. table:: ``CPU_OFF`` latencies (µs) on all non-lead CPUs (v2.11) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 160 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 161 | +---------+------+-----------+--------+----------------+ |
| 162 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 163 | +---------+------+-----------+--------+----------------+ |
| 164 | | 0 | 0 | 1.96 | 22.44 | 0.38 | |
| 165 | +---------+------+-----------+--------+----------------+ |
| 166 | | 0 | 0 | 13.76 | 30.34 | 0.26 | |
| 167 | +---------+------+-----------+--------+----------------+ |
| 168 | | 1 | 0 | 13.46 | 28.28 | 0.24 | |
| 169 | +---------+------+-----------+--------+----------------+ |
| 170 | | 1 | 0 | 13.84 | 30.06 | 0.28 (-60.00%) | |
| 171 | +---------+------+-----------+--------+----------------+ |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 172 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 173 | ``CPU_VERSION`` in parallel |
| 174 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 175 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 176 | .. table:: ``CPU_VERSION`` latency (µs) in parallel on all cores (v2.12) |
| 177 | |
| 178 | +----------+------+-------------------+ |
| 179 | | Cluster | Core | Latency | |
| 180 | +----------+------+-------------------+ |
| 181 | | 0 | 0 | 0.14 | |
| 182 | +----------+------+-------------------+ |
| 183 | | 0 | 0 | 0.2 (-28.57%) | |
| 184 | +----------+------+-------------------+ |
| 185 | | 1 | 0 | 0.2 | |
| 186 | +----------+------+-------------------+ |
| 187 | | 1 | 0 | 0.26 | |
| 188 | +----------+------+-------------------+ |
| 189 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 190 | .. table:: ``CPU_VERSION`` latency (µs) in parallel on all cores (v2.11) |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 191 | |
Harrison Mutai | e210274 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 192 | +-------------+--------+--------------+ |
| 193 | | Cluster | Core | Latency | |
| 194 | +-------------+--------+--------------+ |
| 195 | | 0 | 0 | 0.12 | |
| 196 | +-------------+--------+--------------+ |
| 197 | | 0 | 0 | 0.24 | |
| 198 | +-------------+--------+--------------+ |
| 199 | | 1 | 0 | 0.2 | |
| 200 | +-------------+--------+--------------+ |
| 201 | | 1 | 0 | 0.26 | |
| 202 | +-------------+--------+--------------+ |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 203 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 204 | -------------- |
| 205 | |
Boyan Karatotev | d885590 | 2025-05-07 15:46:36 +0100 | [diff] [blame] | 206 | *Copyright (c) 2023-2025, Arm Limited. All rights reserved.* |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 207 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 208 | .. _TF-A v2.12-rc0: https://review.trustedfirmware.org/plugins/gitiles/TF-A/trusted-firmware-a/+/refs/tags/v2.12-rc0 |
| 209 | .. _TFTF v2.12-rc0: https://review.trustedfirmware.org/plugins/gitiles/TF-A/tf-a-tests/+/refs/tags/v2.12-rc0 |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 210 | .. _user guide: https://gitlab.arm.com/arm-reference-solutions/arm-reference-solutions-docs/-/blob/master/docs/n1sdp/user-guide.rst |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 211 | .. _N1SDP: https://developer.arm.com/documentation/101489/latest |