Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 1 | Runtime Instrumentation Testing - N1SDP |
| 2 | ======================================= |
| 3 | |
| 4 | For this test we used the N1 System Development Platform (`N1SDP`_), which |
| 5 | contains an SoC consisting of two dual-core Arm N1 clusters. |
| 6 | |
Boyan Karatotev | d885590 | 2025-05-07 15:46:36 +0100 | [diff] [blame] | 7 | The following source trees were used: |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 8 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 9 | - `TF-A v2.13-rc0`_ |
| 10 | - `TFTF v2.13-rc0`_ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 11 | |
Thaddeus Serna | 8709cc9 | 2023-08-14 13:28:59 -0500 | [diff] [blame] | 12 | Please see the Runtime Instrumentation :ref:`Testing Methodology |
Boyan Karatotev | d885590 | 2025-05-07 15:46:36 +0100 | [diff] [blame] | 13 | <Runtime Instrumentation Methodology>` page for more details. The tests were ran |
| 14 | using the |
| 15 | `tf-psci-lava-instr/n1sdp-runtime-instrumentation,n1sdp-runtime-instrumentation:n1sdp-fip.tftf-firmware` |
| 16 | configuration in CI. |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 17 | |
| 18 | Results |
| 19 | ------- |
| 20 | |
| 21 | ``CPU_SUSPEND`` to deepest power level |
| 22 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 23 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 24 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in parallel (v2.13) |
| 25 | |
| 26 | +---------+------+----------------+-----------------+----------------+ |
| 27 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 28 | +---------+------+----------------+-----------------+----------------+ |
| 29 | | 0 | 0 | 3.32 | 13.42 (-45.40%) | 0.28 (-69.57%) | |
| 30 | +---------+------+----------------+-----------------+----------------+ |
| 31 | | 0 | 0 | 4.02 (-35.78%) | 18.14 (-52.88%) | 0.28 | |
| 32 | +---------+------+----------------+-----------------+----------------+ |
| 33 | | 1 | 0 | 2.7 (-27.42%) | 17.38 (-49.36%) | 0.26 | |
| 34 | +---------+------+----------------+-----------------+----------------+ |
| 35 | | 1 | 0 | 2.96 | 10.86 (-73.64%) | 0.26 | |
| 36 | +---------+------+----------------+-----------------+----------------+ |
| 37 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 38 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in parallel (v2.12) |
| 39 | |
| 40 | +---------+------+----------------+--------+----------------+ |
| 41 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 42 | +---------+------+----------------+--------+----------------+ |
| 43 | | 0 | 0 | 2.58 | 24.14 | 0.28 (-69.57%) | |
| 44 | +---------+------+----------------+--------+----------------+ |
| 45 | | 0 | 0 | 4.24 (-32.27%) | 40.1 | 0.3 | |
| 46 | +---------+------+----------------+--------+----------------+ |
| 47 | | 1 | 0 | 3.58 | 35.54 | 0.28 | |
| 48 | +---------+------+----------------+--------+----------------+ |
| 49 | | 1 | 0 | 3.28 | 42.36 | 0.3 | |
| 50 | +---------+------+----------------+--------+----------------+ |
| 51 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 52 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in serial (v2.13) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 53 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 54 | +---------+------+-----------+-----------------+----------------+ |
| 55 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 56 | +---------+------+-----------+-----------------+----------------+ |
| 57 | | 0 | 0 | 1.62 | 10.14 (-58.10%) | 0.3 | |
| 58 | +---------+------+-----------+-----------------+----------------+ |
| 59 | | 0 | 0 | 1.86 | 10.62 (-56.44%) | 0.28 (-26.32%) | |
| 60 | +---------+------+-----------+-----------------+----------------+ |
| 61 | | 1 | 0 | 1.8 | 10.16 (-57.84%) | 0.32 | |
| 62 | +---------+------+-----------+-----------------+----------------+ |
| 63 | | 1 | 0 | 2.16 | 10.6 (-56.84%) | 0.5 (+56.25%) | |
| 64 | +---------+------+-----------+-----------------+----------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 65 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 66 | .. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in serial (v2.12) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 67 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 68 | +---------+------+-----------+--------+-------------+ |
| 69 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 70 | +---------+------+-----------+--------+-------------+ |
| 71 | | 0 | 0 | 1.9 | 23.8 | 0.36 | |
| 72 | +---------+------+-----------+--------+-------------+ |
| 73 | | 0 | 0 | 2.26 | 23.86 | 0.34 | |
| 74 | +---------+------+-----------+--------+-------------+ |
| 75 | | 1 | 0 | 2.02 | 23.4 | 0.36 | |
| 76 | +---------+------+-----------+--------+-------------+ |
| 77 | | 1 | 0 | 2.24 | 23.84 | 0.36 | |
| 78 | +---------+------+-----------+--------+-------------+ |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 79 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 80 | ``CPU_SUSPEND`` to power level 0 |
| 81 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 82 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 83 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in parallel (v2.13) |
| 84 | |
| 85 | +---------+------+----------------+-----------------+---------------+ |
| 86 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 87 | +---------+------+----------------+-----------------+---------------+ |
| 88 | | 0 | 0 | 0.8 (-57.45%) | 11.98 (-61.75%) | 0.26 | |
| 89 | +---------+------+----------------+-----------------+---------------+ |
| 90 | | 0 | 0 | 1.54 (-30.63%) | 16.44 (-53.74%) | 0.26 | |
| 91 | +---------+------+----------------+-----------------+---------------+ |
| 92 | | 1 | 0 | 1.62 (-30.77%) | 16.1 (-53.92%) | 0.3 | |
| 93 | +---------+------+----------------+-----------------+---------------+ |
| 94 | | 1 | 0 | 1.8 | 10.54 (-55.30%) | 0.2 (-33.33%) | |
| 95 | +---------+------+----------------+-----------------+---------------+ |
| 96 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 97 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in parallel (v2.12) |
| 98 | |
| 99 | +---------+------+-----------+--------+----------------+ |
| 100 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 101 | +---------+------+-----------+--------+----------------+ |
| 102 | | 0 | 0 | 1.46 | 31.7 | 0.32 | |
| 103 | +---------+------+-----------+--------+----------------+ |
| 104 | | 0 | 0 | 2.06 | 35.5 | 0.48 (+60.00%) | |
| 105 | +---------+------+-----------+--------+----------------+ |
| 106 | | 1 | 0 | 1.96 | 35.7 | 0.32 | |
| 107 | +---------+------+-----------+--------+----------------+ |
| 108 | | 1 | 0 | 2.08 | 23.38 | 0.28 | |
| 109 | +---------+------+-----------+--------+----------------+ |
| 110 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 111 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in serial (v2.13) |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 112 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 113 | +---------+------+----------------+-----------------+----------------+ |
| 114 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 115 | +---------+------+----------------+-----------------+----------------+ |
| 116 | | 0 | 0 | 1.44 | 9.9 (-58.05%) | 0.3 | |
| 117 | +---------+------+----------------+-----------------+----------------+ |
| 118 | | 0 | 0 | 1.74 (-25.64%) | 10.4 (-56.23%) | 0.28 (-33.33%) | |
| 119 | +---------+------+----------------+-----------------+----------------+ |
| 120 | | 1 | 0 | 1.8 | 10.04 (-57.71%) | 0.34 | |
| 121 | +---------+------+----------------+-----------------+----------------+ |
| 122 | | 1 | 0 | 1.96 | 10.46 (-56.23%) | 0.44 | |
| 123 | +---------+------+----------------+-----------------+----------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 124 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 125 | .. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in serial (v2.12) |
Harrison Mutai | 480f0f6 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 126 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 127 | +---------+------+-----------+--------+----------------+ |
| 128 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 129 | +---------+------+-----------+--------+----------------+ |
| 130 | | 0 | 0 | 1.66 | 23.22 | 0.36 | |
| 131 | +---------+------+-----------+--------+----------------+ |
| 132 | | 0 | 0 | 2.58 | 23.72 | 0.78 (+85.71%) | |
| 133 | +---------+------+-----------+--------+----------------+ |
| 134 | | 1 | 0 | 2.02 | 23.84 | 0.38 | |
| 135 | +---------+------+-----------+--------+----------------+ |
| 136 | | 1 | 0 | 2.16 | 23.92 | 0.34 | |
| 137 | +---------+------+-----------+--------+----------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 138 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 139 | ``CPU_OFF`` on all non-lead CPUs |
| 140 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
| 141 | |
| 142 | ``CPU_OFF`` on all non-lead CPUs in sequence then, ``CPU_SUSPEND`` on the lead |
| 143 | core to the deepest power level. |
| 144 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 145 | .. table:: ``CPU_OFF`` latencies (µs) on all non-lead CPUs (v2.13) |
| 146 | |
| 147 | +---------+------+-----------+-----------------+---------------+ |
| 148 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 149 | +---------+------+-----------+-----------------+---------------+ |
| 150 | | 0 | 0 | 1.64 | 10.24 (-57.72%) | 0.3 | |
| 151 | +---------+------+-----------+-----------------+---------------+ |
| 152 | | 0 | 0 | 13.92 | 17.7 (-43.74%) | 0.3 | |
| 153 | +---------+------+-----------+-----------------+---------------+ |
| 154 | | 1 | 0 | 13.54 | 16.74 (-44.90%) | 0.3 (-37.50%) | |
| 155 | +---------+------+-----------+-----------------+---------------+ |
| 156 | | 1 | 0 | 14.12 | 18.28 (-41.93%) | 0.3 (-44.44%) | |
| 157 | +---------+------+-----------+-----------------+---------------+ |
| 158 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 159 | .. table:: ``CPU_OFF`` latencies (µs) on all non-lead CPUs (v2.12) |
| 160 | |
| 161 | +---------+------+-----------+--------+----------------+ |
| 162 | | Cluster | Core | Powerdown | Wakeup | Cache Flush | |
| 163 | +---------+------+-----------+--------+----------------+ |
| 164 | | 0 | 0 | 1.84 | 23.82 | 0.36 | |
| 165 | +---------+------+-----------+--------+----------------+ |
| 166 | | 0 | 0 | 14.18 | 31.78 | 0.56 (+86.67%) | |
| 167 | +---------+------+-----------+--------+----------------+ |
| 168 | | 1 | 0 | 13.64 | 30.54 | 0.36 | |
| 169 | +---------+------+-----------+--------+----------------+ |
| 170 | | 1 | 0 | 14.18 | 31.82 | 0.68 | |
| 171 | +---------+------+-----------+--------+----------------+ |
| 172 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 173 | ``CPU_VERSION`` in parallel |
| 174 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 175 | .. table:: ``CPU_VERSION`` latency (µs) in parallel on all cores (v2.13) |
| 176 | |
| 177 | +----------+------+-------------------+ |
| 178 | | Cluster | Core | Latency | |
| 179 | +----------+------+-------------------+ |
| 180 | | 0 | 0 | 0.12 | |
| 181 | +----------+------+-------------------+ |
| 182 | | 0 | 0 | 0.2 (-28.57%) | |
| 183 | +----------+------+-------------------+ |
| 184 | | 1 | 0 | 0.2 | |
| 185 | +----------+------+-------------------+ |
| 186 | | 1 | 0 | 0.24 (-25.00%) | |
| 187 | +----------+------+-------------------+ |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 188 | |
Zachary Leaf | 02d85f8 | 2024-11-15 12:47:17 +0000 | [diff] [blame] | 189 | .. table:: ``CPU_VERSION`` latency (µs) in parallel on all cores (v2.12) |
| 190 | |
| 191 | +----------+------+-------------------+ |
| 192 | | Cluster | Core | Latency | |
| 193 | +----------+------+-------------------+ |
| 194 | | 0 | 0 | 0.14 | |
| 195 | +----------+------+-------------------+ |
| 196 | | 0 | 0 | 0.2 (-28.57%) | |
| 197 | +----------+------+-------------------+ |
| 198 | | 1 | 0 | 0.2 | |
| 199 | +----------+------+-------------------+ |
| 200 | | 1 | 0 | 0.26 | |
| 201 | +----------+------+-------------------+ |
| 202 | |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 203 | -------------- |
| 204 | |
Boyan Karatotev | d885590 | 2025-05-07 15:46:36 +0100 | [diff] [blame] | 205 | *Copyright (c) 2023-2025, Arm Limited. All rights reserved.* |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 206 | |
Boyan Karatotev | 8f20e6b | 2025-05-07 09:03:51 +0100 | [diff] [blame] | 207 | .. _TF-A v2.13-rc0: https://review.trustedfirmware.org/plugins/gitiles/TF-A/trusted-firmware-a/+/refs/tags/v2.13-rc0 |
| 208 | .. _TFTF v2.13-rc0: https://review.trustedfirmware.org/plugins/gitiles/TF-A/tf-a-tests/+/refs/tags/v2.13-rc0 |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 209 | .. _user guide: https://gitlab.arm.com/arm-reference-solutions/arm-reference-solutions-docs/-/blob/master/docs/n1sdp/user-guide.rst |
Harrison Mutai | fa2fd89 | 2023-05-11 09:50:31 +0100 | [diff] [blame] | 210 | .. _N1SDP: https://developer.arm.com/documentation/101489/latest |