lava-dispatcher, installed at version: 2023.01 start: 0 validate Start time: 2023-03-02 07:25:13.711621+00:00 (UTC) Validating that https://github.com/montjoie/lava-healthchecks-binary/blob/master/images/rootfs/buildroot/x86/rootfs.cpio.gz?raw=true exists Validating that https://github.com/montjoie/lava-healthchecks-binary/blob/master/next/master/next-20190211/x86_64/bzImage?raw=true exists validate duration: 3.15 case: validate
case_id: 3882232
definition: lava
result: pass
start: 1 tftp-deploy (timeout 00:10:00) [common] start: 1.1 download-retry (timeout 00:10:00) [common] start: 1.1.1 http-download (timeout 00:10:00) [common] Not decompressing ramdisk as can be used compressed. downloading https://github.com/montjoie/lava-healthchecks-binary/blob/master/images/rootfs/buildroot/x86/rootfs.cpio.gz?raw=true saving as /var/lib/lava/dispatcher/tmp/32080/tftp-deploy-c7bv8ujw/ramdisk/rootfs.cpio.gz total size: 4012068 (3MB) progress 0% (0MB) progress 5% (0MB) progress 10% (0MB) progress 15% (0MB) progress 20% (0MB) progress 25% (0MB) progress 30% (1MB) progress 35% (1MB) progress 40% (1MB) progress 45% (1MB) progress 50% (1MB) progress 55% (2MB) progress 60% (2MB) progress 65% (2MB) progress 70% (2MB) progress 75% (2MB) progress 80% (3MB) progress 85% (3MB) progress 90% (3MB) progress 95% (3MB) progress 100% (3MB) 3MB downloaded in 1.11s (3.44MB/s) end: 1.1.1 http-download (duration 00:00:01) [common] case: http-download
case_id: 3882246
definition: lava
duration: 1.12
extra: ...
level: 1.1.1
namespace: common
result: pass
end: 1.1 download-retry (duration 00:00:01) [common] start: 1.2 download-retry (timeout 00:09:59) [common] start: 1.2.1 http-download (timeout 00:09:59) [common] downloading https://github.com/montjoie/lava-healthchecks-binary/blob/master/next/master/next-20190211/x86_64/bzImage?raw=true saving as /var/lib/lava/dispatcher/tmp/32080/tftp-deploy-c7bv8ujw/kernel/bzImage total size: 8573824 (8MB) No compression specified progress 0% (0MB) progress 5% (0MB) progress 10% (0MB) progress 15% (1MB) progress 20% (1MB) progress 25% (2MB) progress 30% (2MB) progress 35% (2MB) progress 40% (3MB) progress 45% (3MB) progress 50% (4MB) progress 55% (4MB) progress 60% (4MB) progress 65% (5MB) progress 70% (5MB) progress 75% (6MB) progress 80% (6MB) progress 85% (6MB) progress 90% (7MB) progress 95% (7MB) progress 100% (8MB) 8MB downloaded in 1.78s (4.59MB/s) end: 1.2.1 http-download (duration 00:00:02) [common] case: http-download
case_id: 3882246
definition: lava
duration: 1.78
extra: ...
level: 1.2.1
namespace: common
result: pass
end: 1.2 download-retry (duration 00:00:02) [common] start: 1.3 prepare-tftp-overlay (timeout 00:09:57) [common] start: 1.3.1 extract-nfsrootfs (timeout 00:09:57) [common] end: 1.3.1 extract-nfsrootfs (duration 00:00:00) [common] start: 1.3.2 lava-overlay (timeout 00:09:57) [common] [common] skipped lava-overlay - no test action. end: 1.3.2 lava-overlay (duration 00:00:00) [common] start: 1.3.3 extract-overlay-ramdisk (timeout 00:09:57) [common] end: 1.3.3 extract-overlay-ramdisk (duration 00:00:01) [common] start: 1.3.4 extract-modules (timeout 00:09:56) [common] end: 1.3.4 extract-modules (duration 00:00:00) [common] start: 1.3.5 apply-overlay-tftp (timeout 00:09:56) [common] end: 1.3.5 apply-overlay-tftp (duration 00:00:00) [common] start: 1.3.6 prepare-kernel (timeout 00:09:56) [common] end: 1.3.6 prepare-kernel (duration 00:00:00) [common] start: 1.3.7 configure-preseed-file (timeout 00:09:56) [common] end: 1.3.7 configure-preseed-file (duration 00:00:00) [common] start: 1.3.8 compress-ramdisk (timeout 00:09:56) [common] Building ramdisk /var/lib/lava/dispatcher/tmp/32080/extract-overlay-ramdisk-moj8yiej/ramdisk.cpio containing /var/lib/lava/dispatcher/tmp/32080/extract-overlay-ramdisk-moj8yiej/ramdisk >> 24701 blocks rename /var/lib/lava/dispatcher/tmp/32080/extract-overlay-ramdisk-moj8yiej/ramdisk.cpio.gz to /var/lib/lava/dispatcher/tmp/32080/tftp-deploy-c7bv8ujw/ramdisk/ramdisk.cpio.gz end: 1.3.8 compress-ramdisk (duration 00:00:03) [common] end: 1.3 prepare-tftp-overlay (duration 00:00:04) [common] start: 1.4 lxc-create-udev-rule-action (timeout 00:09:53) [common] No LXC device requested end: 1.4 lxc-create-udev-rule-action (duration 00:00:00) [common] Checking files for TFTP limit of 4294967296 bytes. end: 1 tftp-deploy (duration 00:00:07) [common] start: 2 grub-main-action (timeout 00:05:00) [common] start: 2.1 bootloader-from-media (timeout 00:05:00) [common] end: 2.1 bootloader-from-media (duration 00:00:00) [common] start: 2.2 bootloader-overlay (timeout 00:05:00) [common] substitutions: - {DTB}: None - {INITRD}: 32080/tftp-deploy-c7bv8ujw/ramdisk/ramdisk.cpio.gz - {KERNEL}: 32080/tftp-deploy-c7bv8ujw/kernel/bzImage - {LAVA_MAC}: None - {PRESEED_CONFIG}: None - {PRESEED_LOCAL}: None - {RAMDISK}: 32080/tftp-deploy-c7bv8ujw/ramdisk/ramdisk.cpio.gz - {ROOT_PART}: None - {ROOT}: None - {SERVER_IP}: 192.168.66.1 - {TEE}: None Parsed boot commands: - net_bootp - clear - insmod linux - clear - insmod tftp - clear - linux (tftp,192.168.66.1)/32080/tftp-deploy-c7bv8ujw/kernel/bzImage console=ttyS0,115200 ip=dhcp - clear - initrd (tftp,192.168.66.1)/32080/tftp-deploy-c7bv8ujw/ramdisk/ramdisk.cpio.gz - clear - boot end: 2.2 bootloader-overlay (duration 00:00:00) [common] start: 2.3 connect-device (timeout 00:05:00) [common] [common] connect-device Connecting to device using 'telnet 127.0.0.1 63002' Setting prompt string to ['lava-test: # '] end: 2.3 connect-device (duration 00:00:04) [common] start: 2.4 reset-device (timeout 00:04:56) [common] start: 2.4.1 pdu-reboot (timeout 00:04:56) [common] Calling: 'nice' '/usr/local/bin/acme-cli' '-s' '192.168.66.2' 'reset' '5' >> /usr/bin/nice: ‘/usr/local/bin/acme-cli’: No such file or directory Returned 127 in 4 seconds Unable to run 'nice' '['/usr/local/bin/acme-cli', '-s', '192.168.66.2', 'reset', '5']' Unable to reboot: '/usr/local/bin/acme-cli -s 192.168.66.2 reset 5' failed end: 2.4.1 pdu-reboot (duration 00:00:05) [common] case: pdu-reboot
case_id: 3882250
definition: lava
duration: 4.54
extra: ...
level: 2.4.1
namespace: common
result: fail
Unable to reboot: '/usr/local/bin/acme-cli -s 192.168.66.2 reset 5' failed end: 2.4 reset-device (duration 00:00:05) [common] case: reset-device
case_id: 3882251
definition: lava
duration: 4.55
extra: ...
level: 2.4
namespace: common
result: fail
grub-main-action failed: 1 of 1 attempts. 'Unable to reboot: '/usr/local/bin/acme-cli -s 192.168.66.2 reset 5' failed' Unable to reboot: '/usr/local/bin/acme-cli -s 192.168.66.2 reset 5' failed end: 2 grub-main-action (duration 00:00:09) [common] case: grub-main-action
case_id: 3882252
definition: lava
duration: 8.70
extra: ...
level: 2
namespace: common
result: fail
Cleaning after the job Cleaning up download directory: /var/lib/lava/dispatcher/tmp/32080/tftp-deploy-c7bv8ujw/ramdisk Cleaning up download directory: /var/lib/lava/dispatcher/tmp/32080/tftp-deploy-c7bv8ujw/kernel start: 3.1 power-off (timeout 00:00:30) [common] Calling: 'nice' '/usr/local/bin/acme-cli' '-s' '192.168.66.2' 'switch_off' '5' >> /usr/bin/nice: ‘/usr/local/bin/acme-cli’: No such file or directory Returned 127 in 4 seconds Unable to run 'nice' '['/usr/local/bin/acme-cli', '-s', '192.168.66.2', 'switch_off', '5']' Unable to power-off: '/usr/local/bin/acme-cli -s 192.168.66.2 switch_off 5' failed end: 3.1 power-off (duration 00:00:04) [common] case: power-off
case_id: 3882254
definition: lava
duration: 4.25
extra: ...
level: 3.1
namespace: common
result: fail
Failed to run 'finalize': Unable to power-off: '/usr/local/bin/acme-cli -s 192.168.66.2 switch_off 5' failed Traceback (most recent call last): File "/usr/lib/python3/dist-packages/lava_dispatcher/job.py", line 252, in run self._run() File "/usr/lib/python3/dist-packages/lava_dispatcher/job.py", line 242, in _run self.pipeline.run_actions(self.connection, max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 262, in run_actions new_connection = action.run(connection, action_max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/logical.py", line 68, in run connection = self.pipeline.run_actions(connection, max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 262, in run_actions new_connection = action.run(connection, action_max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 825, in run return self.pipeline.run_actions(connection, max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 262, in run_actions new_connection = action.run(connection, action_max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/power.py", line 119, in run self.run_cmd(cmd, error_msg="Unable to reboot: '%s' failed" % cmd) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 695, in run_cmd raise self.command_exception(error_msg) lava_common.exceptions.InfrastructureError: Unable to reboot: '/usr/local/bin/acme-cli -s 192.168.66.2 reset 5' failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/lava_dispatcher/power.py", line 351, in run connection = super().run(connection, max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 825, in run return self.pipeline.run_actions(connection, max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 262, in run_actions new_connection = action.run(connection, action_max_end_time) File "/usr/lib/python3/dist-packages/lava_dispatcher/power.py", line 244, in run self.run_cmd(cmd, error_msg="Unable to power-off: '%s' failed" % cmd) File "/usr/lib/python3/dist-packages/lava_dispatcher/action.py", line 695, in run_cmd raise self.command_exception(error_msg) lava_common.exceptions.InfrastructureError: Unable to power-off: '/usr/local/bin/acme-cli -s 192.168.66.2 switch_off 5' failed Override tmp directory removed at /var/lib/lava/dispatcher/tmp/32080 Root tmp directory removed at /var/lib/lava/dispatcher/tmp/32080 InfrastructureError: The Infrastructure is not working correctly. Please report this error to LAVA admins. case: job
case_id: 3882255
definition: lava
error_msg: Unable to reboot: '/usr/local/bin/acme-cli -s 192.168.66.2 reset 5' failed
error_type: Infrastructure
result: fail