Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.44.0-wmf.2 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 1516 2243153 2239866 2024-11-08T23:24:38Z Stashbot 7414 AntiComposite: Restarting all CVNBots due to simultaneous RCReader disconnect 54323.128318 seconds ago 2243153 wikitext text/x-wiki hpn56kg8hof0g6ckziflqq42git0ies 0 4108 2243156 2242420 2024-11-09T02:00:36Z DeploymentCalendarTool 20896 Remove Week of November 04 2243156 wikitext text/x-wiki jm316vsqtra1459l8mjdymdbktiq5vo 0 7919 2242822 2242821 2024-11-08T11:59:37Z Stashbot 7414 apergos: testing of account creation backfill script on mwmaint2001 complete for the moment 2242822 wikitext text/x-wiki jc8j3wb34g3z6y7deo2xguxsn9rllqy 2242824 2242822 2024-11-08T12:04:45Z Stashbot 7414 elukey@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2087.codfw.wmnet with OS bullseye 2242824 wikitext text/x-wiki 5k2z81oe2s2affajfurjoojikle00c8 2242825 2242824 2024-11-08T12:07:31Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1002" 2242825 wikitext text/x-wiki mf2t7rhxrj3qf2uw0twz7aumnnm99q9 2242826 2242825 2024-11-08T12:28:29Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply 2242826 wikitext text/x-wiki oyuxglr81rmh8bvn3zrruw1nkssdmjy 2242827 2242826 2024-11-08T12:29:43Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply 2242827 wikitext text/x-wiki mymldsju664d86n23t0bmy36igw2kq0 2242828 2242827 2024-11-08T12:30:02Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply 2242828 wikitext text/x-wiki q6peupkzn79plte1tyywy3d73o9xfy7 2242829 2242828 2024-11-08T12:30:13Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply 2242829 wikitext text/x-wiki c6256hsam5kvgi1dizqji83d8wremlk 2242830 2242829 2024-11-08T12:30:54Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2242830 wikitext text/x-wiki lhfwmsv0sjgyog2aazpv5bdch2fx1go 2242831 2242830 2024-11-08T12:32:05Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2242831 wikitext text/x-wiki ars5snqs4b9zlmpqi298ex1etdq2c1m 2242834 2242831 2024-11-08T13:29:58Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2242834 wikitext text/x-wiki 29da7seouvqawe148z7wsrxxgcrxz6s 2242835 2242834 2024-11-08T13:30:16Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2242835 wikitext text/x-wiki na2ouvfu4p29dw3a50gyyu5q7o4m7jl 2242836 2242835 2024-11-08T13:31:08Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2242836 wikitext text/x-wiki jae0dhy7w9guggonb2e4ixwq9y21a6h 2242842 2242836 2024-11-08T14:18:35Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1002" 2242842 wikitext text/x-wiki g9g3aj0oty6w79vjcmnhre3c8910e92 2242843 2242842 2024-11-08T14:18:52Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2086.codfw.wmnet with OS bullseye 2242843 wikitext text/x-wiki rdovkq5rewgt50ips4g47q2udl6bd4m 2242844 2242843 2024-11-08T14:27:55Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2128'] 2242844 wikitext text/x-wiki 7ist012kibygerxdqefh4nzasqmpzzt 2242845 2242844 2024-11-08T14:28:10Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2128'] 2242845 wikitext text/x-wiki hjcl1zg5aa04wo24kapbszl0xwi35ph 2242846 2242845 2024-11-08T14:28:19Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2129'] 2242846 wikitext text/x-wiki 09yr64nyrdmlihhwyfu1drn6pw6it1f 2242847 2242846 2024-11-08T14:28:34Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2129'] 2242847 wikitext text/x-wiki qzxzhr0o82wbho4cs6xqxsv5a5qyttn 2242848 2242847 2024-11-08T14:28:47Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2136'] 2242848 wikitext text/x-wiki f10e4tvwmgz641cbrrl5ns3lp8kgtfk 2242849 2242848 2024-11-08T14:28:58Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2136'] 2242849 wikitext text/x-wiki en4r4iw1ahf0butcw0w53bqsg1i9db7 2242850 2242849 2024-11-08T14:29:03Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2137'] 2242850 wikitext text/x-wiki jeqhqugkrhicm8metv5o9bntql9ns1f 2242851 2242850 2024-11-08T14:29:13Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2137'] 2242851 wikitext text/x-wiki 8k49bkdblbe1ich2216mkdzf240iafp 2242852 2242851 2024-11-08T14:29:22Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2138'] 2242852 wikitext text/x-wiki im85utqxyyrjimejx3qj1efum9vhwaa 2242853 2242852 2024-11-08T14:29:37Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2138'] 2242853 wikitext text/x-wiki m91nnc9u91hyeav2hpv8j90rfw34yqd 2242854 2242853 2024-11-08T14:29:46Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2139'] 2242854 wikitext text/x-wiki 86hwfe9869rdzw865eeovcq9w706jyn 2242855 2242854 2024-11-08T14:29:55Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2139'] 2242855 wikitext text/x-wiki j3kbcrbxx84u9o6is49uf92kl7ldxk1 2242856 2242855 2024-11-08T14:30:07Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2140'] 2242856 wikitext text/x-wiki b58oz7q5ri5l723ktokoledmga37454 2242857 2242856 2024-11-08T14:30:27Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2140'] 2242857 wikitext text/x-wiki o88akbuhg9noaoina5xbzaxzm6k5t2y 2242858 2242857 2024-11-08T14:30:46Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2141'] 2242858 wikitext text/x-wiki t7w1eay8lnroavpns7ttvxbh2jqo9op 2242860 2242858 2024-11-08T14:31:47Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2141'] 2242860 wikitext text/x-wiki f786mq5xre44gfkt7whob8piioxgwrj 2242861 2242860 2024-11-08T14:31:56Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2142'] 2242861 wikitext text/x-wiki jd87k2inpkvudsxgmo7o0uqyk1tdeij 2242862 2242861 2024-11-08T14:32:58Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2142'] 2242862 wikitext text/x-wiki jtppkshjfsr05bvrszgqveaf23k7f6t 2242863 2242862 2024-11-08T14:33:17Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2143'] 2242863 wikitext text/x-wiki oiddj6m4d2vmrpjnzmze5bd4e1tc0ze 2242864 2242863 2024-11-08T14:33:32Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2143'] 2242864 wikitext text/x-wiki l4i8i3qbson019050dr2bjzeme9audt 2242865 2242864 2024-11-08T14:33:37Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2144'] 2242865 wikitext text/x-wiki cyntmvl4q61zu07mamci1nex826jnbl 2242866 2242865 2024-11-08T14:33:42Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['wikikube-worker2144'] 2242866 wikitext text/x-wiki tdcjbejsgzbch7vizax8qj7v8elz320 2242867 2242866 2024-11-08T14:33:43Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2144'] 2242867 wikitext text/x-wiki 122m74vspkzdlox8gw36rjrcrgs2234 2242868 2242867 2024-11-08T14:33:45Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2144'] 2242868 wikitext text/x-wiki h1plx7iss4mxnrinmi3q1bz9bv5stn4 2242869 2242868 2024-11-08T14:33:47Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2145'] 2242869 wikitext text/x-wiki sr6irzztg99tbg70wk8vamob9q4o3og 2242870 2242869 2024-11-08T14:33:49Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2145'] 2242870 wikitext text/x-wiki bw6uhbjs2pwhnz9gfwl2ii2pyy6xdqe 2242871 2242870 2024-11-08T14:33:57Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2156'] 2242871 wikitext text/x-wiki 2potgrt3espg73dhdlnaxlz2uk27vsn 2242872 2242871 2024-11-08T14:33:58Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['wikikube-worker2156'] 2242872 wikitext text/x-wiki rf3i1cbynfi4vfl81xsmkn0ggc03o5n 2242873 2242872 2024-11-08T14:34:00Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2156'] 2242873 wikitext text/x-wiki 9hwhemwj6cgagoe7p4x2wjs534jvk9e 2242874 2242873 2024-11-08T14:34:02Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2156'] 2242874 wikitext text/x-wiki pna38vac09gdx1imi7yslqmp4wdg7i8 2242875 2242874 2024-11-08T14:34:04Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2157'] 2242875 wikitext text/x-wiki dxlm7rrz1ivon3frwamnp2momnqz4o8 2242876 2242875 2024-11-08T14:34:06Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2157'] 2242876 wikitext text/x-wiki k09yh91im3gaqcxkvphqt0mv5znyq71 2242877 2242876 2024-11-08T14:34:08Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2158'] 2242877 wikitext text/x-wiki 3n7g6xhjch361r70z8veemx96nwanbo 2242878 2242877 2024-11-08T14:34:10Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2158'] 2242878 wikitext text/x-wiki 4pcvjiql0wcq5ka2gmfp06w6kfv070l 2242880 2242878 2024-11-08T14:34:44Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['wikikube-worker2128'] 2242880 wikitext text/x-wiki n8687lwyorcp27d9801yjq2ixyx5hfq 2242881 2242880 2024-11-08T14:35:02Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['wikikube-worker2128'] 2242881 wikitext text/x-wiki m1g4dua4al75j1imz3u470x98rfwuqg 2242882 2242881 2024-11-08T14:37:16Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2242882 wikitext text/x-wiki mvn0wfqnpooblvz8wl0pvrc99skuf0b 2242883 2242882 2024-11-08T14:38:21Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2128.codfw.wmnet with OS bookworm 2242883 wikitext text/x-wiki j0lvspn7xgvj0hjm41hzuk05ja4uszx 2242884 2242883 2024-11-08T14:38:27Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2129.codfw.wmnet with OS bookworm 2242884 wikitext text/x-wiki n0pk3pmsp9fvx6c7s7qw9xkihqmi22y 2242885 2242884 2024-11-08T14:38:39Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2136.codfw.wmnet with OS bookworm 2242885 wikitext text/x-wiki j9v2s5z5wogqgauexb7upcgi03aywo3 2242886 2242885 2024-11-08T14:38:41Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2242886 wikitext text/x-wiki iq67d0r6u5m4qy551arr6qqe7ckr4u3 2242887 2242886 2024-11-08T14:38:52Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2137.codfw.wmnet with OS bookworm 2242887 wikitext text/x-wiki i0ek088qhsd3yssexboz6jbmm9f5fpq 2242888 2242887 2024-11-08T14:39:00Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2138.codfw.wmnet with OS bookworm 2242888 wikitext text/x-wiki hpxmg5y5au932jyngzyajc76yc274pk 2242889 2242888 2024-11-08T14:41:46Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.reimage for host ms-be2087.codfw.wmnet with OS bullseye 2242889 wikitext text/x-wiki i0wy0syby6prx9axbu1wd6gpxdfpwgw 2242890 2242889 2024-11-08T14:42:11Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2139.codfw.wmnet with OS bookworm 2242890 wikitext text/x-wiki cp2hawfu892y1k1v1e2tyx4wxt0z11w 2242891 2242890 2024-11-08T14:42:24Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2140.codfw.wmnet with OS bookworm 2242891 wikitext text/x-wiki 5e66eguj9l9k7fxzcgt4pl1oo0g8sm4 2242892 2242891 2024-11-08T14:42:35Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2141.codfw.wmnet with OS bookworm 2242892 wikitext text/x-wiki ozfxofp29u9rpmjnviojgez6hqkzajp 2242893 2242892 2024-11-08T14:42:49Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2142.codfw.wmnet with OS bookworm 2242893 wikitext text/x-wiki gc6tbxupu8siu8ggya8yu0nvd92jpnm 2242894 2242893 2024-11-08T14:42:54Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2143.codfw.wmnet with OS bookworm 2242894 wikitext text/x-wiki 30qi8btpclwp893hq9lb1vg0ymgnmsv 2242895 2242894 2024-11-08T14:52:56Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2087.codfw.wmnet with reason: host reimage 2242895 wikitext text/x-wiki 78cy65181obz1zxofqewuu8l2b6i7sp 2242896 2242895 2024-11-08T14:55:32Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2242896 wikitext text/x-wiki 5qd7s0pk33ekhg4o7kbo5u0kpwg1b1w 2242897 2242896 2024-11-08T14:56:50Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2087.codfw.wmnet with reason: host reimage 2242897 wikitext text/x-wiki hxq1h1w6nbt64qgsd7zl6ytbb8v0eiv 2242898 2242897 2024-11-08T14:56:52Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2128.codfw.wmnet with reason: host reimage 2242898 wikitext text/x-wiki ti2sbim981fuxlrm3cmdl4z5u520zue 2242899 2242898 2024-11-08T14:56:56Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2129.codfw.wmnet with reason: host reimage 2242899 wikitext text/x-wiki 8ul9ku61l50ypappta0j2xflmffxkbf 2242900 2242899 2024-11-08T14:56:58Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2137.codfw.wmnet with reason: host reimage 2242900 wikitext text/x-wiki 14pu99izdrbc48ysq4251i8orfg21s0 2242901 2242900 2024-11-08T14:57:05Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2136.codfw.wmnet with reason: host reimage 2242901 wikitext text/x-wiki qqyoa49somkx3llnd91ilab8xdth68x 2242902 2242901 2024-11-08T14:58:28Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2138.codfw.wmnet with reason: host reimage 2242902 wikitext text/x-wiki el9mdfjiva7l9a546ye45oo4d3h0wk1 2242903 2242902 2024-11-08T15:00:15Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2128.codfw.wmnet with reason: host reimage 2242903 wikitext text/x-wiki jdyj2n9m3lqfolrw92id4wfhh4g7jxu 2242904 2242903 2024-11-08T15:00:54Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2140.codfw.wmnet with reason: host reimage 2242904 wikitext text/x-wiki msuubw97fticicrwawcmz851wszyw1e 2242905 2242904 2024-11-08T15:01:08Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2141.codfw.wmnet with reason: host reimage 2242905 wikitext text/x-wiki 9hhpg25a23mqw2gesklop6bv3ml8xnv 2242906 2242905 2024-11-08T15:01:15Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2143.codfw.wmnet with reason: host reimage 2242906 wikitext text/x-wiki 10hbtnruq50ayfq1u6fszprthpuvigt 2242907 2242906 2024-11-08T15:01:17Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2142.codfw.wmnet with reason: host reimage 2242907 wikitext text/x-wiki 7y8j5jzvkxgjv89f040i5u8di97atoj 2242908 2242907 2024-11-08T15:03:22Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2137.codfw.wmnet with reason: host reimage 2242908 wikitext text/x-wiki 3k2stgfgfiw063t9nfad0zi1b7mf1ri 2242909 2242908 2024-11-08T15:05:45Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2242909 wikitext text/x-wiki b30tpsuzq3v5fb8x2ggd1s868ui0r15 2242910 2242909 2024-11-08T15:06:03Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2138.codfw.wmnet with reason: host reimage 2242910 wikitext text/x-wiki euwtwhj2nohc6tei0xfanl2rodfdudd 2242911 2242910 2024-11-08T15:08:16Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm 2242911 wikitext text/x-wiki toeczk6ywmfrcfvcioz4aioakal50ud 2242912 2242911 2024-11-08T15:09:29Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2140.codfw.wmnet with reason: host reimage 2242912 wikitext text/x-wiki d1b63b83s1o5tcwv6wj0d7ovpu905xm 2242913 2242912 2024-11-08T15:13:00Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2129.codfw.wmnet with reason: host reimage 2242913 wikitext text/x-wiki n409azulkfzqwuvpic0qqccng2ao7v3 2242914 2242913 2024-11-08T15:15:45Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1002" 2242914 wikitext text/x-wiki 5al8jfq53p82fs0ztcliy6v5qd93avo 2242915 2242914 2024-11-08T15:15:57Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2136.codfw.wmnet with reason: host reimage 2242915 wikitext text/x-wiki n8lilqg3idwo0cokwgr36dxyykh8lj6 2242916 2242915 2024-11-08T15:16:03Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1002" 2242916 wikitext text/x-wiki 7nb81362ikqyqyfbu5xmzc9fja1q1ip 2242917 2242916 2024-11-08T15:16:04Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2087.codfw.wmnet with OS bullseye 2242917 wikitext text/x-wiki d3zbybx9voti2vr1hgd1eop39uk5glo 2242918 2242917 2024-11-08T15:18:54Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242918 wikitext text/x-wiki dyit43bh6hsbowsjkxxenydtp5ns95n 2242919 2242918 2024-11-08T15:19:17Z Stashbot 7414 elukey@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2001.codfw.wmnet with OS bookworm 2242919 wikitext text/x-wiki 4tnpzp39wcjm9i7gapgtcn1wicyebu0 2242920 2242919 2024-11-08T15:20:13Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2141.codfw.wmnet with reason: host reimage 2242920 wikitext text/x-wiki qu64vwrn5kxtrsbid2i8k2037z8to4r 2242921 2242920 2024-11-08T15:21:34Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242921 wikitext text/x-wiki nl0kcua94iirp5fbl6qm5p38r16zaac 2242922 2242921 2024-11-08T15:21:35Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2128.codfw.wmnet with OS bookworm 2242922 wikitext text/x-wiki 58b9w2ydwlsv3jnkojybv2cdf81270n 2242923 2242922 2024-11-08T15:22:08Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242923 wikitext text/x-wiki 5zfzdjtf287fwjjhwia2l34ubo2ljsd 2242924 2242923 2024-11-08T15:23:49Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2143.codfw.wmnet with reason: host reimage 2242924 wikitext text/x-wiki ijste5evwcr01p8pek594qcvq647dvw 2242925 2242924 2024-11-08T15:25:56Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2136.codfw.wmnet with OS bookworm 2242925 wikitext text/x-wiki b17moj47td8phwljgt9gzgomojmod0r 2242926 2242925 2024-11-08T15:27:07Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2142.codfw.wmnet with reason: host reimage 2242926 wikitext text/x-wiki mf5yvqirqqeoq6nb5pnnhb5q6wx9p9c 2242927 2242926 2024-11-08T15:27:11Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242927 wikitext text/x-wiki 784rybt4kzqhwbdiphvc7c7lxaqt6l7 2242928 2242927 2024-11-08T15:27:13Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2137.codfw.wmnet with OS bookworm 2242928 wikitext text/x-wiki 4k9e3v11uqa7kfohzh9wx33bp4vq5d1 2242929 2242928 2024-11-08T15:27:27Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242929 wikitext text/x-wiki fu1ktyloi831qdfz1ufg76czz954kvz 2242930 2242929 2024-11-08T15:28:12Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242930 wikitext text/x-wiki ote9xdaxtamfsz3wf93lpuyq4pzz0ku 2242931 2242930 2024-11-08T15:28:17Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242931 wikitext text/x-wiki g8gali9it0xo397zwcb2b7ukghqo4sz 2242932 2242931 2024-11-08T15:28:25Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2138.codfw.wmnet with OS bookworm 2242932 wikitext text/x-wiki 6kpomcbekr3nw4wuat4i8nrf6b9g5gq 2242933 2242932 2024-11-08T15:28:36Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242933 wikitext text/x-wiki m6zk16gwrgvltgm4bq2bj4euigx7xwt 2242934 2242933 2024-11-08T15:28:38Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2140.codfw.wmnet with OS bookworm 2242934 wikitext text/x-wiki 2hp09vsz1y43bc1l33tu30269ligb3h 2242935 2242934 2024-11-08T15:31:42Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242935 wikitext text/x-wiki 9biomlcxm8idzpizpojt4ee7l5gq8e7 2242936 2242935 2024-11-08T15:32:28Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242936 wikitext text/x-wiki a0xfd0ui113ijlsxolgc8vphz3s9qbp 2242937 2242936 2024-11-08T15:32:32Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2129.codfw.wmnet with OS bookworm 2242937 wikitext text/x-wiki jeu6vgu02uqabdwsdy1l53roj1qx4nw 2242938 2242937 2024-11-08T15:39:16Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242938 wikitext text/x-wiki i24cd4lp9at14kr2gw12te6etcpbzaf 2242939 2242938 2024-11-08T15:40:07Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242939 wikitext text/x-wiki qa5sd0wfoxdr4udjn84naf9kb9l7kp2 2242940 2242939 2024-11-08T15:40:09Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2141.codfw.wmnet with OS bookworm 2242940 wikitext text/x-wiki bjzt85ffu8ncm4vv1qgtxzrwyoorz80 2242941 2242940 2024-11-08T15:43:12Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242941 wikitext text/x-wiki lm8tznmwwr9up15nx4zxm9w3qf6f1t5 2242942 2242941 2024-11-08T15:45:03Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242942 wikitext text/x-wiki b7t2ecy90w4dwgz7jfmi00li61ulzw3 2242943 2242942 2024-11-08T15:45:06Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2143.codfw.wmnet with OS bookworm 2242943 wikitext text/x-wiki cfx33c0xodxow0opm42xljeebp9k497 2242944 2242943 2024-11-08T15:45:23Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242944 wikitext text/x-wiki 8but16c9bhcn6ewao2tmoak8sw27jp0 2242945 2242944 2024-11-08T15:46:25Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242945 wikitext text/x-wiki cibeu7xxv7ocywbl6zh2kkddj3zf16k 2242946 2242945 2024-11-08T15:46:27Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2142.codfw.wmnet with OS bookworm 2242946 wikitext text/x-wiki 04xjax6uupw51tysyms7l39sizwovyi 2242947 2242946 2024-11-08T15:48:39Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.reimage for host aux-k8s-worker1004.eqiad.wmnet with OS bookworm 2242947 wikitext text/x-wiki a425lag1ne17ya14mgdx2dyk5pny09u 2242948 2242947 2024-11-08T15:55:09Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm 2242948 wikitext text/x-wiki 209ynudj6m5uxdxy9l10uzj5jvweawa 2242949 2242948 2024-11-08T15:55:26Z Stashbot 7414 elukey@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2001.codfw.wmnet with OS bookworm 2242949 wikitext text/x-wiki pu5xxsmave49w3tedo17g1x3caf91uf 2242950 2242949 2024-11-08T16:02:28Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2139.codfw.wmnet with OS bookworm 2242950 wikitext text/x-wiki axycx2r74dfkj6mk8swo9nfkfxp4n2s 2242951 2242950 2024-11-08T16:02:39Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-worker1004.eqiad.wmnet with reason: host reimage 2242951 wikitext text/x-wiki m17zvcjnk36auw2yhwhaognjqbmup5e 2242952 2242951 2024-11-08T16:05:21Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-worker1004.eqiad.wmnet with reason: host reimage 2242952 wikitext text/x-wiki hi37wa5ic5o3539soerkds7e46rfydw 2242953 2242952 2024-11-08T16:10:28Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2242953 wikitext text/x-wiki 3rjujpfgryxwts2oy9i2cn9r02y4k20 2242954 2242953 2024-11-08T16:16:58Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2136.codfw.wmnet with OS bookworm 2242954 wikitext text/x-wiki nqjtszr9np325eecilldyevafu6x016 2242955 2242954 2024-11-08T16:22:43Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-worker1004.eqiad.wmnet with OS bookworm 2242955 wikitext text/x-wiki pwag1qe4ky8kbxgwemswopf9k5wukyr 2242956 2242955 2024-11-08T16:25:01Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS bookworm 2242956 wikitext text/x-wiki cevls10icnrh9m23673q58zdvpntbzj 2242959 2242956 2024-11-08T16:35:37Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2136.codfw.wmnet with reason: host reimage 2242959 wikitext text/x-wiki cyrnuiyi7eu5fb2jf1bb6vhsrquzemz 2242960 2242959 2024-11-08T16:35:40Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage 2242960 wikitext text/x-wiki 8kzbjehra42d9z0lh0za7azoiri0vh2 2242961 2242960 2024-11-08T16:39:19Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2136.codfw.wmnet with reason: host reimage 2242961 wikitext text/x-wiki 2u18t42jizlcmuzac6f52utljorofzj 2242965 2242961 2024-11-08T16:43:06Z Stashbot 7414 elukey@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage 2242965 wikitext text/x-wiki i2nwnxncg5zrgv4yx3gcgrphw42z866 2242968 2242965 2024-11-08T16:49:04Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2144.codfw.wmnet with OS bookworm 2242968 wikitext text/x-wiki a1inhv40ohzr0zikzjad799a1s0wbue 2242969 2242968 2024-11-08T16:49:06Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2145.codfw.wmnet with OS bookworm 2242969 wikitext text/x-wiki 2mvs5a2zirldk5m74d699gsyj2g12y1 2242970 2242969 2024-11-08T16:49:09Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2156.codfw.wmnet with OS bookworm 2242970 wikitext text/x-wiki mmhyhrmjk2sbcd5p03nqtmlgsel2gjx 2242971 2242970 2024-11-08T16:49:11Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2157.codfw.wmnet with OS bookworm 2242971 wikitext text/x-wiki g0thgby4vxpkfmafit76vw97b68mv48 2242972 2242971 2024-11-08T16:49:12Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2158.codfw.wmnet with OS bookworm 2242972 wikitext text/x-wiki 9r7gwzpdn8ayalswjm6ztll8r8h0iay 2242973 2242972 2024-11-08T16:49:14Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2159.codfw.wmnet with OS bookworm 2242973 wikitext text/x-wiki pkt8gpgbdr5bh8eqnmbfm4frtm3i9i1 2242974 2242973 2024-11-08T16:49:16Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2160.codfw.wmnet with OS bookworm 2242974 wikitext text/x-wiki h2bn0nw7zbr68pnvx2yyz5d80004gz3 2242975 2242974 2024-11-08T16:49:17Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2161.codfw.wmnet with OS bookworm 2242975 wikitext text/x-wiki 3nbzp86hvpijrv673l9ov2h3rqz38dt 2242976 2242975 2024-11-08T16:49:19Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2162.codfw.wmnet with OS bookworm 2242976 wikitext text/x-wiki d53saln6rgq4vuw52mw3uz1dhqc472h 2242977 2242976 2024-11-08T16:55:53Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bookworm 2242977 wikitext text/x-wiki bgm0f4h4nitwcjd9fkdx2ekbb9k16vv 2242978 2242977 2024-11-08T16:58:11Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242978 wikitext text/x-wiki sg0mb3l6213ytz25oqr8ty2qizpnven 2242979 2242978 2024-11-08T16:58:26Z Stashbot 7414 elukey@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest2001.codfw.wmnet with OS bookworm 2242979 wikitext text/x-wiki j5hl0y0lfqzkkeihef8txqt0m7dfq5s 2242980 2242979 2024-11-08T17:05:02Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2242980 wikitext text/x-wiki qvy9s2lb3mkdl8dhzm5xpiym414x86s 2242981 2242980 2024-11-08T17:05:11Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2136.codfw.wmnet with OS bookworm 2242981 wikitext text/x-wiki 9b2x4mscwfy2k9qznxqfcjhjo6bty9z 2242982 2242981 2024-11-08T17:05:36Z Stashbot 7414 jhathaway@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2082.codfw.wmnet with OS bookworm 2242982 wikitext text/x-wiki 6pe2e1mqi0x6jj1ox2w7ql0f96lkhze 2242983 2242982 2024-11-08T17:07:06Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2163.codfw.wmnet with OS bookworm 2242983 wikitext text/x-wiki nxjzj57rno6wd65u84f2z37jg68uh8x 2242984 2242983 2024-11-08T17:07:28Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2159.codfw.wmnet with reason: host reimage 2242984 wikitext text/x-wiki 00r23t3si1v8y5txefy2ry3iuroszzb 2242985 2242984 2024-11-08T17:07:39Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2156.codfw.wmnet with reason: host reimage 2242985 wikitext text/x-wiki tj6rnuchza8ad5d7g00psvkqwu210ul 2242986 2242985 2024-11-08T17:07:42Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2162.codfw.wmnet with reason: host reimage 2242986 wikitext text/x-wiki seyb9bs5zvryerzm3ptnuzys9yeoagt 2242987 2242986 2024-11-08T17:07:43Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2160.codfw.wmnet with reason: host reimage 2242987 wikitext text/x-wiki fo4dribbc8z9xyyemxiyv2qduqwwtzr 2242988 2242987 2024-11-08T17:07:50Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2161.codfw.wmnet with reason: host reimage 2242988 wikitext text/x-wiki m3747zylguc0vmiksihjb08x3f49cli 2242989 2242988 2024-11-08T17:08:07Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2157.codfw.wmnet with reason: host reimage 2242989 wikitext text/x-wiki 5nn0wv412gnh54ygfceosgbe0gl3evc 2242990 2242989 2024-11-08T17:08:16Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2145.codfw.wmnet with reason: host reimage 2242990 wikitext text/x-wiki fesdcx3npy5wuwd079wm7ddo22v4qku 2242991 2242990 2024-11-08T17:08:22Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2144.codfw.wmnet with reason: host reimage 2242991 wikitext text/x-wiki sqqez2wbvn77ivkrhhh0a5imayvg9lt 2242992 2242991 2024-11-08T17:08:59Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2158.codfw.wmnet with reason: host reimage 2242992 wikitext text/x-wiki 3t7higd428ys964bohjb23a00y3wri0 2242993 2242992 2024-11-08T17:09:13Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.ganeti.makevm for new host aux-k8s-worker1005.eqiad.wmnet 2242993 wikitext text/x-wiki qwe9gbu5u9bdx2q89h2jrfc0czeuv3t 2242994 2242993 2024-11-08T17:09:19Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.netbox 2242994 wikitext text/x-wiki 7mry22vryo36wgeepx3po4omd20oxxw 2242995 2242994 2024-11-08T17:10:36Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye 2242995 wikitext text/x-wiki 7j86158uyt43w1otvvmniudoeo7honq 2242996 2242995 2024-11-08T17:11:05Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2159.codfw.wmnet with reason: host reimage 2242996 wikitext text/x-wiki k8z9zr5uxl8cd9d857qw506vukoym9m 2242997 2242996 2024-11-08T17:13:50Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-worker1005.eqiad.wmnet - herron@cumin1002" 2242997 wikitext text/x-wiki 7au0kx5f4lfin5vk5w3393cngbd7ifn 2242998 2242997 2024-11-08T17:13:55Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-worker1005.eqiad.wmnet - herron@cumin1002" 2242998 wikitext text/x-wiki oyg8dvylwi3d01vwvf9ib7wnt7050o1 2242999 2242998 2024-11-08T17:13:57Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2242999 wikitext text/x-wiki 4wovaqazrmsytu17ii6ov7ka0dpddjb 2243000 2242999 2024-11-08T17:13:59Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.wipe-cache aux-k8s-worker1005.eqiad.wmnet on all recursors 2243000 wikitext text/x-wiki klvm0vjh9di11nhvpyntwi36s00wtw0 2243001 2243000 2024-11-08T17:14:01Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) aux-k8s-worker1005.eqiad.wmnet on all recursors 2243001 wikitext text/x-wiki s1wunawrm4limgsmq78ngjg4dlgl5dh 2243002 2243001 2024-11-08T17:14:08Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2161.codfw.wmnet with reason: host reimage 2243002 wikitext text/x-wiki 8gib0q0jlq5783eo2i3c0t3719w884g 2243003 2243002 2024-11-08T17:14:26Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-worker1005.eqiad.wmnet - herron@cumin1002" 2243003 wikitext text/x-wiki tbg7o772suwaiy4k61qw5ste1absthk 2243004 2243003 2024-11-08T17:14:30Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-worker1005.eqiad.wmnet - herron@cumin1002" 2243004 wikitext text/x-wiki chthc51qf3wy2lppbg234e3wa0bjptq 2243005 2243004 2024-11-08T17:15:39Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.reimage for host aux-k8s-worker1005.eqiad.wmnet with OS bookworm 2243005 wikitext text/x-wiki ii5iiflmprke5o2dv0enmedptpxwo84 2243006 2243005 2024-11-08T17:17:00Z Stashbot 7414 jhathaway@cumin2002: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ms-be2082.codfw.wmnet with OS bullseye 2243006 wikitext text/x-wiki r8js2zq3qwkhh68qi7uxybjwtzi55re 2243007 2243006 2024-11-08T17:17:35Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye 2243007 wikitext text/x-wiki mbod65d478p9uitnqyp9tezzndwjjf6 2243008 2243007 2024-11-08T17:17:36Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2156.codfw.wmnet with reason: host reimage 2243008 wikitext text/x-wiki k3dbg02r8jg8m3un46g3d11rdoi2q5z 2243009 2243008 2024-11-08T17:20:28Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2162.codfw.wmnet with reason: host reimage 2243009 wikitext text/x-wiki d5s20dxth0eg4p5vmpa99q6sc1v74lu 2243010 2243009 2024-11-08T17:23:22Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2158.codfw.wmnet with reason: host reimage 2243010 wikitext text/x-wiki cmhy734v3cws4b4its4ffbxkxfhsvfv 2243011 2243010 2024-11-08T17:26:31Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2160.codfw.wmnet with reason: host reimage 2243011 wikitext text/x-wiki eqitdjbe2ceamlw3hw0t76zbqy8v9xx 2243012 2243011 2024-11-08T17:27:12Z Stashbot 7414 jynus: rebuild frwiki.geo_tags @ an-redacteddb1001 2243012 wikitext text/x-wiki gm3mt0f55ps2m1doiwuc7b1paofld25 2243013 2243012 2024-11-08T17:29:33Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage 2243013 wikitext text/x-wiki fxjqekgxm7tri21tplt44ds501eowi3 2243014 2243013 2024-11-08T17:30:02Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243014 wikitext text/x-wiki tjyyb0jnuaqu5ss8mkskzdc5ddw0w7t 2243015 2243014 2024-11-08T17:31:02Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2157.codfw.wmnet with reason: host reimage 2243015 wikitext text/x-wiki sliewxic9yi9puwymmbr5nfw5afh99p 2243016 2243015 2024-11-08T17:32:48Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-worker1005.eqiad.wmnet with reason: host reimage 2243016 wikitext text/x-wiki 4l0wm7m4reb4k9e0ctzah3ovtxus4bo 2243017 2243016 2024-11-08T17:34:06Z Stashbot 7414 jhathaway@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage 2243017 wikitext text/x-wiki 7fgi8yi6cp88bir32vnoiby1j82pw9r 2243018 2243017 2024-11-08T17:35:19Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243018 wikitext text/x-wiki aqoxo83gvaa4l35h6pm5woecb49qly6 2243019 2243018 2024-11-08T17:36:57Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243019 wikitext text/x-wiki 6922lk0722ghuw24cpgr6qv2o0k5k77 2243020 2243019 2024-11-08T17:36:59Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2159.codfw.wmnet with OS bookworm 2243020 wikitext text/x-wiki rfo22ml6czpj5s0rgqzdchvr1hlqxtr 2243021 2243020 2024-11-08T17:37:35Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-worker1005.eqiad.wmnet with reason: host reimage 2243021 wikitext text/x-wiki 1iyfdbhkkdmf05pruum1qiwdsd5zh22 2243022 2243021 2024-11-08T17:37:38Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2164.codfw.wmnet with OS bookworm 2243022 wikitext text/x-wiki fmlrf0ph287tun1j7o7co17g1u6eqe0 2243023 2243022 2024-11-08T17:37:44Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on wikikube-worker2144.codfw.wmnet with reason: host reimage 2243023 wikitext text/x-wiki gg916lvfk7w0l0n4mmjkfvgcptbe12p 2243024 2243023 2024-11-08T17:38:21Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243024 wikitext text/x-wiki 5y5wkh7488200sz9xnfra4ha9ktp02z 2243025 2243024 2024-11-08T17:38:31Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2161.codfw.wmnet with OS bookworm 2243025 wikitext text/x-wiki 02dd9scrankslexe0jxzgks494ogrr4 2243026 2243025 2024-11-08T17:38:41Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243026 wikitext text/x-wiki fqtbz63iuxsacct0xizfaed1wgatehh 2243027 2243026 2024-11-08T17:39:12Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2165.codfw.wmnet with OS bookworm 2243027 wikitext text/x-wiki jb6igakt167q70rjidpukvs11764r5o 2243028 2243027 2024-11-08T17:39:27Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243028 wikitext text/x-wiki ibewd2kq94nnhxp682w43dulfam79r5 2243029 2243028 2024-11-08T17:39:32Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2156.codfw.wmnet with OS bookworm 2243029 wikitext text/x-wiki 6dv0uqzcxq80edyxp8mdsrjvtz11qve 2243030 2243029 2024-11-08T17:40:02Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243030 wikitext text/x-wiki f8gnuoj7ratv68f06galhubz7m2z9x5 2243031 2243030 2024-11-08T17:40:46Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2145.codfw.wmnet with reason: host reimage 2243031 wikitext text/x-wiki hnetc0y2se64lbcnf6irhvjla7ot0e9 2243032 2243031 2024-11-08T17:40:51Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2166.codfw.wmnet with OS bookworm 2243032 wikitext text/x-wiki dm91cu2bivqnl7ftfziiex6ir17y7oj 2243033 2243032 2024-11-08T17:42:21Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243033 wikitext text/x-wiki tjjd923qye0dill5y0qmgnia5fkkerf 2243034 2243033 2024-11-08T17:42:23Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2162.codfw.wmnet with OS bookworm 2243034 wikitext text/x-wiki s31ditqn4xy46rw9dhgyz38dguklqbi 2243035 2243034 2024-11-08T17:42:30Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243035 wikitext text/x-wiki ex0dteurb83ykr3nngp90try2b8u3i7 2243036 2243035 2024-11-08T17:43:46Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2167.codfw.wmnet with OS bookworm 2243036 wikitext text/x-wiki sqg0n3p7d493qqkzsp38gt10ktscfm7 2243037 2243036 2024-11-08T17:44:14Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243037 wikitext text/x-wiki cqtvx7fi6htix3lupqvoq5yyeujdyir 2243038 2243037 2024-11-08T17:44:15Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2158.codfw.wmnet with OS bookworm 2243038 wikitext text/x-wiki od3tg7y8xw60m4a79kt1rtvpnx6pgp9 2243039 2243038 2024-11-08T17:44:59Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2168.codfw.wmnet with OS bookworm 2243039 wikitext text/x-wiki cchzera9tif7ytrfhzncqd9jxm4vkeb 2243040 2243039 2024-11-08T17:45:36Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243040 wikitext text/x-wiki f6gtvvy56fnojenuzy6ywbfnllbqzz9 2243041 2243040 2024-11-08T17:46:55Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243041 wikitext text/x-wiki q5376g2s90udbz30vv1s0os3laudsze 2243042 2243041 2024-11-08T17:46:57Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2160.codfw.wmnet with OS bookworm 2243042 wikitext text/x-wiki tdrbg6483ewq0bknr4410ouncv0k7nv 2243043 2243042 2024-11-08T17:47:59Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2169.codfw.wmnet with OS bookworm 2243043 wikitext text/x-wiki hrer8egmaoatvr8vkla9fmlddd2fp9n 2243044 2243043 2024-11-08T17:49:22Z Stashbot 7414 cmooney@cumin1002: START - Cookbook sre.dns.netbox 2243044 wikitext text/x-wiki pz62ghtacbboo11k1o6m0hqb0lpd1d1 2243045 2243044 2024-11-08T17:49:53Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243045 wikitext text/x-wiki gokyizdss5kz0l1t740zcgprff6bg75 2243046 2243045 2024-11-08T17:50:21Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243046 wikitext text/x-wiki 7ve0jbnbd4c3r2yz4s3psxhpt386umy 2243047 2243046 2024-11-08T17:50:22Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2157.codfw.wmnet with OS bookworm 2243047 wikitext text/x-wiki 3auyf00e5tsnzpsu69ap03vfro4peqq 2243048 2243047 2024-11-08T17:50:58Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2170.codfw.wmnet with OS bookworm 2243048 wikitext text/x-wiki 202rqaqa6as0j7dlpcryb1ffrbv6oaj 2243049 2243048 2024-11-08T17:52:23Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2163.codfw.wmnet with OS bookworm 2243049 wikitext text/x-wiki nun2f90j6332sf6e4rfisge0tk2vqcv 2243050 2243049 2024-11-08T17:54:35Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243050 wikitext text/x-wiki e3orsj16wnz4xaawvo91bs9bm1nx61s 2243051 2243050 2024-11-08T17:56:03Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2164.codfw.wmnet with reason: host reimage 2243051 wikitext text/x-wiki bh1w7ga69py3tcyo9pjfm7qy55eipal 2243052 2243051 2024-11-08T17:56:06Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-worker1005.eqiad.wmnet with OS bookworm 2243052 wikitext text/x-wiki 1d3puiq0onjy2wd5x6q8x6rc1lrcj1r 2243053 2243052 2024-11-08T17:56:12Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-worker1005.eqiad.wmnet 2243053 wikitext text/x-wiki 1s52baii5xnlrboi7tw6uwqwcyoaqd0 2243054 2243053 2024-11-08T17:56:38Z Stashbot 7414 jhathaway@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2082.codfw.wmnet with OS bullseye 2243054 wikitext text/x-wiki cxm7ooxb7cspmjpq2173xsjblyo6vp6 2243055 2243054 2024-11-08T17:56:41Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2163.codfw.wmnet with OS bookworm 2243055 wikitext text/x-wiki 7rplnq85i18oipb0nlkxlk8vem6sith 2243056 2243055 2024-11-08T17:56:50Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243056 wikitext text/x-wiki 4pdr9lvvg5fhzure429n4v22hqe58l0 2243057 2243056 2024-11-08T17:56:51Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2144.codfw.wmnet with OS bookworm 2243057 wikitext text/x-wiki 1yqqrjzo82o2nurs6j8au3zteepr829 2243058 2243057 2024-11-08T17:56:59Z Stashbot 7414 cmooney@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Create new snippets for frack IPs - cmooney@cumin1002" 2243058 wikitext text/x-wiki cwclnm1n6kj4lush1m52kxqs7w2yvhh 2243059 2243058 2024-11-08T17:57:03Z Stashbot 7414 cmooney@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Create new snippets for frack IPs - cmooney@cumin1002" 2243059 wikitext text/x-wiki 6t3s14kkgyvpygd312fk60l8oy6cli5 2243060 2243059 2024-11-08T17:57:05Z Stashbot 7414 cmooney@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2243060 wikitext text/x-wiki 5blxii6my2bvy78haw2gec0hoo92il3 2243061 2243060 2024-11-08T17:57:35Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2165.codfw.wmnet with reason: host reimage 2243061 wikitext text/x-wiki s8j5qohb4ra6n27byyxdujeeqskkgy7 2243062 2243061 2024-11-08T17:59:12Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2166.codfw.wmnet with reason: host reimage 2243062 wikitext text/x-wiki 564r89sx2fai8dt3fbjxgke91aklweg 2243063 2243062 2024-11-08T17:59:24Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243063 wikitext text/x-wiki e19w7v56658ssr3ie9iqohf88ggn5xt 2243064 2243063 2024-11-08T17:59:48Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243064 wikitext text/x-wiki 6fkz7e3lqla225ccd38txym3iv5vpxy 2243065 2243064 2024-11-08T17:59:49Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2145.codfw.wmnet with OS bookworm 2243065 wikitext text/x-wiki pgrxls3c1d5152dbwry5cugxxs648xe 2243066 2243065 2024-11-08T18:01:22Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2164.codfw.wmnet with reason: host reimage 2243066 wikitext text/x-wiki pp4pn22edpim64imzy6w2vl9e1qi5hh 2243067 2243066 2024-11-08T18:01:53Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2167.codfw.wmnet with reason: host reimage 2243067 wikitext text/x-wiki e3j09w1yijousa1zlbdj6a1hz4ww03j 2243068 2243067 2024-11-08T18:03:19Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2168.codfw.wmnet with reason: host reimage 2243068 wikitext text/x-wiki 8dzqfyjgscokuubtlynvwb9h7kcervb 2243069 2243068 2024-11-08T18:04:44Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2165.codfw.wmnet with reason: host reimage 2243069 wikitext text/x-wiki 71ewxv4dc15pkkjcuoghfqt0tuey2ey 2243070 2243069 2024-11-08T18:06:28Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2169.codfw.wmnet with reason: host reimage 2243070 wikitext text/x-wiki 48tfdop3chug2d23dgszugdb19234b3 2243071 2243070 2024-11-08T18:07:53Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2166.codfw.wmnet with reason: host reimage 2243071 wikitext text/x-wiki 9k5mc0bxp8eskil4lgn07gny7tnziil 2243072 2243071 2024-11-08T18:10:22Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2170.codfw.wmnet with reason: host reimage 2243072 wikitext text/x-wiki 1zvlx24s0adkpolonc2fb9o806hngb4 2243073 2243072 2024-11-08T18:10:39Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2169.codfw.wmnet with reason: host reimage 2243073 wikitext text/x-wiki qbxshmpcnrg19pfl03qvffeizti9j8r 2243074 2243073 2024-11-08T18:13:38Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2170.codfw.wmnet with reason: host reimage 2243074 wikitext text/x-wiki kk6n9ag932scgr0j6cwc8pjk23oaqiv 2243075 2243074 2024-11-08T18:17:19Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2167.codfw.wmnet with reason: host reimage 2243075 wikitext text/x-wiki 6bfic02sv1jei0nj8at8mlyvbpku9o9 2243076 2243075 2024-11-08T18:17:34Z Stashbot 7414 cmooney@cumin1002: START - Cookbook sre.dns.netbox 2243076 wikitext text/x-wiki rl8rnknk7qmgu482rip7ong6t5cu6dp 2243077 2243076 2024-11-08T18:19:20Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243077 wikitext text/x-wiki fn5w6x2vj8de2tmab5qoktd3gr2qdpz 2243078 2243077 2024-11-08T18:20:34Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2168.codfw.wmnet with reason: host reimage 2243078 wikitext text/x-wiki l63046sm1qd5xz1udv8nwo68s6wczty 2243079 2243078 2024-11-08T18:21:16Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243079 wikitext text/x-wiki nll18m3kjtcbqpk6ijdcxyl3vb5a6as 2243080 2243079 2024-11-08T18:21:17Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2164.codfw.wmnet with OS bookworm 2243080 wikitext text/x-wiki 3batw4bgy9ahayuyuu96ideoa79eqxu 2243081 2243080 2024-11-08T18:21:24Z Stashbot 7414 cmooney@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Create new snippets for frack IPs - cmooney@cumin1002" 2243081 wikitext text/x-wiki 94ptjufjndhyh3tfxfuqslotnue2ep5 2243082 2243081 2024-11-08T18:21:28Z Stashbot 7414 cmooney@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Create new snippets for frack IPs - cmooney@cumin1002" 2243082 wikitext text/x-wiki tezjkxjhli2ithztw3lsk9t0kqus2l1 2243083 2243082 2024-11-08T18:21:30Z Stashbot 7414 cmooney@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2243083 wikitext text/x-wiki oju46ein05l3b0k9sqitvfs90ppfcff 2243084 2243083 2024-11-08T18:23:23Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243084 wikitext text/x-wiki tdnb4hug8qv11n7lkfvdtjd71zslvpu 2243085 2243084 2024-11-08T18:26:37Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243085 wikitext text/x-wiki ne1t2etb8k0qrm564hk861b8d2l4bpi 2243086 2243085 2024-11-08T18:26:38Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2165.codfw.wmnet with OS bookworm 2243086 wikitext text/x-wiki nunxbh4j2sdjnaqqfdmh26izjabu4qs 2243087 2243086 2024-11-08T18:27:09Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243087 wikitext text/x-wiki k44kdhtnb9fp9idc5tsrvhfq4ws6ts0 2243088 2243087 2024-11-08T18:27:26Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243088 wikitext text/x-wiki d6w1tf0sseowbz9q3vhehndqwz2a0pu 2243089 2243088 2024-11-08T18:27:27Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2166.codfw.wmnet with OS bookworm 2243089 wikitext text/x-wiki 8zgy42jkdblkkrwd4v8rh0gbceljmev 2243090 2243089 2024-11-08T18:29:36Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243090 wikitext text/x-wiki e2lqfj3pdvfrvic8ylqx4w0qy7zajlr 2243091 2243090 2024-11-08T18:31:21Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243091 wikitext text/x-wiki irwvtdggsrfeejl20fj0ho803d6ko2k 2243092 2243091 2024-11-08T18:31:31Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2169.codfw.wmnet with OS bookworm 2243092 wikitext text/x-wiki f9ndfspmvv603c9b5z5yp8g0p5c1659 2243093 2243092 2024-11-08T18:32:48Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243093 wikitext text/x-wiki ab5937w19k09awf84zeizs23x3t52bo 2243094 2243093 2024-11-08T18:33:22Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243094 wikitext text/x-wiki ru1k2k7ttwg8xdl3r831e3jmd53mll1 2243095 2243094 2024-11-08T18:33:24Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2170.codfw.wmnet with OS bookworm 2243095 wikitext text/x-wiki 82co8ze90xatc748dmw11y84n6o3xbu 2243096 2243095 2024-11-08T18:37:08Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243096 wikitext text/x-wiki badksr5r9zogj8d3jcd7i9p8860a9zm 2243097 2243096 2024-11-08T18:38:22Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243097 wikitext text/x-wiki 7wo00nf523d79o1a4m7wqubkbwy86ee 2243098 2243097 2024-11-08T18:38:24Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2167.codfw.wmnet with OS bookworm 2243098 wikitext text/x-wiki 9rbayqerfnh2wxnmmqcjonflw6xsygj 2243099 2243098 2024-11-08T18:39:47Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243099 wikitext text/x-wiki okp5bwzjo9tm6wtxw6r0plypp9is40r 2243100 2243099 2024-11-08T18:40:35Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2163.codfw.wmnet with OS bookworm 2243100 wikitext text/x-wiki su1avhg38bl446xzydxds2le5c34enf 2243101 2243100 2024-11-08T18:40:41Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" 2243101 wikitext text/x-wiki chhsg5it2f13uvljdvpe3wwo5w1ypx6 2243102 2243101 2024-11-08T18:40:43Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2168.codfw.wmnet with OS bookworm 2243102 wikitext text/x-wiki mgx8e9fi2zqvk7dos63fgcqybons1ga 2243103 2243102 2024-11-08T19:47:46Z Stashbot 7414 aude@deploy2002: Started scap sync-world: Backport for [[gerrit:1088366|Reopen testcommonswiki for testing Chart extension]] 2243103 wikitext text/x-wiki 1cikhdg489acm6fcfpqatmmvnzs1r88 2243104 2243103 2024-11-08T19:50:28Z Stashbot 7414 aude@deploy2002: aude: Backport for [[gerrit:1088366|Reopen testcommonswiki for testing Chart extension]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2243104 wikitext text/x-wiki lybbhv5017vref6vi5zgcam4tkqkqz1 2243105 2243104 2024-11-08T19:57:36Z Stashbot 7414 aude@deploy2002: aude: Continuing with sync 2243105 wikitext text/x-wiki 764sqmm3t6a2et18tafmev17lg3qfid 2243106 2243105 2024-11-08T19:59:29Z Stashbot 7414 jhathaway@cumin1002: START - Cookbook sre.hosts.downtime for 1:00:00 on ms-be2082.codfw.wmnet with reason: T371400 2243106 wikitext text/x-wiki 8v7nbcsa533oh5ncvfe26dhsbupvdc1 2243107 2243106 2024-11-08T19:59:42Z Stashbot 7414 jhathaway@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be2082.codfw.wmnet with reason: T371400 2243107 wikitext text/x-wiki kl7tepas6ujovixf15m80a2xskh4bwh 2243108 2243107 2024-11-08T20:02:20Z Stashbot 7414 aude@deploy2002: Finished scap sync-world: Backport for [[gerrit:1088366|Reopen testcommonswiki for testing Chart extension]] (duration: 14m 33s) 2243108 wikitext text/x-wiki 2uwrfkzqluethg9xmy8lvmdlrhn0xzq 2243109 2243108 2024-11-08T20:04:24Z Stashbot 7414 aude@deploy2002: Started scap sync-world: Backport for [[gerrit:1088375|Enable Tabular data for test commons (T378127)]] 2243109 wikitext text/x-wiki 2y2bfrp39gpqwi4yub49ndvb92j5zdh 2243110 2243109 2024-11-08T20:06:54Z Stashbot 7414 aude@deploy2002: aude: Backport for [[gerrit:1088375|Enable Tabular data for test commons (T378127)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2243110 wikitext text/x-wiki igjsgl4tswggb41y1msx0wzclhw9vt7 2243111 2243110 2024-11-08T20:10:41Z Stashbot 7414 aude@deploy2002: aude: Continuing with sync 2243111 wikitext text/x-wiki 9iaswxf00gdke9i4kvyaty6n68i4tpl 2243112 2243111 2024-11-08T20:15:19Z Stashbot 7414 aude@deploy2002: Finished scap sync-world: Backport for [[gerrit:1088375|Enable Tabular data for test commons (T378127)]] (duration: 10m 55s) 2243112 wikitext text/x-wiki i3a4qmblfb04ww2lmr8pup9j0mtzyyx 2243113 2243112 2024-11-08T20:18:22Z Stashbot 7414 aude@deploy2002: Started scap sync-world: Backport for [[gerrit:1088586|Reviving "Update interwiki map"]] 2243113 wikitext text/x-wiki tw51u1t2b2v9p24l3yypi3tidx4s9f0 2243114 2243113 2024-11-08T20:20:27Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye 2243114 wikitext text/x-wiki buvy6ermvnm89n9apa9q1qlhhi72xpo 2243116 2243114 2024-11-08T20:21:54Z Stashbot 7414 aude@deploy2002: seddon, aude: Backport for [[gerrit:1088586|Reviving "Update interwiki map"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2243116 wikitext text/x-wiki lj3zp73b1t4vz86psyilho78xq1r06i 2243117 2243116 2024-11-08T20:24:03Z Stashbot 7414 aude@deploy2002: seddon, aude: Continuing with sync 2243117 wikitext text/x-wiki g2sezf6kpw79bokzm6ifd3swnsse86i 2243118 2243117 2024-11-08T20:28:41Z Stashbot 7414 aude@deploy2002: Finished scap sync-world: Backport for [[gerrit:1088586|Reviving "Update interwiki map"]] (duration: 10m 19s) 2243118 wikitext text/x-wiki 0m3prt2wcjc8vs2onqdabucf7m2nqgk 2243119 2243118 2024-11-08T21:05:28Z Stashbot 7414 mutante: cumin2002 - sudo systemctl status httpbb_kubernetes_mw-api-int_hourly 2243119 wikitext text/x-wiki 80yxr6co27abffocb8yu80tmww6d6hr 2243120 2243119 2024-11-08T21:08:37Z Stashbot 7414 mutante: cumint2002 [cumin2002:~] $ sudo systemctl reset-failed 2243120 wikitext text/x-wiki 3pkt0wn9dbafbsk03ddkcoc5aj5nq9y 2243121 2243120 2024-11-08T21:12:07Z Stashbot 7414 jhathaway@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2082.codfw.wmnet with OS bullseye 2243121 wikitext text/x-wiki au16d5kzmxdhf9jhug6b9bw59uhhdvw 2243122 2243121 2024-11-08T21:18:00Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.provision for host ms-be2082.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2243122 wikitext text/x-wiki mp0u2lu1tyo4mts7u2705pwq8t2w2ez 2243123 2243122 2024-11-08T21:18:09Z Stashbot 7414 denisse: disabling Puppet on grafana2001 - T379043 2243123 wikitext text/x-wiki 7qqu0f2e8crnhwej22opx5p8abn0q1n 2243124 2243123 2024-11-08T21:18:20Z Stashbot 7414 jhathaway@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be2082.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2243124 wikitext text/x-wiki quwt8f43gak7jp67g0fwwy3ndv3xom9 2243125 2243124 2024-11-08T22:08:27Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye 2243125 wikitext text/x-wiki q1hxc1af7izkksqs20bsuk6wnz227y8 2243128 2243125 2024-11-08T22:28:55Z Stashbot 7414 jhathaway@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2082.codfw.wmnet with OS bullseye 2243128 wikitext text/x-wiki f8f5xo6lhbbz2wsnn70esa7xrak50h0 2243129 2243128 2024-11-08T22:29:20Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye 2243129 wikitext text/x-wiki gzjnx20scveusr435srjefrsblab7j7 2243131 2243129 2024-11-08T22:38:31Z Stashbot 7414 dani@deploy2002: helmfile [staging] START helmfile.d/services/miscweb: apply 2243131 wikitext text/x-wiki 9vpwz09uxjet7pd6l8donsjenw578pv 2243132 2243131 2024-11-08T22:38:49Z Stashbot 7414 dani@deploy2002: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2243132 wikitext text/x-wiki hpvjl7z55vzp9ldii2cg8yy6sbb1xn6 2243133 2243132 2024-11-08T22:38:51Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2243133 wikitext text/x-wiki 22m66svunu2ww5wa50a7v3260xw9nmq 2243134 2243133 2024-11-08T22:39:13Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2243134 wikitext text/x-wiki herfyt2h1zh1tm3qf0flzmkj9h1hbu8 2243135 2243134 2024-11-08T22:39:15Z Stashbot 7414 dani@deploy2002: helmfile [codfw] START helmfile.d/services/miscweb: apply 2243135 wikitext text/x-wiki pzky67e06jxtkd3vsyxpawq07v68c6g 2243136 2243135 2024-11-08T22:39:33Z Stashbot 7414 dani@deploy2002: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2243136 wikitext text/x-wiki dnd7xu8lg0j9ar97lzql7mjtsiizb6u 2243137 2243136 2024-11-08T22:41:14Z Stashbot 7414 jhathaway@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage 2243137 wikitext text/x-wiki 7uzobo1ampv2emaraanfbjy210ynnik 2243138 2243137 2024-11-08T22:44:04Z Stashbot 7414 jhathaway@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage 2243138 wikitext text/x-wiki ay2upmfh5ahregek6v25mwmkitbf882 2243139 2243138 2024-11-08T22:51:07Z Stashbot 7414 dani@deploy2002: helmfile [staging] START helmfile.d/services/miscweb: apply 2243139 wikitext text/x-wiki miekqh14m9arl10f42th3v1h5okng1a 2243140 2243139 2024-11-08T22:51:23Z Stashbot 7414 dani@deploy2002: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2243140 wikitext text/x-wiki rd8o514dg0mf4vvzhu9nog9ehgroc58 2243141 2243140 2024-11-08T22:51:25Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2243141 wikitext text/x-wiki e5jkhgkv0h96gg8ohvkm0kfllyoww5p 2243142 2243141 2024-11-08T22:51:46Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2243142 wikitext text/x-wiki qyb2j74p6pnxo52713kmm647woihfna 2243143 2243142 2024-11-08T22:51:47Z Stashbot 7414 dani@deploy2002: helmfile [codfw] START helmfile.d/services/miscweb: apply 2243143 wikitext text/x-wiki m601q7327ipi0wz4i4hj501zfbkdmr2 2243144 2243143 2024-11-08T22:52:03Z Stashbot 7414 dani@deploy2002: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2243144 wikitext text/x-wiki 8rgizv2328h5bjt8hkg1fe3cwimfcuf 2243145 2243144 2024-11-08T22:54:05Z Stashbot 7414 dani@deploy2002: helmfile [staging] START helmfile.d/services/miscweb: apply 2243145 wikitext text/x-wiki igidfnro4ytu1087ehm2skzru4thrvx 2243146 2243145 2024-11-08T22:54:08Z Stashbot 7414 dani@deploy2002: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2243146 wikitext text/x-wiki 0i71ymye2yt6vzdrlfqyompvqfjjwrd 2243147 2243146 2024-11-08T22:54:10Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2243147 wikitext text/x-wiki p6h74rqw2xyentu4ri8fzdsynwp9hhp 2243148 2243147 2024-11-08T22:54:12Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2243148 wikitext text/x-wiki ave9i0v5ca2qf9anvzn36qcuc3ndjkb 2243149 2243148 2024-11-08T22:54:14Z Stashbot 7414 dani@deploy2002: helmfile [codfw] START helmfile.d/services/miscweb: apply 2243149 wikitext text/x-wiki fspf51ae4h6l0ljjb6og5ij6p58ltil 2243150 2243149 2024-11-08T22:54:15Z Stashbot 7414 dani@deploy2002: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2243150 wikitext text/x-wiki irof519yy8d5x1vb3nx3zu6lpqeo27g 2243151 2243150 2024-11-08T23:07:41Z Stashbot 7414 jhathaway@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2082.codfw.wmnet with OS bullseye 2243151 wikitext text/x-wiki cfxt0xmke6u8y8gl60rn6bh3szjam3q 2243152 2243151 2024-11-08T23:16:07Z Stashbot 7414 Reedy: ran `delete from oathauth_devices where oad_id=4506;` on centralauth for T379398 because oad_user=0 2243152 wikitext text/x-wiki bufdr9o3dns8b0cyhmjkf4rwpa28jzk 2243154 2243152 2024-11-08T23:35:26Z Stashbot 7414 zabe: attach Sotiale's local accounts on newly created wikis 2243154 wikitext text/x-wiki 4wbmucmofkcjh5c9j95tyco7wcunhup 0 17290 2243115 2242154 2024-11-08T20:21:38Z Stashbot 7414 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1088627 T379145 2243115 wikitext text/x-wiki nm59kzl7q3elbh4ycd0w571khajxay8 498 30942 2242833 2242530 2024-11-08T13:28:19Z Stashbot 7414 arturo: [codfw1dev] restart rabbitmq, openstack services logs show connection errors 2242833 wikitext text/x-wiki kvkcccm4mhxjf59qtkj04sgzmfosrb3 2242837 2242833 2024-11-08T13:32:35Z Stashbot 7414 aborrero@cloudcumin2001: START - Cookbook wmcs.openstack.restart_openstack 2242837 wikitext text/x-wiki a507oms0u17nvnktw4a0iqk53ilp5i7 2242838 2242837 2024-11-08T13:33:39Z Stashbot 7414 aborrero@cloudcumin2001: END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) 2242838 wikitext text/x-wiki jmyqr07zsc6epj70sdvn461b26rw129 2242839 2242838 2024-11-08T13:44:45Z Stashbot 7414 aborrero@cloudcumin2001: START - Cookbook wmcs.openstack.restart_openstack 2242839 wikitext text/x-wiki 5d2yyrx1grj3sbrwuymukhagyopar7e 2242840 2242839 2024-11-08T13:45:31Z Stashbot 7414 aborrero@cloudcumin2001: END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) 2242840 wikitext text/x-wiki chsxt3cqc2b2qtvwzqlhmeafcum2lz0 2242962 2242840 2024-11-08T16:42:08Z Stashbot 7414 aborrero@cloudcumin2001: START - Cookbook wmcs.openstack.restart_openstack 2242962 wikitext text/x-wiki 394lj8kyqtk37nr9qepcxo8pqz42y8m 2242963 2242962 2024-11-08T16:42:50Z Stashbot 7414 arturo: [codfw1dev] restart all nova services and rabbitmq out of despair 2242963 wikitext text/x-wiki 9ipri2777dunv5roao5dvq9rnw4u8q3 2242964 2242963 2024-11-08T16:42:54Z Stashbot 7414 aborrero@cloudcumin2001: END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) 2242964 wikitext text/x-wiki 37xxtsk4uf6jx78c7rdgwlleusf6yrp 2242966 2242964 2024-11-08T16:46:01Z Stashbot 7414 aborrero@cloudcumin2001: START - Cookbook wmcs.openstack.restart_openstack 2242966 wikitext text/x-wiki bpsh3feyubkne9hdc9fmftcqfi1ciia 2242967 2242966 2024-11-08T16:47:33Z Stashbot 7414 aborrero@cloudcumin2001: END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) 2242967 wikitext text/x-wiki 57h5ib5xhaj59bzal05fzeceh0yndp1 498 221642 2243158 2231494 2024-11-09T08:18:54Z Stashbot 7414 wmbot~jeanfred@tools-sgebastion-10: Run webservice stop ; webservice --backend=kubernetes python3.9 start for T379452 2243158 wikitext text/x-wiki 1unj6dfax3cgeam3tlngqpgxjn4fa44 12 444255 2242832 2222110 2024-11-08T13:05:21Z ABorrero (WMF) 11379 add scripting section 2242832 wikitext text/x-wiki 1nv5pr1z5xkot46e6pvsz4lwhvingfj 0 450823 2242859 2225167 2024-11-08T14:31:01Z Gehel 6860 /* Asynchronous operations only */ 2242859 wikitext text/x-wiki r1fklgt6dert52ep4y6icxpskv8f7nm 2242879 2242859 2024-11-08T14:34:32Z Gehel 6860 /* Asynchronous operations only */ 2242879 wikitext text/x-wiki 43lmwftyydoolfjn0nos7j9yrqbl55d 0 453487 2243126 2240841 2024-11-08T22:25:22Z Stef Dunlap 34149 2243126 wikitext text/x-wiki adr902yp0ynjxwhohvbrlyec58299gk 2243155 2243126 2024-11-09T01:00:18Z Novem Linguae 23682 ce 2243155 wikitext text/x-wiki 627yrpv5cathxu99w0g2fx85v3q77jm 0 455791 2242841 2238924 2024-11-08T13:55:32Z MPopov (WMF) 37710 Documented what is managed data, added descriptions and examples 2242841 wikitext text/x-wiki fkznkswa128vsuc36xm8tcicw0halzh 498 456102 2242823 2024-11-08T12:00:16Z Labslogbot 55 Auto update of instance info. 2242823 wikitext text/x-wiki 0g2yf4uxv984vnnxn3oueh0l52pvksz 498 456103 2242957 2024-11-08T16:29:59Z Stashbot 7414 arturo: add toolforge-standards-comittee as maintainer (T379340) 2242957 wikitext text/x-wiki 8fn7fn7tt69htcyk38tuso4pgk4y98h 3 456104 2242958 2024-11-08T16:32:03Z StrikerBot 8475 Welcome to Toolforge! 2242958 wikitext text/x-wiki 59sccesdo3ot7sjoy2g5owpchc5qdxp 0 456105 2243127 2024-11-08T22:25:35Z Stef Dunlap 34149 Created page with "== Introduction == Project '''Catalyst''' is a team working on a [[:en:Kubernetes|kubernetes]] cluster as a service explicitly for [[:en:Continuous_integration|CI]] and and [[:en:Exploratory_testing|exploratory testing]]. Our current effort is upgrading [https://toolhub.wikimedia.org/tools/patchdemo Patch Demo], to use kubernetes to provision and host wikis with custom [[mw:Manual:Extensions|extensions]] and [[mw:Help:Skins|skins]]. The Catalyst API wraps a small kuberne..." 2243127 wikitext text/x-wiki e76ytfj52n85sxrpezfp6j5ojuidfpy 3 456106 2243130 2024-11-08T22:34:14Z StrikerBot 8475 Welcome to Toolforge! 2243130 wikitext text/x-wiki 8t5m76ssqfbpzfx11feanbh5gk87frf 0 456107 2243157 2024-11-09T02:00:46Z DeploymentCalendarTool 20896 Add last week 2243157 wikitext text/x-wiki r6yn414a97t4j4qdvlvbl30pp55w2ki