Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.44.0-wmf.5 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 0 3908 2249764 2240460 2024-12-02T04:14:16Z Tim Starling (WMF) 38382 I have better things to do than duplicating language creation work 2249764 wikitext text/x-wiki axhwtfmw0i8piwzo9v2xn1jt13ilnvi 2249770 2249764 2024-12-02T05:46:02Z Tim Starling (WMF) 38382 note maintenance bot 2249770 wikitext text/x-wiki 7m1vdi4suryg7h8vzp8aafxnbbtf32v 2249774 2249770 2024-12-02T07:11:56Z Tim Starling (WMF) 38382 update for new addWiki.php T352113 2249774 wikitext text/x-wiki qaoznnbtrqc5vs7l1cjve3crr14dwl7 0 4108 2249771 2249720 2024-12-02T06:02:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1099410]] to Monday, December 02 UTC morning backport window 2249771 wikitext text/x-wiki sqhg2g0v4fckchltro7m2eovaf7b4i4 2249783 2249771 2024-12-02T08:09:56Z ScheduleDeploymentBot 37566 Add [[gerrit:1099221]] to Monday, December 02 UTC afternoon backport window 2249783 wikitext text/x-wiki 4sf2p442tdgnc577950t9yt7gwwpdqd 2249784 2249783 2024-12-02T08:10:45Z KHarlan (WMF) 37698 2249784 wikitext text/x-wiki cq45iv3vip62zcxo57wzvmyn7t5dbeg 2249827 2249784 2024-12-02T09:42:27Z ScheduleDeploymentBot 37566 Add [[gerrit:1099334]] to Monday, December 02 UTC afternoon backport window 2249827 wikitext text/x-wiki munn6evueklsk6b7iwtr6zkvgswyqk5 3 7542 2249773 2247083 2024-12-02T06:52:26Z MABot 10804 Bot: Archiving 1 thread (older than 30 days) to [[User talk:BryanDavis/Archives/2024]] 2249773 wikitext text/x-wiki s7jpwfn8g8g3xjryfatwjr2bi9w99x9 0 7919 2249734 2249731 2024-12-01T12:10:17Z Stashbot 7414 ladsgroup@cumin1002: END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db1156.eqiad.wmnet onto db1233.eqiad.wmnet 2249734 wikitext text/x-wiki 9m3zu9nkv5jfgtib0zgycsyu6vkayuo 2249735 2249734 2024-12-01T12:16:41Z Stashbot 7414 ladsgroup@cumin1002: START - Cookbook sre.mysql.pool db1233 gradually with 4 steps - Maint over (T381213) 2249735 wikitext text/x-wiki 6xn6lc5w38zjzjzhligal5z19ms5msr 2249736 2249735 2024-12-01T12:31:50Z Stashbot 7414 ladsgroup@cumin1002: START - Cookbook sre.mysql.pool db1156 gradually with 4 steps - Maint over (T381213) 2249736 wikitext text/x-wiki 955h5f7svphhxq19bkyr87tcbjsz8oj 2249737 2249736 2024-12-01T13:02:04Z Stashbot 7414 ladsgroup@cumin1002: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1233 gradually with 4 steps - Maint over (T381213) 2249737 wikitext text/x-wiki 3xbmre43ufbemx6vtgzaqj89pc2f5lt 2249738 2249737 2024-12-01T13:17:44Z Stashbot 7414 ladsgroup@cumin1002: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1156 gradually with 4 steps - Maint over (T381213) 2249738 wikitext text/x-wiki 5k1go1nrcwik561122uhkdkono7sxfs 2249744 2249738 2024-12-01T23:50:48Z Stashbot 7414 dani@deploy2002: helmfile [staging] START helmfile.d/services/miscweb: apply 2249744 wikitext text/x-wiki g0innkj5ogxpspe4dna6x07g8dw6tol 2249745 2249744 2024-12-01T23:50:52Z Stashbot 7414 dani@deploy2002: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2249745 wikitext text/x-wiki bw8e2bhgy224bjghjjevcwkaju2qh3f 2249746 2249745 2024-12-01T23:50:53Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2249746 wikitext text/x-wiki ddebdqm41v57ii9c2ly27jztnaxxyia 2249747 2249746 2024-12-01T23:50:56Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2249747 wikitext text/x-wiki t4hpj2xaepwdmq00oclpu00rtsmkf72 2249748 2249747 2024-12-01T23:50:57Z Stashbot 7414 dani@deploy2002: helmfile [codfw] START helmfile.d/services/miscweb: apply 2249748 wikitext text/x-wiki 7xlwha4jaeb95mwkp9j1tsdm3yekowt 2249749 2249748 2024-12-01T23:50:59Z Stashbot 7414 dani@deploy2002: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2249749 wikitext text/x-wiki 7fxuk3u2nzqa707mp5byx959pi6az4d 2249750 2249749 2024-12-01T23:52:51Z Stashbot 7414 dani@deploy2002: helmfile [staging] START helmfile.d/services/miscweb: apply 2249750 wikitext text/x-wiki 41via4fwfwzb35o7m6g76mrbl58w9hc 2249751 2249750 2024-12-01T23:52:55Z Stashbot 7414 dani@deploy2002: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2249751 wikitext text/x-wiki fg6i971cm8umymbk9yev5tgsf6f3qig 2249752 2249751 2024-12-01T23:52:56Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2249752 wikitext text/x-wiki chc23o7vu5vj3ohpoo3wj2mjhdskngv 2249753 2249752 2024-12-01T23:52:59Z Stashbot 7414 dani@deploy2002: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2249753 wikitext text/x-wiki bm0ype8pjuuah53bo8ya7w12tqn4h6m 2249754 2249753 2024-12-01T23:53:00Z Stashbot 7414 dani@deploy2002: helmfile [codfw] START helmfile.d/services/miscweb: apply 2249754 wikitext text/x-wiki h9p63hdrcjkd84he44dbmk5t1k4du37 2249755 2249754 2024-12-01T23:53:18Z Stashbot 7414 dani@deploy2002: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2249755 wikitext text/x-wiki eia1vcjew09dc7qm4a7yzifh7b787nx 2249761 2249755 2024-12-02T03:55:27Z Stashbot 7414 tstarling@deploy2002: Started scap sync-world: Backport for [[gerrit:1098918|Create id.wikivoyage.org (T380726 T352113)]], [[gerrit:1099405|Add messages for Indonesian Wikivoyage (idwikivoyage) (T380726)]] 2249761 wikitext text/x-wiki 1122bpnv25shomt4xlywampxojc8789 2249762 2249761 2024-12-02T04:12:30Z Stashbot 7414 tstarling@deploy2002: tstarling: Backport for [[gerrit:1098918|Create id.wikivoyage.org (T380726 T352113)]], [[gerrit:1099405|Add messages for Indonesian Wikivoyage (idwikivoyage) (T380726)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2249762 wikitext text/x-wiki 2tuoopvbmeb1kafdso6r50lvou65auw 2249763 2249762 2024-12-02T04:13:14Z Stashbot 7414 tstarling@deploy2002: tstarling: Continuing with sync 2249763 wikitext text/x-wiki 68qd6zfhmr6owhc901y85meoui37f7w 2249765 2249763 2024-12-02T04:26:33Z Stashbot 7414 tstarling@deploy2002: Finished scap sync-world: Backport for [[gerrit:1098918|Create id.wikivoyage.org (T380726 T352113)]], [[gerrit:1099405|Add messages for Indonesian Wikivoyage (idwikivoyage) (T380726)]] (duration: 31m 05s) 2249765 wikitext text/x-wiki exm9fu6i3tyddztpcmy8iuvei5txh18 2249766 2249765 2024-12-02T04:39:26Z Stashbot 7414 TimStarling: on db2123: grant alter ON `%wik%`.* TO `wikiadmin2023`@`10.%` 2249766 wikitext text/x-wiki mtdg4m5twicfepx58p226tf5h407i2e 2249767 2249766 2024-12-02T04:41:27Z Stashbot 7414 TimStarling: installed id.wikivoyage.org 2249767 wikitext text/x-wiki dzj05zls71rndjbafruc9ob980kuvd7 2249768 2249767 2024-12-02T05:14:46Z Stashbot 7414 TimStarling: on mwmaint2002: mwscript extensions/Wikibase/lib/maintenance/populateSitesTable.php --wiki=idwikivoyage --force-protocol=https 2249768 wikitext text/x-wiki 97tg54j7o9aegy9mf33vrh2pcqjofuu 2249769 2249768 2024-12-02T05:20:28Z Stashbot 7414 TimStarling: foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol=https 2249769 wikitext text/x-wiki 2mo3x61srwzmuy3ko1cgseccnjp19dt 2249777 2249769 2024-12-02T08:00:19Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: T373037, host is not pooled 2249777 wikitext text/x-wiki jccyrcrr3hd6yc05xyuo7fh9xaxars7 2249778 2249777 2024-12-02T08:00:33Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: T373037, host is not pooled 2249778 wikitext text/x-wiki 3j4vhsv5hyiocwl9dxpa0ascvkkcypd 2249779 2249778 2024-12-02T08:00:40Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled 2249779 wikitext text/x-wiki 5dksuzemd4y7m8tywfz9g8clv3ce0wg 2249780 2249779 2024-12-02T08:00:53Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled 2249780 wikitext text/x-wiki nfauwsfqqejqz37ro0t6gufsm4giobw 2249781 2249780 2024-12-02T08:07:38Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1009.eqiad.wmnet 2249781 wikitext text/x-wiki dsl5bb3maav0p28irmlqo1i641ce0h9 2249782 2249781 2024-12-02T08:09:36Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1009.eqiad.wmnet 2249782 wikitext text/x-wiki qyoctu5vv0rxsfrbg4xmpm9faj9xhva 2249785 2249782 2024-12-02T08:11:40Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1020.eqiad.wmnet 2249785 wikitext text/x-wiki o8npjm8qobhhn8mu3iod50m750sh6e9 2249786 2249785 2024-12-02T08:12:43Z Stashbot 7414 kartik@deploy2002: Started scap sync-world: Backport for [[gerrit:1099410|Translate: Enable message group subscription feature for some wikis (T372386)]] 2249786 wikitext text/x-wiki h572vcf057n33gwttygk6n6iheioie2 2249787 2249786 2024-12-02T08:15:20Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1020.eqiad.wmnet 2249787 wikitext text/x-wiki 5rm2zn4dgdjm16xj5phodtow2jfeon5 2249788 2249787 2024-12-02T08:18:10Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2249788 wikitext text/x-wiki h0f36nznhrp1uva0cpfbzoy9vkrrc2u 2249789 2249788 2024-12-02T08:18:50Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2249789 wikitext text/x-wiki ktvyt2cwq5yuhv6r7dg00rwyhn7i8qy 2249790 2249789 2024-12-02T08:19:32Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249790 wikitext text/x-wiki n7ni6r5v6ovcxagw9l01ujj0oxmerzs 2249791 2249790 2024-12-02T08:19:43Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249791 wikitext text/x-wiki 0zq3uxf8voclor0n93bdqu32avj0w3u 2249792 2249791 2024-12-02T08:19:55Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249792 wikitext text/x-wiki c7sp08z8qynz8y3t0vb5ahs16u2vfwi 2249793 2249792 2024-12-02T08:20:13Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249793 wikitext text/x-wiki b490abis5n77jp9wgy91i2hkpdg597w 2249794 2249793 2024-12-02T08:21:10Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249794 wikitext text/x-wiki 23mgacljdxfk2p4gdr4egq5k17xm6oh 2249795 2249794 2024-12-02T08:21:14Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249795 wikitext text/x-wiki lzrflnqn4o7o4muvrw6f5gl55ovifbk 2249796 2249795 2024-12-02T08:25:26Z Stashbot 7414 kartik@deploy2002: abi, kartik: Backport for [[gerrit:1099410|Translate: Enable message group subscription feature for some wikis (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2249796 wikitext text/x-wiki 38398hkfyl0qjd13xz8u6y1s9ojoget 2249797 2249796 2024-12-02T08:29:43Z Stashbot 7414 kartik@deploy2002: abi, kartik: Continuing with sync 2249797 wikitext text/x-wiki gms8o988dex4rrvad45kwe5bs4ehedh 2249798 2249797 2024-12-02T08:35:26Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.reimage for host ms-be2086.codfw.wmnet with OS bullseye 2249798 wikitext text/x-wiki ozs4zwrucyko3v0aa30x2cgm1wkhap8 2249799 2249798 2024-12-02T08:36:22Z Stashbot 7414 kartik@deploy2002: Finished scap sync-world: Backport for [[gerrit:1099410|Translate: Enable message group subscription feature for some wikis (T372386)]] (duration: 23m 39s) 2249799 wikitext text/x-wiki 6m6io8vygt32sxrkiwyfz3dfp8shncl 2249800 2249799 2024-12-02T08:42:35Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249800 wikitext text/x-wiki mqsquvuu1g9ll8lmcxjxgg09w5esidf 2249801 2249800 2024-12-02T08:42:47Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249801 wikitext text/x-wiki g0bp6ee7xmy0yq8mgpnfo0szj2dih2s 2249802 2249801 2024-12-02T08:44:51Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249802 wikitext text/x-wiki 8i2bkhvais4qoiu4mlv7816vezju1xd 2249803 2249802 2024-12-02T08:45:02Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249803 wikitext text/x-wiki c5loj7rquv59fd6dwm0dvae73sqpzgh 2249804 2249803 2024-12-02T08:47:27Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249804 wikitext text/x-wiki j3b5lkctg012u90o66uu346auwi82ip 2249805 2249804 2024-12-02T08:47:39Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249805 wikitext text/x-wiki ihgv941d8r5ym4rmng9itzhtdlwaajn 2249806 2249805 2024-12-02T08:49:21Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249806 wikitext text/x-wiki l54jbzus64t03k5d6qxvt90ol9bm842 2249807 2249806 2024-12-02T08:49:33Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2249807 wikitext text/x-wiki c6ckx6v0bwlj93ck3m0ymjsicfkcyns 2249808 2249807 2024-12-02T08:52:56Z Stashbot 7414 dcausse: restarting blazegraph on wdqs1019 (BlazegraphFreeAllocatorsDecreasingRapidly) 2249808 wikitext text/x-wiki hyc9ft1nh735ae2b8sq2tho7evhe5ih 2249809 2249808 2024-12-02T08:59:33Z Stashbot 7414 elukey@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2086.codfw.wmnet with OS bullseye 2249809 wikitext text/x-wiki n2t0675lyyr7m8nvnd6vf0tds6g06yj 2249811 2249809 2024-12-02T09:09:16Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.reimage for host ms-be2086.codfw.wmnet with OS bullseye 2249811 wikitext text/x-wiki si6q3qctkwe01cuqb0jhryg2lgpm1uq 2249812 2249811 2024-12-02T09:13:13Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1020.eqiad.wmnet 2249812 wikitext text/x-wiki g9we0uxy2wetmnkm9ykc6ia4ynks851 2249813 2249812 2024-12-02T09:20:56Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2086.codfw.wmnet with reason: host reimage 2249813 wikitext text/x-wiki 085qoh99t58xbgqc809n6q6r3qdja1m 2249814 2249813 2024-12-02T09:24:47Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2086.codfw.wmnet with reason: host reimage 2249814 wikitext text/x-wiki dkfy4d0pdv8qs5wvvjvbuoz644c48vz 2249815 2249814 2024-12-02T09:28:36Z Stashbot 7414 marostegui@cumin1002: START - Cookbook sre.hosts.downtime for 1:00:00 on db1198.eqiad.wmnet with reason: testing 2249815 wikitext text/x-wiki 7gsezhc39v2ut16h0nvrsfaplfzyv74 2249816 2249815 2024-12-02T09:28:50Z Stashbot 7414 marostegui@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1198.eqiad.wmnet with reason: testing 2249816 wikitext text/x-wiki jgpmqw95tg8tqup4nyz0gon8ukbvdq1 2249817 2249816 2024-12-02T09:28:56Z Stashbot 7414 marostegui@cumin2002: dbctl commit (dc=all): 'Depoll db1198 to install 10.6.20', diff saved to https://phabricator.wikimedia.org/P71460 and previous config saved to /var/cache/conftool/dbconfig/20241202-092854-marostegui.json 2249817 wikitext text/x-wiki 4x3ur9i3gfr0ae6od9f6ujai63igxth 2249819 2249817 2024-12-02T09:35:20Z Stashbot 7414 marostegui: Installing mariadb 10.6.20 on db1198 T378940 2249819 wikitext text/x-wiki hpfvjlafj74sknvahpscba9gokas4tq 2249820 2249819 2024-12-02T09:35:29Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2249820 wikitext text/x-wiki 01x1h7bbothbqxck168suwvx8hi3mqq 2249821 2249820 2024-12-02T09:35:38Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2249821 wikitext text/x-wiki be2atzm37t3o1ftfvqsfjtxdkkj2v0o 2249823 2249821 2024-12-02T09:39:23Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2249823 wikitext text/x-wiki 3aoqb6k162t3fs0lrvk4byevn3r9mb6 2249824 2249823 2024-12-02T09:39:32Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2249824 wikitext text/x-wiki cedm8257cypv5aerkoh9hr0gma7p3c6 2249825 2249824 2024-12-02T09:41:54Z Stashbot 7414 elukey@deploy2002: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: sync 2249825 wikitext text/x-wiki i7ct1kj3m4eq3gn90zpi8zfwnkfatfj 2249826 2249825 2024-12-02T09:42:20Z Stashbot 7414 elukey@deploy2002: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: sync 2249826 wikitext text/x-wiki 280zffdprdkk8mdqbknn57ve5t80m93 2249828 2249826 2024-12-02T09:43:09Z Stashbot 7414 marostegui@cumin1002: START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1198.eqiad.wmnet with reason: optimizing 2249828 wikitext text/x-wiki mtlr5gk5xicnh5iyjal5up1cay07pnq 2249829 2249828 2024-12-02T09:43:12Z Stashbot 7414 marostegui@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1198.eqiad.wmnet with reason: optimizing 2249829 wikitext text/x-wiki 5r3607gxicwpgxa6d1c57lb84ea4gt5 2249830 2249829 2024-12-02T09:45:18Z Stashbot 7414 elukey@deploy2002: helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: sync 2249830 wikitext text/x-wiki 97vtjfocg92wjibw9mao3ndeb2z3s9f 2249831 2249830 2024-12-02T09:45:37Z Stashbot 7414 elukey@deploy2002: helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: sync 2249831 wikitext text/x-wiki hoazbpda7x6is4yuri3w3k1vgxl2nji 2249832 2249831 2024-12-02T09:45:40Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2086.codfw.wmnet with OS bullseye 2249832 wikitext text/x-wiki 3unfsqn2ci8fl2b02irsr1g2xe5g7pn 2249833 2249832 2024-12-02T09:47:50Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.k8s.pool-depool-node depool for host mw[2436-2437].codfw.wmnet 2249833 wikitext text/x-wiki hxxyumqhe6pk909vkzgnoix2vwvibhw 2249835 2249833 2024-12-02T09:48:55Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw[2436-2437].codfw.wmnet 2249835 wikitext text/x-wiki mfrnabr3rs1tbqnq0er89evbcera1nm 2249836 2249835 2024-12-02T09:51:46Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2249836 wikitext text/x-wiki e18koin438x8gu4ocs3woejbaphoclx 2249837 2249836 2024-12-02T09:51:55Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2249837 wikitext text/x-wiki mdjyz9i0f8d95pfain5ey89u0u8uxyn 2249838 2249837 2024-12-02T09:52:25Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.reimage for host ms-be2087.codfw.wmnet with OS bullseye 2249838 wikitext text/x-wiki e874frelmop8t27yentibe7kz5gljhd 2249839 2249838 2024-12-02T09:52:32Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on mw[2436-2437].codfw.wmnet with reason: rename/reimage 2249839 wikitext text/x-wiki gp2yrm90vo7nwpcl5gi6o333mv199ez 2249840 2249839 2024-12-02T09:52:49Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on mw[2436-2437].codfw.wmnet with reason: rename/reimage 2249840 wikitext text/x-wiki evz90zz5zgrqps5ts9hzzzll3zr68d9 2249841 2249840 2024-12-02T09:56:18Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.reimage for host pc1017.eqiad.wmnet with OS bookworm 2249841 wikitext text/x-wiki 2m9hbv3glzkyt1etv062ajg2zvlmf6x 2249842 2249841 2024-12-02T10:03:03Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.provision for host mw2436.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2249842 wikitext text/x-wiki d654jjdb8hhasgsz3mxzsav5uzn777r 2249843 2249842 2024-12-02T10:04:09Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.provision for host mw2437.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2249843 wikitext text/x-wiki jb1vi7qzfc1y0cvt4e0givhs9cx3ucl 2249844 2249843 2024-12-02T10:05:13Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2087.codfw.wmnet with reason: host reimage 2249844 wikitext text/x-wiki f05vzoh1y25meq7tmt3gog4vr73hhra 2249845 2249844 2024-12-02T10:09:11Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2087.codfw.wmnet with reason: host reimage 2249845 wikitext text/x-wiki a0kjzrbe340o3wl4l84lk1aa3giwhtk 2249846 2249845 2024-12-02T10:09:38Z Stashbot 7414 marostegui@cumin1002: START - Cookbook sre.hosts.downtime for 3 days, 8:00:00 on db1167.eqiad.wmnet with reason: alter 2249846 wikitext text/x-wiki 0bzm5y0rgu9cjxe4pfpuz3rwqwpyxbi 2249847 2249846 2024-12-02T10:09:41Z Stashbot 7414 marostegui@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 8:00:00 on db1167.eqiad.wmnet with reason: alter 2249847 wikitext text/x-wiki a471xfhqh90y2jfcr6gmpj8232ocyb0 2249848 2249847 2024-12-02T10:10:09Z Stashbot 7414 marostegui@cumin1002: START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet,db1154.eqiad.wmnet with reason: alter 2249848 wikitext text/x-wiki f2swk43xlw5syvk69t0nxymaprhw1k7 2249849 2249848 2024-12-02T10:10:26Z Stashbot 7414 marostegui@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet,db1154.eqiad.wmnet with reason: alter 2249849 wikitext text/x-wiki 57xbezd7hiozo8eqtnc7uzw6ayhybb4 2249850 2249849 2024-12-02T10:12:27Z Stashbot 7414 marostegui@cumin2002: dbctl commit (dc=all): 'Depool db1167 for an alter table', diff saved to https://phabricator.wikimedia.org/P71461 and previous config saved to /var/cache/conftool/dbconfig/20241202-101225-marostegui.json 2249850 wikitext text/x-wiki 1swjq6z0xkvh668a7v2m2tp0fsvdxhk 2249851 2249850 2024-12-02T10:12:52Z Stashbot 7414 marostegui: Deploy schema change on db1167 - s8 sanitarium master, there will be days of lag in wikireplicas in s8 T367856 2249851 wikitext text/x-wiki 2cmbnwp0vq9m49eqp340gw0recg2ywv 2249852 2249851 2024-12-02T10:12:58Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on pc1017.eqiad.wmnet with reason: host reimage 2249852 wikitext text/x-wiki bqxs9prwxxuzs2ymjjui9lze7lm237v 2249853 2249852 2024-12-02T10:16:00Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1017.eqiad.wmnet with reason: host reimage 2249853 wikitext text/x-wiki 60dju8rkjehyazlh9qlyni7pvyqm9wd 2249854 2249853 2024-12-02T10:16:43Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2436.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2249854 wikitext text/x-wiki 847cjhwd4bjnxb9rgohstuszncn8bkg 2249855 2249854 2024-12-02T10:16:45Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2437.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2249855 wikitext text/x-wiki p4zfy4wo0rauotfbofcj1ju3iawpv65 2249856 2249855 2024-12-02T10:26:45Z Stashbot 7414 ladsgroup@deploy2002: Started scap sync-world: Backport for [[gerrit:1099653|Enable new ParserCache key schema on every page (T373037)]] 2249856 wikitext text/x-wiki dkxranyd2yaexr4oy2m4yououcmev6f 2249857 2249856 2024-12-02T10:31:13Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2087.codfw.wmnet with OS bullseye 2249857 wikitext text/x-wiki aedp8rik03uo4376jaw96h2zk1vp5x6 2249858 2249857 2024-12-02T10:32:51Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'sync'. 2249858 wikitext text/x-wiki rxxpo6a9c3d6m0iufrfacs0d9967bkj 2249859 2249858 2024-12-02T10:32:55Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'sync'. 2249859 wikitext text/x-wiki s04n74pmj5ch6r9dhj5s6a9yvpojfam 2249860 2249859 2024-12-02T10:33:23Z Stashbot 7414 ladsgroup@deploy2002: ladsgroup: Backport for [[gerrit:1099653|Enable new ParserCache key schema on every page (T373037)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2249860 wikitext text/x-wiki 9cmf63mlgzl6vuxdoxgam8vrovym63a 2249861 2249860 2024-12-02T10:35:54Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.reimage for host ms-be2088.codfw.wmnet with OS bullseye 2249861 wikitext text/x-wiki 8xa44l3sxga1kgunqdytkdfvgi6il4v 2249862 2249861 2024-12-02T10:37:25Z Stashbot 7414 ladsgroup@deploy2002: ladsgroup: Continuing with sync 2249862 wikitext text/x-wiki p3v89wo6ejkim08yzywibxb9l29phio 2249863 2249862 2024-12-02T10:38:04Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc1017.eqiad.wmnet with OS bookworm 2249863 wikitext text/x-wiki 5r0slclbydkz57kkm0ehh3fs6ti9nxx 2249864 2249863 2024-12-02T10:44:10Z Stashbot 7414 ladsgroup@deploy2002: Finished scap sync-world: Backport for [[gerrit:1099653|Enable new ParserCache key schema on every page (T373037)]] (duration: 17m 25s) 2249864 wikitext text/x-wiki h6cksprue3vhylh3otwbk34ont54kav 2249865 2249864 2024-12-02T10:45:12Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.k8s.pool-depool-node depool for host kubernetes1017.eqiad.wmnet 2249865 wikitext text/x-wiki r7xpkdphwtmikc0uwsmdmlv8lcqy0uw 2249866 2249865 2024-12-02T10:45:45Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubernetes1017.eqiad.wmnet 2249866 wikitext text/x-wiki lj2153pi6m9k0qxqys0we19o4tujlg7 2249867 2249866 2024-12-02T10:46:09Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.rename from mw2436 to wikikube-worker2005 2249867 wikitext text/x-wiki q6du8qx655l5pikzuwfn2t99ktvi9om 2249868 2249867 2024-12-02T10:46:20Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.netbox 2249868 wikitext text/x-wiki rx0my1mmo6gy17z4pj3afz8knmbcpai 2249869 2249868 2024-12-02T10:46:29Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.rename from mw2437 to wikikube-worker2006 2249869 wikitext text/x-wiki 63eb86peugl7m52zz1z6ci3pnw7huhx 2249870 2249869 2024-12-02T10:48:52Z Stashbot 7414 elukey@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2088.codfw.wmnet with reason: host reimage 2249870 wikitext text/x-wiki kv0mz04ahdbqs3jj3o16mlh66i2qqhc 2249871 2249870 2024-12-02T10:50:42Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2436 to wikikube-worker2005 - jayme@cumin2002" 2249871 wikitext text/x-wiki pwdd9axcq9b0g1gdzrac3zypfcn7ksc 2249872 2249871 2024-12-02T10:51:09Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2436 to wikikube-worker2005 - jayme@cumin2002" 2249872 wikitext text/x-wiki ofsmffljss1nfjm15v9iexp9suzqhkb 2249873 2249872 2024-12-02T10:51:10Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2249873 wikitext text/x-wiki 31mxr7nixye0r527ytn4zp5whcs33y5 2249874 2249873 2024-12-02T10:51:11Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2005 2249874 wikitext text/x-wiki mwbtfjjl4oujcjkqx708l1h55hjss4d 2249875 2249874 2024-12-02T10:51:23Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.netbox 2249875 wikitext text/x-wiki 6tktfli7r006ccdjj3hlslnqiy6d04x 2249876 2249875 2024-12-02T10:51:24Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2005 2249876 wikitext text/x-wiki p1deij1r402mtb1jcyetaafoo8t8f3d 2249877 2249876 2024-12-02T10:52:03Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2088.codfw.wmnet with reason: host reimage 2249877 wikitext text/x-wiki iqfbvz2oxmbhzq2ewkax14sbtyq5445 2249878 2249877 2024-12-02T10:52:04Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2436 to wikikube-worker2005 2249878 wikitext text/x-wiki olxlbmy4c3f1w3lakwrxjc6o52r5gor 2249879 2249878 2024-12-02T10:54:46Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2437 to wikikube-worker2006 - jayme@cumin2002" 2249879 wikitext text/x-wiki 53hacav649ma3y2fa77wy3otoqe5f9u 2249880 2249879 2024-12-02T10:54:51Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming mw2437 to wikikube-worker2006 - jayme@cumin2002" 2249880 wikitext text/x-wiki 33opikfa7ont7f74jcus7oqpn1xnar7 2249881 2249880 2024-12-02T10:54:52Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2249881 wikitext text/x-wiki m11q35nbkj4f421govqgib2778n6sov 2249882 2249881 2024-12-02T10:54:53Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2006 2249882 wikitext text/x-wiki b2scyfy1b1r0wkderz0lnmu37vnoks2 2249883 2249882 2024-12-02T10:55:06Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2006 2249883 wikitext text/x-wiki qbmg9vujy31ohw699v5cxmfxe7ur5jz 2249884 2249883 2024-12-02T10:55:46Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from mw2437 to wikikube-worker2006 2249884 wikitext text/x-wiki 2ujfqslfkma0tcurro4l7hz0bav8umv 2249885 2249884 2024-12-02T11:00:04Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.hosts.rename from kubernetes1017 to wikikube-worker1005 2249885 wikitext text/x-wiki bnkl230ro8mvfrckf3u2xsynl2j3hcg 2249886 2249885 2024-12-02T11:00:23Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.dns.netbox 2249886 wikitext text/x-wiki 2vzz6nar9fmrvcraxw7qn1jr8rz18aq 2249887 2249886 2024-12-02T11:01:15Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.wipe-cache wikikube-worker2005.codfw.wmnet wikikube-worker2006.codfw.wmnet on all recursors 2249887 wikitext text/x-wiki p4lgnog7lrwfz8ni09z6qnruqhig4dw 2249888 2249887 2024-12-02T11:01:18Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2005.codfw.wmnet wikikube-worker2006.codfw.wmnet on all recursors 2249888 wikitext text/x-wiki 4iz7we0522ymaa7q4bf6hp6rbrppytt 2249889 2249888 2024-12-02T11:02:06Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2006.codfw.wmnet with OS bookworm 2249889 wikitext text/x-wiki beexvwptrnhxgzu40o3e4d8a7r05l3q 2249890 2249889 2024-12-02T11:02:17Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.move-vlan for host wikikube-worker2006 2249890 wikitext text/x-wiki f1c7wq8xurra1s2d3nv7qyxsomnzfha 2249891 2249890 2024-12-02T11:02:42Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker2005.codfw.wmnet with OS bookworm 2249891 wikitext text/x-wiki s2n4waks4itgj7fsmm19wollp9j5zhr 2249892 2249891 2024-12-02T11:04:17Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1017 to wikikube-worker1005 - jelto@cumin1002" 2249892 wikitext text/x-wiki spdqwp54wwckfl80iuzz1advwcjo6fu 2249893 2249892 2024-12-02T11:05:02Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1017 to wikikube-worker1005 - jelto@cumin1002" 2249893 wikitext text/x-wiki 0e0x45r97lpb7e5mjskzj4wq5vdsih3 2249894 2249893 2024-12-02T11:05:07Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2249894 wikitext text/x-wiki b848wix0sh1q4ergsdrep31lgx35ja2 2249895 2249894 2024-12-02T11:05:09Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1005 2249895 wikitext text/x-wiki ksvbg4p90tzt6zunyuukfgtlbjqc7bf 2249896 2249895 2024-12-02T11:05:30Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.netbox 2249896 wikitext text/x-wiki qfv29ulnd29w3zwj3lmmge9wlzngkd8 2249897 2249896 2024-12-02T11:06:25Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1005 2249897 wikitext text/x-wiki omk3g6juzndazcbw08bsjihzwbsvi1l 2249898 2249897 2024-12-02T11:07:04Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from kubernetes1017 to wikikube-worker1005 2249898 wikitext text/x-wiki mrgrw08khscrpbeeab9zhgfdnmuc3fu 2249900 2249898 2024-12-02T11:07:55Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2249900 wikitext text/x-wiki 4yul6hqzra7ra8wgcx1r2t5zp4jfi17 2249901 2249900 2024-12-02T11:08:10Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2249901 wikitext text/x-wiki 6sz7pqkbo3qwv13rjsjgwxciyvokzm3 2249902 2249901 2024-12-02T11:08:45Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2249902 wikitext text/x-wiki kejn9twe0b2g1um3t7nvwebfk8zed5m 2249903 2249902 2024-12-02T11:09:00Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2249903 wikitext text/x-wiki jz3bh6nx759w6bgmbyxz72aiinlfdjs 2249904 2249903 2024-12-02T11:09:09Z Stashbot 7414 ladsgroup@deploy2002: Started scap sync-world: Backport for [[gerrit:1099659|Translate: Disable message group subscription feature for legalteamwiki (T372386 T381250)]] 2249904 wikitext text/x-wiki m7j1spcj5w1a61kzma2qjaxi8wa1fwf 2249905 2249904 2024-12-02T11:13:15Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2006 - jayme@cumin2002" 2249905 wikitext text/x-wiki 9np6udkqxl8egr93g7edha8cps34thb 2249906 2249905 2024-12-02T11:13:20Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2006 - jayme@cumin2002" 2249906 wikitext text/x-wiki iy57vudymmx6t3lh0pc7j4c7tbn1v3b 2249907 2249906 2024-12-02T11:13:21Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2249907 wikitext text/x-wiki mrtmypp1toye4lg269n073ipfrf7ln3 2249908 2249907 2024-12-02T11:13:22Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.wipe-cache wikikube-worker2006.codfw.wmnet 141.32.192.10.in-addr.arpa 1.4.1.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2249908 wikitext text/x-wiki tk1kim083brzwvnps2hu76v2ey8fdz2 2249909 2249908 2024-12-02T11:13:25Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2006.codfw.wmnet 141.32.192.10.in-addr.arpa 1.4.1.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2249909 wikitext text/x-wiki 5t0jqkco0lko0840niimsnk79gww0z7 2249910 2249909 2024-12-02T11:13:26Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2006 2249910 wikitext text/x-wiki b64qp36vjtw048r5yefr96u5qa1u566 2249911 2249910 2024-12-02T11:13:36Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2006 2249911 wikitext text/x-wiki 1xvq7u07bp6x5vq3q3y0smf378jfmrc 2249912 2249911 2024-12-02T11:13:37Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2006 2249912 wikitext text/x-wiki de18n9tcobbu4jewtv2levj4jm1arte 2249913 2249912 2024-12-02T11:14:20Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.move-vlan for host wikikube-worker2005 2249913 wikitext text/x-wiki kb6p1wgmzhwmgq8mzs8ppyjkgul1xb6 2249914 2249913 2024-12-02T11:14:25Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.netbox 2249914 wikitext text/x-wiki gz5nnp13vxl9k4p5qrsk9r0ehkhzwt6 2249915 2249914 2024-12-02T11:14:55Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.dns.wipe-cache kubernetes1017.eqiad.wmnet wikikube-worker1005.eqiad.wmnet on all recursors 2249915 wikitext text/x-wiki hhgp8eiacbhcyignxmy8xqjpnbaoass 2249916 2249915 2024-12-02T11:15:00Z Stashbot 7414 ladsgroup@deploy2002: Started scap sync-world: Backport for [[gerrit:1099659|Translate: Disable message group subscription feature for legalteamwiki (T372386 T381250)]] 2249916 wikitext text/x-wiki 9335k1gkgnvq2hz8bd84xfdo43yishs 2249917 2249916 2024-12-02T11:15:02Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) kubernetes1017.eqiad.wmnet wikikube-worker1005.eqiad.wmnet on all recursors 2249917 wikitext text/x-wiki 4vh0cakugysdfel852ac79zw871yke9 2249918 2249917 2024-12-02T11:15:25Z Stashbot 7414 elukey@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2088.codfw.wmnet with OS bullseye 2249918 wikitext text/x-wiki 11gguvm86oisdtsked94qznj1zfx8s9 2249919 2249918 2024-12-02T11:15:41Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2249919 wikitext text/x-wiki 65tr4je2zkdydveu07306h8qgwkxcj2 2249920 2249919 2024-12-02T11:15:57Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2249920 wikitext text/x-wiki 3uylqksqqw7r06vrpvgenjw9fwxfqz2 2249921 2249920 2024-12-02T11:19:26Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2005 - jayme@cumin2002" 2249921 wikitext text/x-wiki 6v4mx29ijf6yewrrov4qi4h69cvlkke 2249922 2249921 2024-12-02T11:19:32Z Stashbot 7414 ladsgroup@deploy2002: abi, ladsgroup: Backport for [[gerrit:1099659|Translate: Disable message group subscription feature for legalteamwiki (T372386 T381250)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2249922 wikitext text/x-wiki jnjqmh0xi6s9kue0p1cobrozr2hpmh9 2249923 2249922 2024-12-02T11:19:33Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker2005 - jayme@cumin2002" 2249923 wikitext text/x-wiki 8cexpwipb5z7uihzvgycinyk9e6xtkl 2249924 2249923 2024-12-02T11:19:34Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2249924 wikitext text/x-wiki rz0vtpa9706lpljomobrtbz55luo3wr 2249925 2249924 2024-12-02T11:19:35Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.wipe-cache wikikube-worker2005.codfw.wmnet 40.32.192.10.in-addr.arpa 0.4.0.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2249925 wikitext text/x-wiki 797w3qw6sy676prqj8rq5qnp71avfnz 2249926 2249925 2024-12-02T11:19:36Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker2005.codfw.wmnet 40.32.192.10.in-addr.arpa 0.4.0.0.2.3.0.0.2.9.1.0.0.1.0.0.3.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2249926 wikitext text/x-wiki swv3qrfyphz6z1zkf527mq6oa7zdt3o 2249927 2249926 2024-12-02T11:19:37Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker2005 2249927 wikitext text/x-wiki nfrh49z8mqugsupq2qmc4pfvazmtziq 2249928 2249927 2024-12-02T11:19:38Z Stashbot 7414 ladsgroup@deploy2002: abi, ladsgroup: Continuing with sync 2249928 wikitext text/x-wiki 3bwc9z8xdyj0mwsxy1f8jswskm5ksy5 2249929 2249928 2024-12-02T11:21:08Z Stashbot 7414 marostegui@cumin2002: dbctl commit (dc=all): 'Depool es2020 T381259', diff saved to https://phabricator.wikimedia.org/P71463 and previous config saved to /var/cache/conftool/dbconfig/20241202-112105-marostegui.json 2249929 wikitext text/x-wiki mvra93l9uui9064yzdcgtc2fu1zndt1 2249931 2249929 2024-12-02T11:22:40Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker1005.eqiad.wmnet with OS bookworm 2249931 wikitext text/x-wiki 50wvpr69ecnvqxlrlm7mahbpp5gf67c 2249932 2249931 2024-12-02T11:23:22Z Stashbot 7414 topranks: rollback OSPF metric change on cr4-ulsfo to place all codfw to eqsin traffic back on primary transport link 2249932 wikitext text/x-wiki af5llu5g23oirslov44ey0jrwnpaeyc 2249933 2249932 2024-12-02T11:23:30Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker2005 2249933 wikitext text/x-wiki bqg8wqu4pd8yme77rp1xrod1059fy4t 2249934 2249933 2024-12-02T11:23:31Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2005 2249934 wikitext text/x-wiki 1di4dyzk5nds44tofmctmjwz9gpxt9r 2249935 2249934 2024-12-02T11:26:22Z Stashbot 7414 ladsgroup@deploy2002: Finished scap sync-world: Backport for [[gerrit:1099659|Translate: Disable message group subscription feature for legalteamwiki (T372386 T381250)]] (duration: 11m 21s) 2249935 wikitext text/x-wiki 8cbf2ud5lu4qghccsw1nkvsubiw0sa0 2249936 2249935 2024-12-02T11:33:12Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2006.codfw.wmnet with reason: host reimage 2249936 wikitext text/x-wiki 99xkbpw820fir5853z5ehxgwosjo6az 2249937 2249936 2024-12-02T11:36:50Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2006.codfw.wmnet with reason: host reimage 2249937 wikitext text/x-wiki ofqtcvujdsi0szr83mffzz2zd1mkj1x 2249938 2249937 2024-12-02T11:38:18Z Stashbot 7414 marostegui@cumin1002: START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on es2020.codfw.wmnet with reason: cloning 2249938 wikitext text/x-wiki owjnh4atk5z4i74h1rz2ar44s0f595n 2249939 2249938 2024-12-02T11:38:31Z Stashbot 7414 marostegui@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on es2020.codfw.wmnet with reason: cloning 2249939 wikitext text/x-wiki 23q8yt3et82q0se5csa4h3yn1g1tkiq 2249940 2249939 2024-12-02T11:38:44Z Stashbot 7414 jelto@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1005.eqiad.wmnet with reason: host reimage 2249940 wikitext text/x-wiki 9bfid8e9df1oj0lv67zrd23fyq70qv6 2249941 2249940 2024-12-02T11:42:36Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2005.codfw.wmnet with reason: host reimage 2249941 wikitext text/x-wiki 4oj7orfrv3qzl1nzh1bbqv9u0voqoko 2249942 2249941 2024-12-02T11:42:40Z Stashbot 7414 jelto@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1005.eqiad.wmnet with reason: host reimage 2249942 wikitext text/x-wiki 2z7q3uj5hk1wod9yfavvholamyzihb4 2249944 2249942 2024-12-02T11:45:43Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.downtime for 1:00:00 on ms-be1070.eqiad.wmnet with reason: vacuum two overlarge container dbs 2249944 wikitext text/x-wiki 7qeh35n2ohdu6pl5kae4rarkm59nhj0 2249945 2249944 2024-12-02T11:46:11Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on ms-be1070.eqiad.wmnet with reason: vacuum two overlarge container dbs 2249945 wikitext text/x-wiki 1xiarkbrye13lvisczujo7viyg7sajj 2249946 2249945 2024-12-02T11:46:21Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2005.codfw.wmnet with reason: host reimage 2249946 wikitext text/x-wiki oj3zgv0jda9u8mf2ojug51wb9hgg1wq 2249948 2249946 2024-12-02T11:52:42Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.remove-downtime for ms-be1070.eqiad.wmnet 2249948 wikitext text/x-wiki pitsrfb4oamhncq24p1zu6y2fkdiktj 2249949 2249948 2024-12-02T11:52:44Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ms-be1070.eqiad.wmnet 2249949 wikitext text/x-wiki i0wd5jho9v9hb6i5ooul25qc87kl9sl 2249950 2249949 2024-12-02T11:55:49Z Stashbot 7414 marostegui: Stop mariadb on es2020 to clone es2041 T381259 2249950 wikitext text/x-wiki 28pfi5n1dvo3u7judmu2b1945b7o0oi 2249951 2249950 2024-12-02T11:56:31Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2006.codfw.wmnet with OS bookworm 2249951 wikitext text/x-wiki 4yws71irofb2u8tvkyplh5lr3ln8m30 2249952 2249951 2024-12-02T11:56:59Z Stashbot 7414 jiji@cumin1002: START - Cookbook sre.hosts.decommission for hosts mc-gp2001.codfw.wmnet 2249952 wikitext text/x-wiki dqu48294kng5yl6auutx04l0y8sbcvs 2249953 2249952 2024-12-02T11:57:33Z Stashbot 7414 moritzm: upload mapnik 4.0.3+ds-2~wmf12u2 (adding a forward ported mapnik-config script to be consumed by node-mapnik even with the switch of mapnik 4 towards pkg-config) T327396 2249953 wikitext text/x-wiki 0vww2qt48lawtnwn5o7u6c0vk7lfle0 0 10397 2249947 2182372 2024-12-02T11:46:25Z Alexandros Kosiaris 1276 2249947 wikitext text/x-wiki l6jr9nnwzroaenaic2cp0uaw8n4vfao 0 17290 2249818 2248663 2024-12-02T09:32:46Z Stashbot 7414 hashar: deployment-prep: pruning branches and tags from the git repositories under /srv/mediawiki-staging 2249818 wikitext text/x-wiki 6qfinvq5qgk3g58nmzwvokfh4lv1g6g 2249899 2249818 2024-12-02T11:07:27Z Stashbot 7414 hashar: integration: rebooted integration-puppetserver-01 , stall waiting for IO after having cherry picked a puppet.git patch 2249899 wikitext text/x-wiki azh95wcwtkswlzk2797iotfnm99gu3l 0 20832 2249760 2173452 2024-12-02T00:53:47Z Wargo 15859 /* Virtual machine requests (Production) */ not wmcloud too 2249760 wikitext text/x-wiki n3kg2bqy6xiq84sfrh8p4vlkvvcnhz5 0 91251 2249943 2182371 2024-12-02T11:44:40Z Alexandros Kosiaris 1276 Add warning to url-downloader 2249943 wikitext text/x-wiki 7r4nk5wvzx4o4w3kep9s6115rty4ota 0 443686 2249822 2248546 2024-12-02T09:36:14Z Mvolz 2813 /* Staging */ 2249822 wikitext text/x-wiki a8a3e3xp24av60pme10sb0szy65fsc5 498 443800 2249739 2249546 2024-12-01T18:26:26Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-13: deployed e6cd8c4e34 (add preference for watchlist behavior) 2249739 wikitext text/x-wiki 1bf4bacdnubwgv02ternp1mu3fhqtpt 12 444256 2249740 2242307 2024-12-01T19:14:11Z Wargo 15859 /* Create and manage files */ update - GUI 2249740 wikitext text/x-wiki ogm30b8u0h5roxrujfw3qb5smx2vlj0 0 446656 2249759 2208424 2024-12-02T00:33:17Z Wargo 15859 link target 2249759 wikitext text/x-wiki 564jvxgdl9m11eeehwf5hn5o5aemi7u 0 447990 2249758 2107217 2024-12-02T00:32:48Z Wargo 15859 /* What sites are SSO enabled? */ partial update 2249758 wikitext text/x-wiki eumr7zi72f9rl0dmg6cdccbogpi2hwe 0 449160 2249756 2249732 2024-12-02T00:01:48Z Dexbot 30554 Bot: Updating the report 2249756 wikitext text/x-wiki me3plueox5lz3fpym1qzx69brpnacl9 2249930 2249756 2024-12-02T11:21:31Z Dexbot 30554 Bot: Updating the report 2249930 wikitext text/x-wiki 24ecrm7n5hlpcfmpt6t7b6ap91d0usp 12 452933 2249742 2249390 2024-12-01T22:46:24Z Lucas Werkmeister 8093 /* Creating a new environment variable */ fix name of system vars 2249742 wikitext text/x-wiki 1yjcdu7w953cor2gkdzyxi6csiku8l7 2249743 2249742 2024-12-01T22:46:43Z Lucas Werkmeister 8093 /* Features that are already available */ fix syntax 2249743 wikitext text/x-wiki ow9wvsspw7gy6pbpxug5an4dj31hgj6 2249757 2249743 2024-12-02T00:27:45Z Lucas Werkmeister 8093 document that envvar names are public (I found this surprising but it’s probably not a security issue) 2249757 wikitext text/x-wiki 6dzf2c0bqevadzec8xik4zj0f1emkyd 116 453426 2249741 2249249 2024-12-01T19:27:58Z Phabbanbot 37210 Adarshsingh was disabled by JJMC89 2249741 wikitext text/x-wiki cgqvnmohnwcywcp8odal4ht4exdp0ls 3 454451 2249772 2247082 2024-12-02T06:52:16Z MABot 10804 Bot: Archiving 1 thread from [[User talk:BryanDavis]] 2249772 wikitext text/x-wiki kbzvqhulmri2qfz2yatxhje8n5w6pkq 2 455656 2249810 2238358 2024-12-02T09:03:40Z LToscano (WMF) 37705 2249810 wikitext text/x-wiki gazsz4rbcoo57obci8u0e1csv2laz2y 498 456246 2249733 2024-12-01T12:00:16Z Labslogbot 55 Auto update of instance info. 2249733 wikitext text/x-wiki guy26x0itjjbv71jz0nnpkz18gtzymn 3 456247 2249775 2024-12-02T07:33:49Z StrikerBot 8475 Welcome to Toolforge! 2249775 wikitext text/x-wiki ct6w78xla9jbn5445g30h9d9zxz3vpa 3 456248 2249776 2024-12-02T07:34:54Z StrikerBot 8475 Welcome to Toolforge! 2249776 wikitext text/x-wiki 0wofe67qo59njbytpmejwh3n8a5palr 498 456249 2249834 2024-12-02T09:48:35Z Stashbot 7414 wmbot~urbanecm@tools-bastion-13: Deploy 9743f47 (T331193) 2249834 wikitext text/x-wiki b9cjnm8cd794eyornssvsxyirj8rgi0