Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.44.0-wmf.4 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Help:Cloud VPS 12 558 2247076 2127263 2024-11-24T18:13:33Z Taavi 13997 new key for [[Category:Cloud VPS]]: " " using [[Help:Gadget-HotCat|HotCat]] 2247076 wikitext text/x-wiki ow8bco9ac2o4aqe7z15z89i64ycuo33 Deployments 0 4108 2247081 2247046 2024-11-25T02:41:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1078105]] to Monday, November 25 UTC afternoon backport window 2247081 wikitext text/x-wiki glrvf5bdjx03dga53tj4wgd3zit34iy 2247085 2247081 2024-11-25T07:45:01Z Gergő Tisza 392 /* Monday, November 25 */ 2247085 wikitext text/x-wiki ongir0vi6ors10kpdqq22112grs0uw6 2247087 2247085 2024-11-25T07:49:18Z ScheduleDeploymentBot 37566 Add [[gerrit:1053230]] to Monday, November 25 UTC morning backport window 2247087 wikitext text/x-wiki 4h525hbfyakkheaor91u9xgw72j7m6f Nova Resource:Toolsbeta/SAL 498 6726 2247139 2247050 2024-11-25T09:20:30Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2247139 wikitext text/x-wiki 6yee8d7tfipvaj32h80nlsesx7bycsz 2247141 2247139 2024-11-25T09:26:57Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2247141 wikitext text/x-wiki 7bnygtznczlush1cxfwkwyv2pa3h9bh 2247172 2247141 2024-11-25T10:35:35Z Stashbot 7414 sstefanova@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2247172 wikitext text/x-wiki 4p1aqbsvsc1lwff0lowl5ph7dwbnkdl 2247180 2247172 2024-11-25T10:40:19Z Stashbot 7414 sstefanova@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2247180 wikitext text/x-wiki fsg0dfup0va4kaizhuu6b7k14b5gslv 2247182 2247180 2024-11-25T10:55:59Z Stashbot 7414 sstefanova@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2247182 wikitext text/x-wiki gp2a1tdxpu2b5bdgiuk2v7805xsh81x 2247185 2247182 2024-11-25T11:02:01Z Stashbot 7414 sstefanova@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2247185 wikitext text/x-wiki 70qapnxr7skbu78z3ethh76ugjqw7iq 2247189 2247185 2024-11-25T11:03:36Z Stashbot 7414 sstefanova@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2247189 wikitext text/x-wiki g9w59xbx2woohuovz5o9i5ul0qtux99 User talk:BryanDavis 3 7542 2247083 2239265 2024-11-25T06:52:28Z MABot 10804 Bot: Archiving 1 thread (older than 30 days) to [[User talk:BryanDavis/Archives/2024]] 2247083 wikitext text/x-wiki 4oge04yjvefqpmlqdcp2dq904o5qg0i Server Admin Log 0 7919 2247084 2247060 2024-11-25T07:15:32Z Stashbot 7414 _joe_: upgrading vopsbot to 0.3.9 2247084 wikitext text/x-wiki emcoomtzzmumef5wjjahxbnljw2etqx 2247086 2247084 2024-11-25T07:47:49Z Stashbot 7414 moritzm: remove ganeti7004 from active Ganeti nodes in magru02 T376737 2247086 wikitext text/x-wiki q0swguettvikvokxppjdn8186xu1f30 2247088 2247086 2024-11-25T07:53:20Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7003.magru.wmnet 2247088 wikitext text/x-wiki tfntrcudd3rdwqfdg8my2r8d62clemf 2247089 2247088 2024-11-25T07:54:00Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti7003.magru.wmnet 2247089 wikitext text/x-wiki qlibtit43notm1q3i7q73vax2cuivyq 2247090 2247089 2024-11-25T07:55:42Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled 2247090 wikitext text/x-wiki 1eypwto851h7rwb1xxoew1mp6axh5pa 2247091 2247090 2024-11-25T07:55:55Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled 2247091 wikitext text/x-wiki khhun68f1uqh5rg4g8mquue681m60z4 2247092 2247091 2024-11-25T07:56:10Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: T373037, host is not pooled 2247092 wikitext text/x-wiki d8sln9l4ku9k42ivv1hjvj6xm2pi7b3 2247093 2247092 2024-11-25T07:56:23Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: T373037, host is not pooled 2247093 wikitext text/x-wiki jghvagijo8bj9ry1bg44qao4mas74do 2247094 2247093 2024-11-25T07:57:39Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 4:00:00 on db2240.codfw.wmnet with reason: Maintenance 2247094 wikitext text/x-wiki 6m6pt595l0fhq0u4fyxs8y74pzx4kr2 2247095 2247094 2024-11-25T07:57:52Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2240.codfw.wmnet with reason: Maintenance 2247095 wikitext text/x-wiki g6nc7oze1n1a9ki3hdxccfxa6kdopyp 2247096 2247095 2024-11-25T07:58:01Z Stashbot 7414 arnaudb@cumin1002: dbctl commit (dc=all): 'Depooling db2240 (T367781)', diff saved to https://phabricator.wikimedia.org/P71119 and previous config saved to /var/cache/conftool/dbconfig/20241125-075758-arnaudb.json 2247096 wikitext text/x-wiki mheci6yb136f0ew0z4dsx8bgtx2b7hz 2247097 2247096 2024-11-25T08:00:13Z Stashbot 7414 arnaudb@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2240 (T367781)', diff saved to https://phabricator.wikimedia.org/P71120 and previous config saved to /var/cache/conftool/dbconfig/20241125-080010-arnaudb.json 2247097 wikitext text/x-wiki kphhtn86w278nilrxzwjdfpkfkt1135 2247098 2247097 2024-11-25T08:00:41Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of netflow7001.magru.wmnet to plain 2247098 wikitext text/x-wiki 70dn47exht7b9uqwa29ugeoqwmq6jkw 2247099 2247098 2024-11-25T08:02:38Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of netflow7001.magru.wmnet to plain 2247099 wikitext text/x-wiki 2y4a9ct6359sqcll3jqhh3vw78b851w 2247104 2247099 2024-11-25T08:08:42Z Stashbot 7414 tgr@deploy2002: Started scap sync-world: Backport for [[gerrit:1094071|Disable more extensions when using the shared login domain (T373737)]] 2247104 wikitext text/x-wiki qoq1u9zpb6jljoizuyhhvi6rfuixlfv 2247105 2247104 2024-11-25T08:10:58Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir7001.magru.wmnet to plain 2247105 wikitext text/x-wiki sdf7rdubnmhbalkz21bp10hp40a6nyd 2247106 2247105 2024-11-25T08:11:36Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir7001.magru.wmnet to plain 2247106 wikitext text/x-wiki m8qq7wzv13pe2xaoh3hj5rerq5htjov 2247107 2247106 2024-11-25T08:15:18Z Stashbot 7414 arnaudb@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P71121 and previous config saved to /var/cache/conftool/dbconfig/20241125-081517-arnaudb.json 2247107 wikitext text/x-wiki qbnd3oztbtbknbncn5bg6zcemdh3h2h 2247108 2247107 2024-11-25T08:15:30Z Stashbot 7414 jelto@deploy2002: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2247108 wikitext text/x-wiki nlr2irgp4hmg98tdlxwb303jg3mbsj0 2247109 2247108 2024-11-25T08:16:01Z Stashbot 7414 jelto@deploy2002: helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply 2247109 wikitext text/x-wiki boims8rua63mtcyk5qh60zgcybt4waw 2247110 2247109 2024-11-25T08:16:41Z Stashbot 7414 jelto@deploy2002: helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply 2247110 wikitext text/x-wiki pgftw7mdb523039i7zl5n8k4h4xa2dc 2247111 2247110 2024-11-25T08:17:05Z Stashbot 7414 jelto@deploy2002: helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply 2247111 wikitext text/x-wiki 88qnnkpjgom32qxmv8susnrgwzr2xjy 2247112 2247111 2024-11-25T08:17:23Z Stashbot 7414 jelto@deploy2002: helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply 2247112 wikitext text/x-wiki ikxyd4snr5gepuq7466xe8k00ma1o1g 2247113 2247112 2024-11-25T08:17:45Z Stashbot 7414 jelto@deploy2002: helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply 2247113 wikitext text/x-wiki acvi2clw0apn14ai3bc39tnrsf9kxtb 2247114 2247113 2024-11-25T08:25:04Z Stashbot 7414 tgr@deploy2002: tgr: Backport for [[gerrit:1094071|Disable more extensions when using the shared login domain (T373737)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2247114 wikitext text/x-wiki qa7ddmh4t0y4xdfbbcu8olln2rhnya3 2247115 2247114 2024-11-25T08:30:05Z Stashbot 7414 tgr@deploy2002: tgr: Continuing with sync 2247115 wikitext text/x-wiki 8w8nwqv3fbkdgbqfqrfaflbs8znvxvs 2247116 2247115 2024-11-25T08:30:25Z Stashbot 7414 arnaudb@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P71122 and previous config saved to /var/cache/conftool/dbconfig/20241125-083024-arnaudb.json 2247116 wikitext text/x-wiki 3ckcj9pn8f7qzqeszeouwnzml87to7e 2247117 2247116 2024-11-25T08:37:24Z Stashbot 7414 fabfur@cumin1002: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on A:cp-ulsfo and not (P{cp4043.*} or P{cp4051.*}) and A:cp for 9.2.6-1wm2 2247117 wikitext text/x-wiki 3srw09bluogl1nont25epkp1uuxykxg 2247118 2247117 2024-11-25T08:39:17Z Stashbot 7414 tgr@deploy2002: Finished scap sync-world: Backport for [[gerrit:1094071|Disable more extensions when using the shared login domain (T373737)]] (duration: 30m 35s) 2247118 wikitext text/x-wiki 0xl4keikot4ly87bri5xnxxugfuvhmr 2247119 2247118 2024-11-25T08:39:28Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of install7001.wikimedia.org to plain 2247119 wikitext text/x-wiki pamju33cmlkn659pn02xad0jhgj0yg2 2247120 2247119 2024-11-25T08:43:18Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of install7001.wikimedia.org to plain 2247120 wikitext text/x-wiki sdqo5wpr3gwy4hvigc6cspyunv9vlp8 2247121 2247120 2024-11-25T08:45:34Z Stashbot 7414 arnaudb@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2240 (T367781)', diff saved to https://phabricator.wikimedia.org/P71123 and previous config saved to /var/cache/conftool/dbconfig/20241125-084531-arnaudb.json 2247121 wikitext text/x-wiki tq2j7qhzqkmzkgcykgjlukirmiw6n6t 2247122 2247121 2024-11-25T08:46:02Z Stashbot 7414 kharlan@deploy2002: Started scap sync-world: Backport for [[gerrit:1053230|IPReputation: Enable everywhere (T360067)]] 2247122 wikitext text/x-wiki 89vtrddozqwmrweh12n57q2ifc5q5qq 2247123 2247122 2024-11-25T08:46:10Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 4:00:00 on db1160.eqiad.wmnet with reason: Maintenance 2247123 wikitext text/x-wiki fc311trmqgtpc4gex4l4r5j7efovl2m 2247124 2247123 2024-11-25T08:46:23Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1160.eqiad.wmnet with reason: Maintenance 2247124 wikitext text/x-wiki 2eulzt7rwgaj6zhth52y4sruwcsxolm 2247125 2247124 2024-11-25T08:46:26Z Stashbot 7414 arnaudb@cumin1002: START - Cookbook sre.hosts.downtime for 4:00:00 on db2179.codfw.wmnet with reason: Maintenance 2247125 wikitext text/x-wiki 0g5moylr2252chndh2arelw65vvk1w4 2247126 2247125 2024-11-25T08:46:40Z Stashbot 7414 arnaudb@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2179.codfw.wmnet with reason: Maintenance 2247126 wikitext text/x-wiki 6l8rwdogphs07wel25d19h5ofn0rb4q 2247127 2247126 2024-11-25T08:47:48Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of durum7001.magru.wmnet to plain 2247127 wikitext text/x-wiki qf15f53ynklfcwvactsnw4mr2b6vn5q 2247128 2247127 2024-11-25T08:48:37Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of durum7001.magru.wmnet to plain 2247128 wikitext text/x-wiki cnxugjy9ggh97bkvkwmr08w3buzynmr 2247129 2247128 2024-11-25T08:50:14Z Stashbot 7414 kharlan@deploy2002: kharlan: Backport for [[gerrit:1053230|IPReputation: Enable everywhere (T360067)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2247129 wikitext text/x-wiki 0fiq6ds6b0fbf74yucf74aky5p6vrda 2247130 2247129 2024-11-25T08:54:00Z Stashbot 7414 kharlan@deploy2002: kharlan: Continuing with sync 2247130 wikitext text/x-wiki cg3pwmhppvqljqwx5nsudk1b5bheaqx 2247131 2247130 2024-11-25T09:01:51Z Stashbot 7414 kharlan@deploy2002: Finished scap sync-world: Backport for [[gerrit:1053230|IPReputation: Enable everywhere (T360067)]] (duration: 15m 48s) 2247131 wikitext text/x-wiki jdmpyje0u14utfkjgtzqo9kxusz4cuw 2247132 2247131 2024-11-25T09:04:51Z Stashbot 7414 kostajh: UTC morning deploys done 2247132 wikitext text/x-wiki n8n0b4o4531uj1bdu74zifake4uw13w 2247133 2247132 2024-11-25T09:13:34Z Stashbot 7414 dcausse: restarting blazegraph on wdqs1012 (BlazegraphFreeAllocatorsDecreasingRapidly) 2247133 wikitext text/x-wiki 6wr0k7bankqarpn2ikj55e2xewlmpfm 2247134 2247133 2024-11-25T09:13:58Z Stashbot 7414 ladsgroup@deploy2002: Started scap sync-world: Backport for [[gerrit:1093956|Bump ratio of new parsercache key spec to 6 (T373037)]] 2247134 wikitext text/x-wiki j8d2wlh9koe4eub1ccy7dfssprnaird 2247135 2247134 2024-11-25T09:14:01Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of doh7001.wikimedia.org to plain 2247135 wikitext text/x-wiki b6ho0uxvp5c4vn7mo195s8n3k6k9nud 2247136 2247135 2024-11-25T09:18:16Z Stashbot 7414 ladsgroup@deploy2002: ladsgroup: Backport for [[gerrit:1093956|Bump ratio of new parsercache key spec to 6 (T373037)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2247136 wikitext text/x-wiki 2quoedbv9o80nfz04l9etdkz5j1eune 2247137 2247136 2024-11-25T09:18:20Z Stashbot 7414 ladsgroup@deploy2002: ladsgroup: Continuing with sync 2247137 wikitext text/x-wiki ng30xu7nlxdr6d1lg7lpcz89x3rfvf8 2247138 2247137 2024-11-25T09:18:54Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of doh7001.wikimedia.org to plain 2247138 wikitext text/x-wiki qzz5t59qy18w3vw3be9z1gd0w95l30f 2247140 2247138 2024-11-25T09:25:04Z Stashbot 7414 ladsgroup@deploy2002: Finished scap sync-world: Backport for [[gerrit:1093956|Bump ratio of new parsercache key spec to 6 (T373037)]] (duration: 11m 05s) 2247140 wikitext text/x-wiki slery06kkmgqafy3pxn8wub94gpah1w 2247143 2247140 2024-11-25T09:32:53Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2247143 wikitext text/x-wiki 00rad62ej2mxzz37rdpllt5z7ga7cl4 2247144 2247143 2024-11-25T09:33:00Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2247144 wikitext text/x-wiki neggisacnsvzkmj4h1iof5ot6mcu5r1 2247145 2247144 2024-11-25T09:34:01Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.reboot-single for host thanos-be2005.codfw.wmnet 2247145 wikitext text/x-wiki 6frxef01vxo1jiqde76h8u4td0fysdb 2247148 2247145 2024-11-25T09:39:18Z Stashbot 7414 moritzm: remove ganeti7003 from active Ganeti nodes in magru01 T376737 2247148 wikitext text/x-wiki pk6ls7i7b4toj7yavqr3nn38e3eu5wu 2247151 2247148 2024-11-25T09:43:54Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2247151 wikitext text/x-wiki sm34p5bzvzmmpbav41nqj66wnkifcio 2247152 2247151 2024-11-25T09:44:20Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2247152 wikitext text/x-wiki jen2fzaxwmpeo8p82rkxytfi235rmd5 2247154 2247152 2024-11-25T09:45:54Z Stashbot 7414 mvernon@cumin2002: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host thanos-be2005.codfw.wmnet 2247154 wikitext text/x-wiki gott2uhort4q5i7n3cvo63icv46m8wg 2247155 2247154 2024-11-25T09:46:39Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.reboot-single for host thanos-be2005.codfw.wmnet 2247155 wikitext text/x-wiki 0w1z9uflfymuzdvqyi6hc4oae5tu3xb 2247156 2247155 2024-11-25T09:58:31Z Stashbot 7414 mvernon@cumin2002: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host thanos-be2005.codfw.wmnet 2247156 wikitext text/x-wiki m64v9q5tdjdf2z2d33m1nbpgzjb8yr2 2247159 2247156 2024-11-25T10:06:06Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.reboot-single for host thanos-be1005.eqiad.wmnet 2247159 wikitext text/x-wiki b6mak1sx74b94jzav1i30xew99xqwcb 2247160 2247159 2024-11-25T10:07:26Z Stashbot 7414 jynus: extending backup1009 free filesystem 2247160 wikitext text/x-wiki iwy8zgyz9jaly3ntweqjbs1way58j9f 2247161 2247160 2024-11-25T10:10:17Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2247161 wikitext text/x-wiki lhzs80xflfuftugxu33i9zkmz7abj3o 2247162 2247161 2024-11-25T10:10:24Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2247162 wikitext text/x-wiki 5xix3hdud01g8yk0y2r41o7xqfd4f6d 2247164 2247162 2024-11-25T10:11:08Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2247164 wikitext text/x-wiki ot36x4huq3dj7710z5oeh7fz3p9rnbj 2247165 2247164 2024-11-25T10:11:51Z Stashbot 7414 brouberol@deploy2002: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2247165 wikitext text/x-wiki b1g1uv2t21e2d4upunxekc53kcxxey4 2247166 2247165 2024-11-25T10:18:00Z Stashbot 7414 mvernon@cumin2002: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host thanos-be1005.eqiad.wmnet 2247166 wikitext text/x-wiki 4ygagn2ruad8ist6mk3ts6xa5cton5y 2247167 2247166 2024-11-25T10:25:03Z Stashbot 7414 fabfur@cumin1002: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on A:cp-ulsfo and not (P{cp4043.*} or P{cp4051.*}) and A:cp for 9.2.6-1wm2 2247167 wikitext text/x-wiki ojnuitlpiy0gze48cvpf6yf5xkxbdj0 2247173 2247167 2024-11-25T10:35:47Z Stashbot 7414 fabfur@cumin1002: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on A:cp-eqsin and not (P{cp5018.*} or P{cp5026.*}) and A:cp for 9.2.6-1wm2 2247173 wikitext text/x-wiki qafa1zgnpydp3260yen69a740qd9iu1 2247175 2247173 2024-11-25T10:38:03Z Stashbot 7414 _joe_: deleted pyall component from reprepro 2247175 wikitext text/x-wiki 0vu6rlb7vl79jgdr7bhlwuo46vfar2t 2247177 2247175 2024-11-25T10:40:04Z Stashbot 7414 hashar@deploy2002: Started deploy [integration/docroot@d585f2b]: build: Updating cross-spawn to 7.0.6 2247177 wikitext text/x-wiki fnu1wzb4yg4duqeis387seg5nciic9u 2247179 2247177 2024-11-25T10:40:17Z Stashbot 7414 hashar@deploy2002: Finished deploy [integration/docroot@d585f2b]: build: Updating cross-spawn to 7.0.6 (duration: 00m 10s) 2247179 wikitext text/x-wiki k52spvty9opflhhuec7cfkj1ld50v7k 2247183 2247179 2024-11-25T11:01:34Z Stashbot 7414 fabfur: depooling magru for hardware swap (T376737) 2247183 wikitext text/x-wiki 9gsub66ijgbwqqrtanvix98q3xcw6ga 2247184 2247183 2024-11-25T11:01:49Z Stashbot 7414 fabfur@cumin1002: START - Cookbook sre.dns.admin DNS admin: depool site magru [reason: depool magru for hw swap, T376737] 2247184 wikitext text/x-wiki l85g6j4t7pknrx4t5f9wpyvgycibw9i 2247186 2247184 2024-11-25T11:02:05Z Stashbot 7414 fabfur@cumin1002: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site magru [reason: depool magru for hw swap, T376737] 2247186 wikitext text/x-wiki 1lb6xb6u5t0ysrw9blg4ntbyouwfzxl 2247187 2247186 2024-11-25T11:02:46Z Stashbot 7414 fabfur: depooling dnsboxes @ magru for hardware swap (T376737) 2247187 wikitext text/x-wiki m94dr5x9xpul7eqju8pxfph2w5w2u3w 2247188 2247187 2024-11-25T11:03:12Z Stashbot 7414 fabfur@cumin1002: conftool action : set/pooled=no; selector: cluster=dnsbox,dc=magru 2247188 wikitext text/x-wiki p1kc7zyaoty6cdpp700pwi1bgxl4w8o 2247191 2247188 2024-11-25T11:18:04Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1256.eqiad.wmnet with reason: host reimage 2247191 wikitext text/x-wiki oa7ijz6eosoxvhz5gpglrjrschfpxew 2247192 2247191 2024-11-25T11:20:39Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1256.eqiad.wmnet with reason: host reimage 2247192 wikitext text/x-wiki jzdsnwxdhkryx37ujq77buf3rwie8vd 2247193 2247192 2024-11-25T11:24:29Z Stashbot 7414 moritzm: installing Linux 6.1.119 on Bookworm nodes 2247193 wikitext text/x-wiki 81xut0ei27qydw4gqck6acuvu08fdn3 2247195 2247193 2024-11-25T11:34:18Z Stashbot 7414 hashar@deploy2002: Installing scap version "4.128.0" for 211 hosts 2247195 wikitext text/x-wiki mxrsqfuoelmxoestzk2fl19p7mrzwbg 2247197 2247195 2024-11-25T11:39:14Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - cgoubert@cumin1002" 2247197 wikitext text/x-wiki fw42au780qchfh6akyl83jihufkzaaq 2247198 2247197 2024-11-25T11:39:31Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - cgoubert@cumin1002" 2247198 wikitext text/x-wiki f2zypyxaolfk8iq0w6wjl999bcswwey 2247199 2247198 2024-11-25T11:39:34Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1256.eqiad.wmnet with OS bookworm 2247199 wikitext text/x-wiki raye686t97ygx5anoo168zsx1paoi0b 2247200 2247199 2024-11-25T11:41:27Z Stashbot 7414 claime: homer 'cr*eqiad*' commit 'T379454' 2247200 wikitext text/x-wiki dz2op6bh9dj2ixraot96wr4dwzx850b 2247201 2247200 2024-11-25T11:46:32Z Stashbot 7414 ladsgroup@cumin1002: START - Cookbook sre.hosts.downtime for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance 2247201 wikitext text/x-wiki tdrh8r3t9c8zigi6qxhmtkleizvig7t 2247202 2247201 2024-11-25T11:46:46Z Stashbot 7414 ladsgroup@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance 2247202 wikitext text/x-wiki 201b4gxh3g9hc8e5dnl8g8j57kxh7gs 2247203 2247202 2024-11-25T11:47:24Z Stashbot 7414 ladsgroup@cumin1002: dbctl commit (dc=all): 'Depooling db1179 (T380449)', diff saved to https://phabricator.wikimedia.org/P71125 and previous config saved to /var/cache/conftool/dbconfig/20241125-114651-ladsgroup.json 2247203 wikitext text/x-wiki k3sj58efk5hdpfgtm3v7fjtg49094x9 2247204 2247203 2024-11-25T11:47:34Z Stashbot 7414 hashar@deploy2002: Installing scap version "4.128.0" for 211 hosts 2247204 wikitext text/x-wiki sd7z44japtbnnsgi7r7y8ijz1uc7wh5 2247205 2247204 2024-11-25T11:49:12Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.k8s.pool-depool-node check for host wikikube-worker1290.eqiad.wmnet 2247205 wikitext text/x-wiki csc64lmmi7qz5gkzrwwbvnxju4veyw0 2247206 2247205 2024-11-25T11:49:14Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) check for host wikikube-worker1290.eqiad.wmnet 2247206 wikitext text/x-wiki amvssgktygfm2qchsvwb6aipyd1bgsa 2247207 2247206 2024-11-25T11:51:46Z Stashbot 7414 hashar@deploy2002: Installation of scap version "4.128.0" completed for 211 hosts 2247207 wikitext text/x-wiki gxvs1xqn4f5p7z50vu1u96kyo5dtcmh 2247208 2247207 2024-11-25T11:56:04Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1256.eqiad.wmnet 2247208 wikitext text/x-wiki 7m7fuauvlfmn7sx0b5r7yrlstc8p863 2247209 2247208 2024-11-25T11:56:07Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1256.eqiad.wmnet 2247209 wikitext text/x-wiki 7o9q857r09ggwar37e82om061z3k9kr User:Revi C. 2 8705 2247079 2240887 2024-11-24T18:50:22Z Revi C. 1919 2024-11 update 2247079 wikitext text/x-wiki kicsljr2yf9zv4tqxfpz7jrzd3agxtu Release Engineering/SAL 0 17290 2247157 2246575 2024-11-25T10:02:24Z Stashbot 7414 hashar: Reloaded Zuul to enable PHPUnit parallel testing for mediawiki/core | https://gerrit.wikimedia.org/r/1093909 | T379712 2247157 wikitext text/x-wiki a6x1w2radn2njwjy6e6fjd2aaz9k5kg Nova Resource:Admin/SAL 498 30942 2247168 2247066 2024-11-25T10:29:22Z Stashbot 7414 aborrero@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch 2247168 wikitext text/x-wiki odu66tqg0ji4vyxnkyvjsuurvqdo6hd 2247169 2247168 2024-11-25T10:29:25Z Stashbot 7414 aborrero@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch 2247169 wikitext text/x-wiki 0d7umqub4aegqymth4dq824s6g2g8wk 2247170 2247169 2024-11-25T10:32:29Z Stashbot 7414 aborrero@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch 2247170 wikitext text/x-wiki cy4aifo9puxhzbvj2sa1w6ooataqo92 2247171 2247170 2024-11-25T10:33:58Z Stashbot 7414 aborrero@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch 2247171 wikitext text/x-wiki kofnrqjf6idohrbl0jtagjbct4rc1w3 2247176 2247171 2024-11-25T10:39:27Z Stashbot 7414 aborrero@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch 2247176 wikitext text/x-wiki 21robvifouj8cs2fk51qzblilsmvf3l 2247178 2247176 2024-11-25T10:40:14Z Stashbot 7414 aborrero@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch 2247178 wikitext text/x-wiki 4mia40n3urbth774oj65vw1ujagllfg 2247194 2247178 2024-11-25T11:28:04Z Stashbot 7414 arturo: create IPv6 networks in eqiad1 (T380174), then reverted because network outage 2247194 wikitext text/x-wiki 0ljqx3ljz33u9mbl19pfg8xi1hdqlo8 Portal:Cloud VPS 0 46349 2247080 2237030 2024-11-24T19:29:12Z Taavi 13997 new key for [[Category:Cloud VPS]]: " " using [[Help:Gadget-HotCat|HotCat]] 2247080 wikitext text/x-wiki gl1gwimf9oayli4lhx3yba6f1vz7ycd Status.wikimedia.org 0 154026 2247078 1948585 2024-11-24T18:45:55Z Revi C. 1919 y2018 2247078 wikitext text/x-wiki g0ix67k4srezkbgjahi2vkr4c7m8d0b Nova Resource:Tools.versions/SAL 498 441263 2247174 2179063 2024-11-25T10:36:32Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-13: webservice restart # maybe it helps with T380703 2247174 wikitext text/x-wiki hteg7kgvy9cob92g3fbejzjzaao99h5 Portal:Cloud VPS/Admin/Skill matrix 0 442952 2247153 2246574 2024-11-25T09:45:29Z ABorrero (WMF) 11379 update my skills 2247153 wikitext text/x-wiki k36dfj8pinvymlcgr4yy8wfwoeri4q9 Nova Resource:Tools.quickcategories/SAL 498 443800 2247075 2239042 2024-11-24T15:15:25Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-13: deployed 91ee3ebea2 (upgrade dependencies, including Flask 3.1) 2247075 wikitext text/x-wiki kwiubvdco4c74m4zihsr7gm903v8dta Template:Cloud VPS nav 10 444620 2247077 2232806 2024-11-24T18:21:48Z Taavi 13997 categorize admin things in admin cat 2247077 wikitext text/x-wiki i088mm0dvs0n8023kvf84solvli3m4c Help:Toolforge/Envvars 12 452933 2247146 2246076 2024-11-25T09:35:00Z DCaro (WMF) 18271 /* Features that are already available */ 2247146 wikitext text/x-wiki sd6i2xazpiwkp8i0xugtc1lhh6qaf97 Portal:Toolforge/Changelog 0 453597 2247147 2244358 2024-11-25T09:35:06Z DCaro (WMF) 18271 /* 2024 */ 2247147 wikitext text/x-wiki bfqqn81kb7rzjnyffqbz28o5l7ywi9n Debian packaging/Package your software as deb 0 453976 2247181 2141220 2024-11-25T10:48:30Z GLavagetto (WMF) 37699 /* How to enable automatic build of debian packages */ 2247181 wikitext text/x-wiki b70szrjqg83uxxvqr0s7zlqm9xt2wc6 2247196 2247181 2024-11-25T11:37:57Z GLavagetto (WMF) 37699 2247196 wikitext text/x-wiki 9y2qmz6om9ey8nelr2b8uf87090g5wf User talk:BryanDavis/Archives/2024 3 454451 2247082 2172663 2024-11-25T06:52:18Z MABot 10804 Bot: Archiving 1 thread from [[User talk:BryanDavis]] 2247082 wikitext text/x-wiki hsddtap2d33og55ls9z61dvwycwx9ak SRE/Dc-operations/Platform-specific documentation/Supermicro Documentation 0 455886 2247142 2239197 2024-11-25T09:31:41Z MVernon (WMF) 25893 Note on how to exit the serial console on supermicro 2247142 wikitext text/x-wiki qkuizd21eum97iir1zdk5n48e51nfsi APT Staging repository 0 456130 2247190 2244429 2024-11-25T11:16:14Z GLavagetto (WMF) 37699 Added section on how to promote packages 2247190 wikitext text/x-wiki dgowj0ko6reqh37kpg69wse3ka978t2 Data Platform/Systems/Airflow/Kubernetes/Operations 0 456157 2247100 2246828 2024-11-25T08:03:47Z Brouberol 37217 /* Migrate the scheduler and kerberos components to Kubernetes */ 2247100 wikitext text/x-wiki kgfg5zhjfwga8i1dbhvd8j4zethu9y0 2247101 2247100 2024-11-25T08:04:03Z Brouberol 37217 /* Migrate the scheduler and kerberos components to Kubernetes */ 2247101 wikitext text/x-wiki aqwz0xoy1zvo5itw6hzl3l4njz6iklj 2247102 2247101 2024-11-25T08:05:30Z Brouberol 37217 /* Defining the webserver configuration */ 2247102 wikitext text/x-wiki rc7v92w6eextfg08pr5djaukga14fhc 2247103 2247102 2024-11-25T08:06:29Z Brouberol 37217 /* Migrate the scheduler and kerberos components to Kubernetes */ 2247103 wikitext text/x-wiki krf5yxerv6hcz45t71nvtuv0h50uky6 2247149 2247103 2024-11-25T09:40:06Z Brouberol 37217 /* Deploy a CloudnativePG cluster in the name Kubernetes namespace than Airlow and import the data */ 2247149 wikitext text/x-wiki d5g8gl6v3vi233ylansi1feove9gypc 2247150 2247149 2024-11-25T09:42:03Z Brouberol 37217 /* Deploy a CloudnativePG cluster in the name Kubernetes namespace than Airlow and import the data */ 2247150 wikitext text/x-wiki qscvy51vfayfhyu0flf77tdl5u1f87q 2247158 2247150 2024-11-25T10:04:25Z Brouberol 37217 /* Deploy a CloudnativePG cluster in the name Kubernetes namespace than Airlow and import the data */ 2247158 wikitext text/x-wiki d9g8kshltvasg5tfdgakvntd6af2w8k 2247163 2247158 2024-11-25T10:11:05Z Brouberol 37217 /* Deploy a CloudnativePG cluster in the name Kubernetes namespace than Airlow and import the data */ 2247163 wikitext text/x-wiki iucjed5l5rrxl7l4wwcfxunqm1s5mhy Nova Resource:Tofuinfratest-81b61034-25b3-40b4-9b76-3a80e26c00ba 498 456173 2247074 2024-11-24T12:00:20Z Labslogbot 55 Auto update of instance info. 2247074 wikitext text/x-wiki 120bzz46ya4dso9i72r410rkzokl7ka