Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.44.0-wmf.4 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Template:Nova Project 10 258 2246593 2188326 2024-11-21T19:48:01Z Andrewbogott 33 Clarify project id field (which now diverges from project name in modern projects) 2246593 wikitext text/x-wiki 5lguy9dp1epjqbs5x2hmc9ad7qsm721 Memcached for MediaWiki 0 3214 2246531 2234799 2024-11-21T16:42:33Z Krinkle 44 /* High level */ 2246531 wikitext text/x-wiki 9hwhucvujup1nd1p6pidenpl5fi3kg8 Deployments 0 4108 2246377 2246325 2024-11-21T12:12:42Z ScheduleDeploymentBot 37566 Add [[gerrit:1093889]] to Thursday, November 21 UTC afternoon backport window 2246377 wikitext text/x-wiki l6w1glfthksaa9b7ammgriybdo22qzo 2246488 2246377 2024-11-21T14:52:13Z ScheduleDeploymentBot 37566 Add [[gerrit:1090968]] to Thursday, November 21 UTC late backport window 2246488 wikitext text/x-wiki rv8ogko9a12g6h6t3sl7qebtc9xyfqo 2246546 2246488 2024-11-21T17:23:08Z ScheduleDeploymentBot 37566 Add [[gerrit:1093960]] to Thursday, November 21 UTC late backport window 2246546 wikitext text/x-wiki 419d5aurir5ilylaffxq8lmz4yvf2tu 2246547 2246546 2024-11-21T17:23:35Z ScheduleDeploymentBot 37566 Add [[gerrit:1079640]] to Thursday, November 21 UTC late backport window 2246547 wikitext text/x-wiki 9f11sgea9q96n409k03ab6r9qze1r60 2246548 2246547 2024-11-21T17:28:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1093961]] to Thursday, November 21 UTC late backport window 2246548 wikitext text/x-wiki c8ernyna6e9pczrgjiqmpkcvkn9uypm 2246549 2246548 2024-11-21T17:29:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1093962]] to Thursday, November 21 UTC late backport window 2246549 wikitext text/x-wiki 5mp1l47qbymo86ws0aicirjtnn46yji 2246550 2246549 2024-11-21T17:30:20Z ScheduleDeploymentBot 37566 Add [[gerrit:1092334]] to Thursday, November 21 UTC late backport window 2246550 wikitext text/x-wiki f07h2msqkpltrc0htw6tkypfkelo1gm 2246591 2246550 2024-11-21T19:36:19Z DDesouza 31852 /* Week of November 25 */ 2246591 wikitext text/x-wiki huqf7592j1ma6hq1xfhx76jeg93dozq 2246592 2246591 2024-11-21T19:40:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1094000]] to Thursday, November 21 UTC late backport window 2246592 wikitext text/x-wiki 9hmgtl80t3h0f3zaowki7pboyzvm58u 2246594 2246592 2024-11-21T19:49:30Z DDesouza 31852 /* Week of November 25 */ 2246594 wikitext text/x-wiki o151gfe4nq46tnvl45bf58n1rnvab60 2246596 2246594 2024-11-21T20:14:41Z ScheduleDeploymentBot 37566 Add [[gerrit:1093497]] to Monday, November 25 UTC afternoon backport window 2246596 wikitext text/x-wiki i4rfm28ju0ud67gmm1y5kiu3argsyg4 2246598 2246596 2024-11-21T20:21:49Z ScheduleDeploymentBot 37566 Add [[gerrit:1094005]] to Thursday, November 21 UTC late backport window 2246598 wikitext text/x-wiki d3tla8hkgohpxvdk3wi34xue02x66r1 2246627 2246598 2024-11-21T22:33:04Z DDesouza 31852 /* Week of November 25 */ 2246627 wikitext text/x-wiki bsn29yo6sgy3hiqu622lzjyr5kqv1ti Server Admin Log 0 7919 2246374 2246372 2024-11-21T12:02:14Z Stashbot 7414 jmm@deploy2002: helmfile [codfw] START helmfile.d/services/thumbor: apply 2246374 wikitext text/x-wiki qpehgijpctbxsf3s909oesym0vkln0e 2246375 2246374 2024-11-21T12:09:15Z Stashbot 7414 jmm@deploy2002: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2246375 wikitext text/x-wiki jpktl86ffpnq8oax6t98xcldt3g1i8m 2246376 2246375 2024-11-21T12:09:47Z Stashbot 7414 jmm@deploy2002: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2246376 wikitext text/x-wiki bcfon98wmla9srslh1aqoebq9o3k4lv 2246378 2246376 2024-11-21T12:13:13Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2156.codfw.wmnet with OS bookworm 2246378 wikitext text/x-wiki 3ezlg297ze83qwk8s672xu8kv938ecv 2246379 2246378 2024-11-21T12:13:51Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2158.codfw.wmnet with OS bookworm 2246379 wikitext text/x-wiki jpydib08jh3wuwm0zummr25uksom7o6 2246380 2246379 2024-11-21T12:16:23Z Stashbot 7414 jmm@deploy2002: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2246380 wikitext text/x-wiki faqi4mvj2xfwokpcg5ceoj37gfzhob6 2246381 2246380 2024-11-21T12:16:39Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2161.codfw.wmnet with OS bookworm 2246381 wikitext text/x-wiki dnec95u17pd80kltk20q5a93r17mo74 2246382 2246381 2024-11-21T12:17:27Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2160.codfw.wmnet with OS bookworm 2246382 wikitext text/x-wiki 2vv4amvzl8ecwail2u9t5d35ismyedi 2246383 2246382 2024-11-21T12:17:44Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2162.codfw.wmnet with OS bookworm 2246383 wikitext text/x-wiki ntsxcusouzd36cw8198iqlw0crjmlf2 2246384 2246383 2024-11-21T12:18:24Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2163.codfw.wmnet with OS bookworm 2246384 wikitext text/x-wiki 7othzq3ahit50y4t2iqk3nefdsmguxw 2246385 2246384 2024-11-21T12:18:56Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2164.codfw.wmnet with OS bookworm 2246385 wikitext text/x-wiki tcbrkjle005xdl6wwqmuuxdf99m9xoe 2246386 2246385 2024-11-21T12:19:32Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2165.codfw.wmnet with OS bookworm 2246386 wikitext text/x-wiki gqpim9wopu53v8e1uqyj240urzyrmyi 2246387 2246386 2024-11-21T12:32:47Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2156.codfw.wmnet with reason: host reimage 2246387 wikitext text/x-wiki oo7f6mikowc4e3la6d8nmmpx1yk4uey 2246388 2246387 2024-11-21T12:32:50Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2158.codfw.wmnet with reason: host reimage 2246388 wikitext text/x-wiki 4d847ogkid333lsydi39lhoxfpoj0jv 2246389 2246388 2024-11-21T12:35:50Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2161.codfw.wmnet with reason: host reimage 2246389 wikitext text/x-wiki nxliuz6y9n1a8gei7hxq17n6x747dfa 2246390 2246389 2024-11-21T12:36:05Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2160.codfw.wmnet with reason: host reimage 2246390 wikitext text/x-wiki jsplpx6eoy7ph1uoug81sir7jmnxfg5 2246391 2246390 2024-11-21T12:37:00Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2156.codfw.wmnet with reason: host reimage 2246391 wikitext text/x-wiki if8n53zims8zaxznybb0pxz8ny8c8s5 2246392 2246391 2024-11-21T12:37:15Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2162.codfw.wmnet with reason: host reimage 2246392 wikitext text/x-wiki b49ie99rrf62u2ygewgr3dvxfbruo5d 2246393 2246392 2024-11-21T12:38:05Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2163.codfw.wmnet with reason: host reimage 2246393 wikitext text/x-wiki dwa16z59v2p4mid6llvjeyujkqlswhp 2246394 2246393 2024-11-21T12:38:24Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2164.codfw.wmnet with reason: host reimage 2246394 wikitext text/x-wiki qbf0jyqtav6bdmwzlmipm17givypbky 2246395 2246394 2024-11-21T12:38:41Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2165.codfw.wmnet with reason: host reimage 2246395 wikitext text/x-wiki kh95rh54e32g5k50p4y8d3o7eh0jp00 2246396 2246395 2024-11-21T12:39:34Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2161.codfw.wmnet with reason: host reimage 2246396 wikitext text/x-wiki 18jxpw7itmnhqancipo0xejpxvr55qg 2246397 2246396 2024-11-21T12:42:51Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2158.codfw.wmnet with reason: host reimage 2246397 wikitext text/x-wiki e9ing12989zre2jj5jrz2cjx2g4he13 2246398 2246397 2024-11-21T12:46:27Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2163.codfw.wmnet with reason: host reimage 2246398 wikitext text/x-wiki gedoerp0550cu86g9p7ek183ylm4uao 2246399 2246398 2024-11-21T12:49:40Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2165.codfw.wmnet with reason: host reimage 2246399 wikitext text/x-wiki hgpre0xoluo06vdyhzq8polhogi2ygx 2246400 2246399 2024-11-21T12:52:15Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2162.codfw.wmnet with reason: host reimage 2246400 wikitext text/x-wiki 5kanubkqn48wakyx9ow3v5qyqrpog3p 2246402 2246400 2024-11-21T12:55:12Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2164.codfw.wmnet with reason: host reimage 2246402 wikitext text/x-wiki nu44ih7lt2mokclas7zpaq1mmg85p8o 2246403 2246402 2024-11-21T12:55:36Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2156.codfw.wmnet with OS bookworm 2246403 wikitext text/x-wiki crfn1oney9zucix4vr5qxtycmm32e53 2246405 2246403 2024-11-21T12:58:38Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2160.codfw.wmnet with reason: host reimage 2246405 wikitext text/x-wiki 7wv34ydr6twqd6m5kqu3n9yfn95zqge 2246406 2246405 2024-11-21T12:58:49Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2161.codfw.wmnet with OS bookworm 2246406 wikitext text/x-wiki oshuyikksac3gp26ro6166o5l7d068g 2246407 2246406 2024-11-21T13:02:29Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2158.codfw.wmnet with OS bookworm 2246407 wikitext text/x-wiki 7363fp0ykf2c7phzug8fnkh2ilyyii2 2246408 2246407 2024-11-21T13:05:36Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2163.codfw.wmnet with OS bookworm 2246408 wikitext text/x-wiki g7diotkhvup34xbwl301gp5y10mbsqu 2246410 2246408 2024-11-21T13:10:28Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2165.codfw.wmnet with OS bookworm 2246410 wikitext text/x-wiki 31rn6k07q1vxo4v322wr5euejw4bifg 2246411 2246410 2024-11-21T13:10:51Z Stashbot 7414 fabfur@cumin1002: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp5018*} and A:cp for 9.2.6-1wm2 2246411 wikitext text/x-wiki 95theh9wzsi8fiapdcd9zxmvbbas3z1 2246412 2246411 2024-11-21T13:11:56Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2162.codfw.wmnet with OS bookworm 2246412 wikitext text/x-wiki 45ihm1s724elnboszxcbnpalmuoaa8w 2246413 2246412 2024-11-21T13:14:18Z Stashbot 7414 fabfur@cumin1002: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp5018*} and A:cp for 9.2.6-1wm2 2246413 wikitext text/x-wiki 3ei8nl8zdsulk8j98jtgxuqvos6sn63 2246414 2246413 2024-11-21T13:14:29Z Stashbot 7414 fabfur@cumin1002: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp5026*} and A:cp for 9.2.6-1wm2 2246414 wikitext text/x-wiki alb3tlmaat0t6h7irie38rvft5zndt0 2246415 2246414 2024-11-21T13:14:32Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2164.codfw.wmnet with OS bookworm 2246415 wikitext text/x-wiki akti48hcbuyvvedxdgcpz9pp0b6u5b7 2246416 2246415 2024-11-21T13:17:25Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.rename from kubernetes1007 to kubestage1005 2246416 wikitext text/x-wiki 65ezagbk9ceedzf8755puezju52o9gh 2246417 2246416 2024-11-21T13:17:49Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.netbox 2246417 wikitext text/x-wiki gpgngemdru74lq2n8ulosnatkoubdyz 2246418 2246417 2024-11-21T13:18:14Z Stashbot 7414 fabfur@cumin1002: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp5026*} and A:cp for 9.2.6-1wm2 2246418 wikitext text/x-wiki qqhoanos60u64blxz1w733cidyw2jgr 2246419 2246418 2024-11-21T13:18:19Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2160.codfw.wmnet with OS bookworm 2246419 wikitext text/x-wiki ljtnzv2mxk9ezcyyl11fg9hgrgtum1t 2246421 2246419 2024-11-21T13:21:19Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1007 to kubestage1005 - jayme@cumin2002" 2246421 wikitext text/x-wiki nkpz95xbm077dsshrhg2j4z4x3bozzd 2246422 2246421 2024-11-21T13:22:52Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1007 to kubestage1005 - jayme@cumin2002" 2246422 wikitext text/x-wiki a7j63yvhtx1xtjmxq2s8eh54ryoac95 2246423 2246422 2024-11-21T13:22:55Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246423 wikitext text/x-wiki gh666w6vcm1o3aksus6as5ie3nnrsn8 2246424 2246423 2024-11-21T13:22:57Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host kubestage1005 2246424 wikitext text/x-wiki pif87q3csotrtelbetkofd99kw1phfg 2246425 2246424 2024-11-21T13:24:16Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host kubestage1005 2246425 wikitext text/x-wiki a7fb2no2xg1bnxl91oqva2qji07u306 2246426 2246425 2024-11-21T13:24:56Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from kubernetes1007 to kubestage1005 2246426 wikitext text/x-wiki 7uo8kz1thjdxe48161s32u603we7fyp 2246427 2246426 2024-11-21T13:25:47Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.rename from kubernetes1008 to kubestage1006 2246427 wikitext text/x-wiki h97czxzuv86yd0hdswy00yc4onfd0vh 2246428 2246427 2024-11-21T13:25:59Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.dns.netbox 2246428 wikitext text/x-wiki 7uccfbvf677vfqj6xsroormnkwjp43j 2246430 2246428 2024-11-21T13:27:58Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.reimage for host kubestage1005.eqiad.wmnet with OS bookworm 2246430 wikitext text/x-wiki jbtl9g273tao1cl7e73zjh3uh24c3uq 2246431 2246430 2024-11-21T13:30:58Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1008 to kubestage1006 - jayme@cumin2002" 2246431 wikitext text/x-wiki at5xllx3cfiiy9hx3mkpb1d516nrrq9 2246432 2246431 2024-11-21T13:31:16Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming kubernetes1008 to kubestage1006 - jayme@cumin2002" 2246432 wikitext text/x-wiki 91anc28qyllf18zadh4zucou7dz9lki 2246433 2246432 2024-11-21T13:31:18Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246433 wikitext text/x-wiki myed885wrw0zrtvopursv6qmtd999qz 2246434 2246433 2024-11-21T13:31:21Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host kubestage1006 2246434 wikitext text/x-wiki fpxrss9cnsakgmhsfsdjwzrlm0fc0x2 2246435 2246434 2024-11-21T13:32:30Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host kubestage1006 2246435 wikitext text/x-wiki ax0cfkxfmb1wz4qk0noxj3djm329laf 2246437 2246435 2024-11-21T13:33:11Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from kubernetes1008 to kubestage1006 2246437 wikitext text/x-wiki icv8f9siy2ikxhpiibs60p7lt98g4ai 2246438 2246437 2024-11-21T13:34:31Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.reimage for host kubestage1006.eqiad.wmnet with OS bookworm 2246438 wikitext text/x-wiki t8eusr0j2itsj3zqoqep2jdsherbrw8 2246440 2246438 2024-11-21T13:44:32Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on kubestage1005.eqiad.wmnet with reason: host reimage 2246440 wikitext text/x-wiki fuayiaebi7j0js4z89i81gw8m2skwo2 2246443 2246440 2024-11-21T13:47:33Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestage1005.eqiad.wmnet with reason: host reimage 2246443 wikitext text/x-wiki g9d7rqsujsfeoluic0oarhst2sytt07 2246444 2246443 2024-11-21T13:51:06Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on kubestage1006.eqiad.wmnet with reason: host reimage 2246444 wikitext text/x-wiki 2daef6vsw9w031cn4gvpy9yxrd6u4jb 2246445 2246444 2024-11-21T13:54:22Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestage1006.eqiad.wmnet with reason: host reimage 2246445 wikitext text/x-wiki 8smlty6wp9vliq2lvm0wsnaw9688hhp 2246447 2246445 2024-11-21T14:03:35Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2166.codfw.wmnet with OS bookworm 2246447 wikitext text/x-wiki h383uge0hh8t5dw74h4ash8pto85lnr 2246448 2246447 2024-11-21T14:04:07Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2167.codfw.wmnet with OS bookworm 2246448 wikitext text/x-wiki qr4nhwcihfpzybixal408woipc22vxa 2246449 2246448 2024-11-21T14:04:35Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2168.codfw.wmnet with OS bookworm 2246449 wikitext text/x-wiki t8btr3meyfnq3nm5sypjlh6ru4ql0ne 2246450 2246449 2024-11-21T14:05:05Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2169.codfw.wmnet with OS bookworm 2246450 wikitext text/x-wiki 4k40k08yxuee5qtic8qy6mfp7sc9bxh 2246451 2246450 2024-11-21T14:05:36Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2170.codfw.wmnet with OS bookworm 2246451 wikitext text/x-wiki 2jmmrsvda2ppnordjqpuq0h72eqjf09 2246452 2246451 2024-11-21T14:06:44Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestage1005.eqiad.wmnet with OS bookworm 2246452 wikitext text/x-wiki 4jbqb7uta93a7od23bk2b9oj8t359mp 2246453 2246452 2024-11-21T14:07:24Z Stashbot 7414 sgimeno@deploy2002: Started scap sync-world: Backport for [[gerrit:1092956|enwiki: Add abusefilter-access-protected-vars to EFH/EFM (T380332)]] 2246453 wikitext text/x-wiki gx6rqpn6lmzjp1f2j8sezsvguulaooo 2246454 2246453 2024-11-21T14:11:16Z Stashbot 7414 jayme@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubestage1006.eqiad.wmnet with OS bookworm 2246454 wikitext text/x-wiki p0xqulgyxc1y2a6xqgi9d2m0up1nnjm 2246455 2246454 2024-11-21T14:11:39Z Stashbot 7414 sgimeno@deploy2002: eggroll97, sgimeno: Backport for [[gerrit:1092956|enwiki: Add abusefilter-access-protected-vars to EFH/EFM (T380332)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246455 wikitext text/x-wiki 1tq1tdet0t16vp5jlomvkwahxa5v3h1 2246458 2246455 2024-11-21T14:14:11Z Stashbot 7414 sgimeno@deploy2002: eggroll97, sgimeno: Continuing with sync 2246458 wikitext text/x-wiki ihfwg66bdj6gzk3hh5cfoeexg8vpzxa 2246461 2246458 2024-11-21T14:21:14Z Stashbot 7414 sgimeno@deploy2002: Finished scap sync-world: Backport for [[gerrit:1092956|enwiki: Add abusefilter-access-protected-vars to EFH/EFM (T380332)]] (duration: 13m 50s) 2246461 wikitext text/x-wiki q25bcbpx4wq3rd6vz232yjjjk3660t2 2246462 2246461 2024-11-21T14:22:30Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2166.codfw.wmnet with reason: host reimage 2246462 wikitext text/x-wiki pt9g0ukj62pqbu0gx377f1kk4d9u9th 2246463 2246462 2024-11-21T14:23:20Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2167.codfw.wmnet with reason: host reimage 2246463 wikitext text/x-wiki 1qtw2s15muqbltwu6h2xyp8uxkogolt 2246464 2246463 2024-11-21T14:23:40Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2168.codfw.wmnet with reason: host reimage 2246464 wikitext text/x-wiki 9zmhsnlar3rk5mu5uv4jodnswuy8ffr 2246465 2246464 2024-11-21T14:24:13Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2169.codfw.wmnet with reason: host reimage 2246465 wikitext text/x-wiki hcq04pczu2zuh7981ao2ra6pxrpof0q 2246466 2246465 2024-11-21T14:24:50Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2170.codfw.wmnet with reason: host reimage 2246466 wikitext text/x-wiki btlii21a576ncx3qbrj15vp2fowjhuj 2246467 2246466 2024-11-21T14:25:14Z Stashbot 7414 ihurbain@deploy2002: helmfile [staging] START helmfile.d/services/push-notifications: apply 2246467 wikitext text/x-wiki paxhpt920r4i3mtbh39dftysjt84m4c 2246469 2246467 2024-11-21T14:25:50Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2166.codfw.wmnet with reason: host reimage 2246469 wikitext text/x-wiki my44u9nwdm5lgdu38bbcv4fokau9o89 2246470 2246469 2024-11-21T14:25:54Z Stashbot 7414 ihurbain@deploy2002: helmfile [staging] DONE helmfile.d/services/push-notifications: apply 2246470 wikitext text/x-wiki ebutagdhz7mwzh02ykv0td1vbr01y0x 2246471 2246470 2024-11-21T14:28:44Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2167.codfw.wmnet with reason: host reimage 2246471 wikitext text/x-wiki 9dkq2zeo1cqblj6bof45xldupy1hv6k 2246472 2246471 2024-11-21T14:31:17Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2170.codfw.wmnet with reason: host reimage 2246472 wikitext text/x-wiki kwqpkhz4kjtai4w1dg60lop8h71ubca 2246473 2246472 2024-11-21T14:33:44Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2168.codfw.wmnet with reason: host reimage 2246473 wikitext text/x-wiki gbbylc5x4w6szlwzy707838l3dpnotr 2246474 2246473 2024-11-21T14:35:41Z Stashbot 7414 sgimeno@deploy2002: Started scap sync-world: Backport for [[gerrit:1093889|ExperimentUserDefaultsManager: use read latest when retrieving central id (T379682)]] 2246474 wikitext text/x-wiki 74xzrn4wryki9bqk4buuar3zol340t1 2246475 2246474 2024-11-21T14:36:51Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2169.codfw.wmnet with reason: host reimage 2246475 wikitext text/x-wiki djg9mob67bljne9y6h51h8mu6wfpkqt 2246476 2246475 2024-11-21T14:39:09Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246476 wikitext text/x-wiki ph8efm104qj22ba1rg1omaiwyzn5sk1 2246477 2246476 2024-11-21T14:41:17Z Stashbot 7414 sgimeno@deploy2002: sgimeno: Backport for [[gerrit:1093889|ExperimentUserDefaultsManager: use read latest when retrieving central id (T379682)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246477 wikitext text/x-wiki 7zuzvtrcf0uzhe1jqaf96cw20sf0kxz 2246478 2246477 2024-11-21T14:43:19Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2157.codfw.wmnet with OS bookworm 2246478 wikitext text/x-wiki mf49mvveckhzova7imlay79hjtnk78i 2246479 2246478 2024-11-21T14:43:29Z Stashbot 7414 jynus@cumin1002: START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on kafka-main1001.eqiad.wmnet with reason: Per claime's recommendation 2246479 wikitext text/x-wiki l86a04dgefk0j5dxyffgpjtvesvcvqc 2246480 2246479 2024-11-21T14:43:43Z Stashbot 7414 jynus@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on kafka-main1001.eqiad.wmnet with reason: Per claime's recommendation 2246480 wikitext text/x-wiki 5vrpcmr4ct037v6mzx38y2qvv2eruq8 2246481 2246480 2024-11-21T14:47:40Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2166.codfw.wmnet with OS bookworm 2246481 wikitext text/x-wiki 7oj1vksgajg1o1k30p9dnfrag74bu0h 2246482 2246481 2024-11-21T14:47:55Z Stashbot 7414 cgoubert@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246482 wikitext text/x-wiki d53egvzj8wujc4o5hqdihu3u1jc49ww 2246483 2246482 2024-11-21T14:48:47Z Stashbot 7414 sgimeno@deploy2002: Sync cancelled. 2246483 wikitext text/x-wiki sd8fk81b5yumklv3lbatz7e4bnnkfht 2246484 2246483 2024-11-21T14:49:14Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2167.codfw.wmnet with OS bookworm 2246484 wikitext text/x-wiki hz224t9r40qnis29wqdpzfm1uoux38k 2246486 2246484 2024-11-21T14:50:19Z Stashbot 7414 sergi0: UTC afternoon deploys done 2246486 wikitext text/x-wiki pysa36qlp8ei4032ujjwxj1net8dn46 2246487 2246486 2024-11-21T14:51:10Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2170.codfw.wmnet with OS bookworm 2246487 wikitext text/x-wiki 1so6mbyy7il02h3p45u2to6xauk2mtc 2246489 2246487 2024-11-21T14:53:20Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2168.codfw.wmnet with OS bookworm 2246489 wikitext text/x-wiki 2r4q4pznamtdtlrp3wyrq33zbhglnf3 2246490 2246489 2024-11-21T14:54:37Z Stashbot 7414 gmodena@deploy2002: Started deploy [analytics/refinery@358ccf5]: Ad-hoc deployment [analytics/refinery@358ccf55] 2246490 wikitext text/x-wiki s3vt219aajhfmrtjuwdnfjnny7n3su2 2246491 2246490 2024-11-21T14:55:43Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246491 wikitext text/x-wiki 9vdybt5rz8d96n7yh6ls027ynoaj564 2246492 2246491 2024-11-21T14:56:01Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2169.codfw.wmnet with OS bookworm 2246492 wikitext text/x-wiki m9xd5nx6hfnckyyqtnalljpsewf8456 2246493 2246492 2024-11-21T15:06:21Z Stashbot 7414 gmodena@deploy2002: Finished deploy [analytics/refinery@358ccf5]: Ad-hoc deployment [analytics/refinery@358ccf55] (duration: 11m 44s) 2246493 wikitext text/x-wiki czr4zn70lixwk5n6m1td2f3gw54t8n1 2246494 2246493 2024-11-21T15:10:42Z Stashbot 7414 eevans@cumin1002: START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase2021.codfw.wmnet with reason: Decommissioning — T380236 2246494 wikitext text/x-wiki 79cycef47mw3a5bv09qqydej5qzwk1t 2246495 2246494 2024-11-21T15:11:21Z Stashbot 7414 eevans@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase2021.codfw.wmnet with reason: Decommissioning — T380236 2246495 wikitext text/x-wiki gg88b69vz3kmpqt4yk0nh23rn76ktk8 2246496 2246495 2024-11-21T15:15:54Z Stashbot 7414 cgoubert@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246496 wikitext text/x-wiki hti794xcz386vcw5aou8zzoazyoebs4 2246497 2246496 2024-11-21T15:16:16Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246497 wikitext text/x-wiki b521drledz7jut3oopik36v068aps6w 2246499 2246497 2024-11-21T15:23:24Z Stashbot 7414 cgoubert@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246499 wikitext text/x-wiki fh9hz0koa0pz84o07u2zsrh2lssa89s 2246500 2246499 2024-11-21T15:24:00Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246500 wikitext text/x-wiki enw8lvig6dwtzhpho0rmjn7jvj6jsut 2246501 2246500 2024-11-21T15:24:08Z Stashbot 7414 kartik@deploy2002: Started scap sync-world: Backport for [[gerrit:1093927|Fix layout broken by display:flex on HorizontalLayout (T380471)]], [[gerrit:1093928|Revert "ExperimentUserDefaultsManager: use read latest when retrieving central id"]] 2246501 wikitext text/x-wiki hroyjuk31qemx934w7ggt5isgk9buwl 2246502 2246501 2024-11-21T15:24:37Z Stashbot 7414 gmodena@deploy2002: Started deploy [analytics/refinery@358ccf5] (thin): Ad-hoc deployment THIN [analytics/refinery@358ccf55] 2246502 wikitext text/x-wiki l0rk1w1t4gttihizt4jqu0f2654yg90 2246503 2246502 2024-11-21T15:25:00Z Stashbot 7414 sukhe: stop pybal on lvs2013 to confirm changes in CR 1091243 2246503 wikitext text/x-wiki r38fwgxpp8mwms8g36tndzxh4h0b79j 2246504 2246503 2024-11-21T15:25:46Z Stashbot 7414 ebernhardson@deploy2002: Started deploy [airflow-dags/search@6183645]: increase driver memory for mjolnir feature selection 2246504 wikitext text/x-wiki akzanqwv8y7zrewg639dvagsp33pdv3 2246505 2246504 2024-11-21T15:25:58Z Stashbot 7414 sukhe@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs2013.codfw.wmnet with reason: rebooting 2246505 wikitext text/x-wiki jmmbsfngeogbp4h6ozw15rdz99e5w4c 2246506 2246505 2024-11-21T15:26:12Z Stashbot 7414 sukhe@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs2013.codfw.wmnet with reason: rebooting 2246506 wikitext text/x-wiki 1a7cgpouju6yh7ixuai79xcrmehkf6w 2246507 2246506 2024-11-21T15:26:18Z Stashbot 7414 ebernhardson@deploy2002: Finished deploy [airflow-dags/search@6183645]: increase driver memory for mjolnir feature selection (duration: 00m 31s) 2246507 wikitext text/x-wiki aacyinmqs7e6nnyntg1mcuknxd9z9rw 2246508 2246507 2024-11-21T15:27:37Z Stashbot 7414 ihurbain@deploy2002: helmfile [codfw] START helmfile.d/services/push-notifications: apply 2246508 wikitext text/x-wiki qwulxk8xkqmann41oy6kvyy652yeqvh 2246509 2246508 2024-11-21T15:28:16Z Stashbot 7414 ihurbain@deploy2002: helmfile [codfw] DONE helmfile.d/services/push-notifications: apply 2246509 wikitext text/x-wiki 5usen4tsvvlkuq88dd6u210so7fvqo7 2246510 2246509 2024-11-21T15:28:56Z Stashbot 7414 ihurbain@deploy2002: helmfile [eqiad] START helmfile.d/services/push-notifications: apply 2246510 wikitext text/x-wiki lws8hx980b9pefex0pjd9qyupkj6ax1 2246511 2246510 2024-11-21T15:29:12Z Stashbot 7414 kartik@deploy2002: abi, sgimeno, kartik: Backport for [[gerrit:1093927|Fix layout broken by display:flex on HorizontalLayout (T380471)]], [[gerrit:1093928|Revert "ExperimentUserDefaultsManager: use read latest when retrieving central id"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246511 wikitext text/x-wiki f6iz07eig0npuw8py44lxw9nvql9gkx 2246512 2246511 2024-11-21T15:29:43Z Stashbot 7414 ihurbain@deploy2002: helmfile [eqiad] DONE helmfile.d/services/push-notifications: apply 2246512 wikitext text/x-wiki o0nzolsclxwrnmu73j3c1q0pbbfdkuu 2246513 2246512 2024-11-21T15:29:54Z Stashbot 7414 gmodena@deploy2002: Finished deploy [analytics/refinery@358ccf5] (thin): Ad-hoc deployment THIN [analytics/refinery@358ccf55] (duration: 05m 16s) 2246513 wikitext text/x-wiki 4zy1jwapvc7ut9eifgx2c8y7jcxmwpi 2246514 2246513 2024-11-21T15:31:15Z Stashbot 7414 gmodena@deploy2002: Started deploy [analytics/refinery@358ccf5] (hadoop-test): Ad-hoc deployment TEST [analytics/refinery@358ccf55] 2246514 wikitext text/x-wiki hob6qcn9p4wj2b7vcjwyfg2uybu19vu 2246515 2246514 2024-11-21T15:33:22Z Stashbot 7414 kartik@deploy2002: abi, sgimeno, kartik: Continuing with sync 2246515 wikitext text/x-wiki cjvuo9wdwbd65h96fdbz8lnsy9etgzs 2246516 2246515 2024-11-21T15:34:46Z Stashbot 7414 gmodena@deploy2002: Finished deploy [analytics/refinery@358ccf5] (hadoop-test): Ad-hoc deployment TEST [analytics/refinery@358ccf55] (duration: 03m 30s) 2246516 wikitext text/x-wiki 1mfmxozlxky4jtn5kci05351ovx08mv 2246518 2246516 2024-11-21T15:40:00Z Stashbot 7414 kartik@deploy2002: Finished scap sync-world: Backport for [[gerrit:1093927|Fix layout broken by display:flex on HorizontalLayout (T380471)]], [[gerrit:1093928|Revert "ExperimentUserDefaultsManager: use read latest when retrieving central id"]] (duration: 15m 51s) 2246518 wikitext text/x-wiki t4wlxbwzn3kyap3gig8ighh80fhdj1o 2246520 2246518 2024-11-21T16:00:52Z Stashbot 7414 dancy@deploy2002: Installing scap version "4.127.0" for 209 hosts 2246520 wikitext text/x-wiki fmpy90lq92icmxnfdy0oq48izzwm7yh 2246521 2246520 2024-11-21T16:03:10Z Stashbot 7414 cgoubert@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246521 wikitext text/x-wiki 1hna6w4n56ygyt25doqvef4xufx6rgx 2246522 2246521 2024-11-21T16:04:13Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246522 wikitext text/x-wiki 744h5rihw4d5zlk1mfbotsff3jc1gpj 2246523 2246522 2024-11-21T16:05:53Z Stashbot 7414 dancy@deploy2002: Started scap sync-world: testing 2246523 wikitext text/x-wiki e19m680s3h9we2c47d4rfoc0sep9h12 2246524 2246523 2024-11-21T16:08:55Z Stashbot 7414 dancy@deploy2002: Finished scap sync-world: testing (duration: 03m 01s) 2246524 wikitext text/x-wiki e0suekr4iegesm7faha5glvxfum3hye 2246525 2246524 2024-11-21T16:13:37Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=no; selector: name=cluster=dnsbox,dc=magru [reason: testing] 2246525 wikitext text/x-wiki onfivdcs5e5a7c47gb0tcuohc2zklgf 2246526 2246525 2024-11-21T16:20:06Z Stashbot 7414 cgoubert@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2157.codfw.wmnet with OS bookworm 2246526 wikitext text/x-wiki tj49q1kokbooom1ok0dd9torrpzhc17 2246527 2246526 2024-11-21T16:21:13Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2157.codfw.wmnet with OS bookworm 2246527 wikitext text/x-wiki frdaximy5ltgzqhtmo4dmylnqubjwbv 2246528 2246527 2024-11-21T16:23:09Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2140.codfw.wmnet with reason: host reimage 2246528 wikitext text/x-wiki f6w8tz8us6v5ipkhanq9qeh5f41ya21 2246529 2246528 2024-11-21T16:26:46Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2140.codfw.wmnet with reason: host reimage 2246529 wikitext text/x-wiki 4tgjxnttmaoyhpshan16r8343ma6to2 2246530 2246529 2024-11-21T16:39:24Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2157.codfw.wmnet with reason: host reimage 2246530 wikitext text/x-wiki cj5wthi37x9a6crplzb60bxedoo1ksa 2246532 2246530 2024-11-21T16:43:16Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2157.codfw.wmnet with reason: host reimage 2246532 wikitext text/x-wiki 2i2ofiignpm5rj5buhkheapsq0qco8x 2246533 2246532 2024-11-21T16:43:46Z Stashbot 7414 sukhe: rebooting drained lvs2013 2246533 wikitext text/x-wiki 5z708myfj8j4nciw7axrroav7lyyhbb 2246534 2246533 2024-11-21T16:43:56Z Stashbot 7414 sukhe@cumin1002: START - Cookbook sre.hosts.reboot-single for host lvs2013.codfw.wmnet 2246534 wikitext text/x-wiki s16h5zw0dsxgrzi45pv8nxsto0wgbgk 2246535 2246534 2024-11-21T16:46:25Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - cgoubert@cumin1002" 2246535 wikitext text/x-wiki kdnfo2ndcjebkqnom0cviqla2iuuhbl 2246536 2246535 2024-11-21T16:46:39Z Stashbot 7414 sukhe@cumin1002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs2013.codfw.wmnet 2246536 wikitext text/x-wiki gotp3lj2srmxzmr2eek4b78yctwnd0e 2246537 2246536 2024-11-21T16:47:10Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - cgoubert@cumin1002" 2246537 wikitext text/x-wiki n488gb64msjvi6zy549time07suv35w 2246538 2246537 2024-11-21T16:47:12Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2140.codfw.wmnet with OS bookworm 2246538 wikitext text/x-wiki 2su7anicv9nf44wdn0e5ss8wla1fjna 2246539 2246538 2024-11-21T16:47:53Z Stashbot 7414 sukhe@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs2013.codfw.wmnet with reason: rebooting 2246539 wikitext text/x-wiki arr3qhfw33xvnwc7olceh0l0k39q0bc 2246540 2246539 2024-11-21T16:48:07Z Stashbot 7414 sukhe@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs2013.codfw.wmnet with reason: rebooting 2246540 wikitext text/x-wiki 4zk1i970sg94rm7aokkpf3dkpi41as5 2246541 2246540 2024-11-21T16:54:03Z Stashbot 7414 sukhe: enable puppet on lvs2013 and start pybal 2246541 wikitext text/x-wiki 1f3k3zlalgjax624h6z469wesly6cpi 2246542 2246541 2024-11-21T16:54:44Z Stashbot 7414 sukhe@cumin1002: START - Cookbook sre.hosts.remove-downtime for lvs2013.codfw.wmnet 2246542 wikitext text/x-wiki s4y8rm144my7epu76fiah6auk4bvsdq 2246543 2246542 2024-11-21T16:54:46Z Stashbot 7414 sukhe@cumin1002: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs2013.codfw.wmnet 2246543 wikitext text/x-wiki 4a1g8j945srvxe73al6n339148ar4tv 2246545 2246543 2024-11-21T17:02:35Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2157.codfw.wmnet with OS bookworm 2246545 wikitext text/x-wiki hf8n6wmg8rd2rpp4i4q9do4fwpqwbtd 2246551 2246545 2024-11-21T17:31:15Z Stashbot 7414 andrew@cumin1002: START - Cookbook sre.hosts.decommission for hosts clouddb2002-dev.codfw.wmnet 2246551 wikitext text/x-wiki ay0eyn937q50ufyqla6dwdhtgiyuaxj 2246552 2246551 2024-11-21T17:36:11Z Stashbot 7414 andrew@cumin1002: START - Cookbook sre.dns.netbox 2246552 wikitext text/x-wiki h2r97t1rsiclwfeuk7fxtyl6rabro0f 2246553 2246552 2024-11-21T17:39:27Z Stashbot 7414 fabfur: adding acls to kafka-jumbo cluster (T380373) 2246553 wikitext text/x-wiki m8rg0oeqbk5q4uopknqxbzl8pflr8bj 2246554 2246553 2024-11-21T17:39:55Z Stashbot 7414 andrew@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: clouddb2002-dev.codfw.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" 2246554 wikitext text/x-wiki a6magr2xpcqgp6fkfki01kafkhnjlzx 2246555 2246554 2024-11-21T17:40:50Z Stashbot 7414 andrew@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: clouddb2002-dev.codfw.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1002" 2246555 wikitext text/x-wiki lgfw4rocbf0rnik1bcc1e197f73q7n0 2246556 2246555 2024-11-21T17:40:56Z Stashbot 7414 andrew@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246556 wikitext text/x-wiki oivb11h0rinrme8ado1p81tkh66a1wt 2246557 2246556 2024-11-21T17:41:00Z Stashbot 7414 andrew@cumin1002: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts clouddb2002-dev.codfw.wmnet 2246557 wikitext text/x-wiki f5t7ksyap69g7mhszoawuhhlnbxfvmo 2246558 2246557 2024-11-21T17:45:42Z Stashbot 7414 jayme@cumin2002: START - Cookbook sre.k8s.pool-depool-node check for host kubestage2003.codfw.wmnet 2246558 wikitext text/x-wiki j2bqjsl68ttir5yk61rd09e6exonya1 2246559 2246558 2024-11-21T17:45:45Z Stashbot 7414 jayme@cumin2002: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) check for host kubestage2003.codfw.wmnet 2246559 wikitext text/x-wiki rdsm75b51851kxogiacgejyht71ax8e 2246560 2246559 2024-11-21T17:58:24Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=no; selector: name=cp2038.codfw.wmnet [reason: DIMM failure T308459] 2246560 wikitext text/x-wiki 6xojnv99eo2ceix90zzhwmlxrzle9m5 2246561 2246560 2024-11-21T18:07:05Z Stashbot 7414 cdanis@deploy2002: Started scap sync-world: Backport for [[gerrit:1091328|Enabling Charts on commons+test2 (T379689)]] 2246561 wikitext text/x-wiki 9pi536f3hhbf9rabgcnv5zoodwb2tmi 2246563 2246561 2024-11-21T18:09:13Z Stashbot 7414 sukhe@cumin1002: START - Cookbook sre.hosts.downtime for 1:00:00 on cp2038.codfw.wmnet with reason: DIMM replacement in progress 2246563 wikitext text/x-wiki 4s1ol90yjn918uyo8i2xyt917rbeb4k 2246565 2246563 2024-11-21T18:09:26Z Stashbot 7414 sukhe@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on cp2038.codfw.wmnet with reason: DIMM replacement in progress 2246565 wikitext text/x-wiki q866u44ym9xjae3lh56nvb6h9jzk2tr 2246566 2246565 2024-11-21T18:10:27Z Stashbot 7414 sukhe: sudo cumin -b11 'A:cp' 'run-puppet-agent 2246566 wikitext text/x-wiki rfolq5i3erxw6wn38ldz6ds0fasipsi 2246567 2246566 2024-11-21T18:10:46Z Stashbot 7414 sukhe: running puppet on A:cp to resolve failed puppet run 2246567 wikitext text/x-wiki l3ircl81kyjcnh11aruslrvrzjci6ve 2246568 2246567 2024-11-21T18:12:37Z Stashbot 7414 cdanis@deploy2002: cdanis, bvibber: Backport for [[gerrit:1091328|Enabling Charts on commons+test2 (T379689)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246568 wikitext text/x-wiki 4v7bj1or844wbchvg1be3sq7l0wx1ae 2246569 2246568 2024-11-21T18:13:53Z Stashbot 7414 cdanis@deploy2002: cdanis, bvibber: Continuing with sync 2246569 wikitext text/x-wiki 84r74f937rjwiea10zolzkg54555qok 2246570 2246569 2024-11-21T18:15:57Z Stashbot 7414 jayme@cumin2002: conftool action : set/weight=10; selector: name=kubestage200[34].codfw.wmnet 2246570 wikitext text/x-wiki 0ug7t1htzijffd1wnzekhlpjre74ibp 2246571 2246570 2024-11-21T18:16:44Z Stashbot 7414 jayme@cumin2002: conftool action : set/pooled=yes; selector: name=kubestage200[34].codfw.wmnet 2246571 wikitext text/x-wiki cdii9park1y3gyzejuq5xcb4hmkz4jm 2246572 2246571 2024-11-21T18:21:13Z Stashbot 7414 cdanis@deploy2002: Finished scap sync-world: Backport for [[gerrit:1091328|Enabling Charts on commons+test2 (T379689)]] (duration: 14m 05s) 2246572 wikitext text/x-wiki 47mg20mvkgptcx3b4tr9eetddwxw9is 2246576 2246572 2024-11-21T18:43:16Z Stashbot 7414 gmodena@deploy2002: Started deploy [analytics/refinery@199401a]: Ad-hoc deployment [analytics/refinery@199401a6] 2246576 wikitext text/x-wiki 0nop1585v76t1kfhouejcjy4wr7c9n2 2246577 2246576 2024-11-21T18:45:31Z Stashbot 7414 cdanis@deploy2002: Started scap sync-world: Backport for [[gerrit:1093983|Follow-up fix for Charts enable on commons/test2 (T379689)]] 2246577 wikitext text/x-wiki gp9zzh9n24zwddxsc36cxvsitbzc18e 2246578 2246577 2024-11-21T18:49:28Z Stashbot 7414 cdanis@deploy2002: cdanis, bvibber: Backport for [[gerrit:1093983|Follow-up fix for Charts enable on commons/test2 (T379689)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246578 wikitext text/x-wiki 8olzravlmhu3mlc4wlu0vcotzcer5hn 2246579 2246578 2024-11-21T18:49:30Z Stashbot 7414 cdanis@deploy2002: cdanis, bvibber: Continuing with sync 2246579 wikitext text/x-wiki gojswpo8ongwsdtmdyz914cn9i4kfvc 2246580 2246579 2024-11-21T18:57:03Z Stashbot 7414 cdanis@deploy2002: Finished scap sync-world: Backport for [[gerrit:1093983|Follow-up fix for Charts enable on commons/test2 (T379689)]] (duration: 11m 29s) 2246580 wikitext text/x-wiki gh47w6s1bx8h566tr2i7irc865d1x0y 2246581 2246580 2024-11-21T18:57:25Z Stashbot 7414 gmodena@deploy2002: Finished deploy [analytics/refinery@199401a]: Ad-hoc deployment [analytics/refinery@199401a6] (duration: 14m 08s) 2246581 wikitext text/x-wiki fzuwlv6i2fl5d30wibqd66q3zxc5s70 2246582 2246581 2024-11-21T19:01:34Z Stashbot 7414 gmodena@deploy2002: Started deploy [analytics/refinery@199401a] (thin): Ad-hoc deployment THIN [analytics/refinery@199401a6] 2246582 wikitext text/x-wiki m0zn6uqra5tqshkicxd4ib8gon3xt5v 2246583 2246582 2024-11-21T19:07:12Z Stashbot 7414 gmodena@deploy2002: Finished deploy [analytics/refinery@199401a] (thin): Ad-hoc deployment THIN [analytics/refinery@199401a6] (duration: 05m 37s) 2246583 wikitext text/x-wiki 7nhjmz33e55b7yvipmg85466sfcivzr 2246589 2246583 2024-11-21T19:27:52Z Stashbot 7414 gmodena@deploy2002: Started deploy [analytics/refinery@199401a] (hadoop-test): Ad-hoc deployment TEST [analytics/refinery@199401a6] 2246589 wikitext text/x-wiki r22fk5nyams1h8urzvj6y8gtj9tqzh5 2246590 2246589 2024-11-21T19:31:38Z Stashbot 7414 gmodena@deploy2002: Finished deploy [analytics/refinery@199401a] (hadoop-test): Ad-hoc deployment TEST [analytics/refinery@199401a6] (duration: 03m 45s) 2246590 wikitext text/x-wiki 5j7rhu0pno2fx7afum8vvrhtu220owk 2246597 2246590 2024-11-21T20:20:58Z Stashbot 7414 sukhe: force agent on cp2038 2246597 wikitext text/x-wiki ecxnimvp8un1l0j43b0vvdgtxiypfsz 2246599 2246597 2024-11-21T20:24:12Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp2038.codfw.wmnet [reason: DIMM replaced, T308459] 2246599 wikitext text/x-wiki k8d5r44f0u5ex3f519pfgtttss135wi 2246601 2246599 2024-11-21T20:46:41Z Stashbot 7414 tgr|away: T378289 running mwscript-k8s -f --comment="T378289" -- extensions/CentralAuth/maintenance/attachAccount.php --wiki=testwiki --wiki-user-list T378289-accounts-to-attach.tsv 2246601 wikitext text/x-wiki 826m89ie0pqsomzs058dvrdnw3lp8n1 2246602 2246601 2024-11-21T21:05:37Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1090968|Enable AutoModerator on afwiki (T376597)]] 2246602 wikitext text/x-wiki cmat3ezsl3lc3ccy574hxiik053qc8v 2246603 2246602 2024-11-21T21:10:59Z Stashbot 7414 brennen@deploy2002: kgraessle, brennen: Backport for [[gerrit:1090968|Enable AutoModerator on afwiki (T376597)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246603 wikitext text/x-wiki hkhmx6ag2b4ox9zrmi7lr2y6r8oe9uy 2246604 2246603 2024-11-21T21:12:51Z Stashbot 7414 brennen@deploy2002: kgraessle, brennen: Continuing with sync 2246604 wikitext text/x-wiki 1mn071usgzxh3ojk5siguy3k92lh42q 2246605 2246604 2024-11-21T21:19:28Z Stashbot 7414 brennen@deploy2002: Finished scap sync-world: Backport for [[gerrit:1090968|Enable AutoModerator on afwiki (T376597)]] (duration: 13m 50s) 2246605 wikitext text/x-wiki jsa45w73zt60p1n8ilt57j3ayt0h2dy 2246606 2246605 2024-11-21T21:20:47Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1093960|Enable Skin-Codex logging (T375287)]] 2246606 wikitext text/x-wiki fr2sp2c6lr20x5ejxalhviby4oky4vz 2246607 2246606 2024-11-21T21:26:28Z Stashbot 7414 brennen@deploy2002: brennen, jdlrobson: Backport for [[gerrit:1093960|Enable Skin-Codex logging (T375287)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246607 wikitext text/x-wiki edsaa45hul0nv2radln6dnslqraya11 2246608 2246607 2024-11-21T21:29:43Z Stashbot 7414 brennen@deploy2002: brennen, jdlrobson: Continuing with sync 2246608 wikitext text/x-wiki av43a2kpjhanlcfyh99xk0vfj7qxtzn 2246611 2246608 2024-11-21T21:36:41Z Stashbot 7414 brennen@deploy2002: Finished scap sync-world: Backport for [[gerrit:1093960|Enable Skin-Codex logging (T375287)]] (duration: 15m 53s) 2246611 wikitext text/x-wiki es41dkh9p4h2hdhdtcusodpztgp67uo 2246612 2246611 2024-11-21T21:39:03Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1079640|Reduce number of bucketsizes for MediaViewer (group0) (T372165)]], [[gerrit:1093961|Set 'remember' central session object field when recreating (T379254 T372702)]], [[gerrit:1093962|Use cookie to access central session when local session expired]] 2246612 wikitext text/x-wiki e4lex60gjdoezh5lftfwontaqulug6p 2246613 2246612 2024-11-21T21:42:52Z Stashbot 7414 brennen@deploy2002: brennen, tgr, simon04: Backport for [[gerrit:1079640|Reduce number of bucketsizes for MediaViewer (group0) (T372165)]], [[gerrit:1093961|Set 'remember' central session object field when recreating (T379254 T372702)]], [[gerrit:1093962|Use cookie to access central session when local session expired]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246613 wikitext text/x-wiki awag6xhmq0txg7r7589l3s6mpixkfc3 2246614 2246613 2024-11-21T21:51:02Z Stashbot 7414 brennen@deploy2002: Sync cancelled. 2246614 wikitext text/x-wiki 20hz1rcx8xg1k946wnjfb0o6azqdtrv 2246615 2246614 2024-11-21T21:54:49Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1094047|Revert "Reduce number of bucketsizes for MediaViewer (group0)" (T372165)]] 2246615 wikitext text/x-wiki h0c1yxhv8q9eocfo6fizhoktl21wkz1 2246616 2246615 2024-11-21T21:58:40Z Stashbot 7414 brennen@deploy2002: brennen: Backport for [[gerrit:1094047|Revert "Reduce number of bucketsizes for MediaViewer (group0)" (T372165)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246616 wikitext text/x-wiki 0hyonanopkf9oxj8q7uyx23yti4t6aj 2246617 2246616 2024-11-21T21:58:43Z Stashbot 7414 brennen@deploy2002: brennen: Continuing with sync 2246617 wikitext text/x-wiki phb625du06jr6q6r50pl4fj43eb34dz 2246618 2246617 2024-11-21T22:05:24Z Stashbot 7414 brennen@deploy2002: Finished scap sync-world: Backport for [[gerrit:1094047|Revert "Reduce number of bucketsizes for MediaViewer (group0)" (T372165)]] (duration: 10m 34s) 2246618 wikitext text/x-wiki pzwve8wmiz7xyog84ahtcf4av8l01t0 2246619 2246618 2024-11-21T22:06:50Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1092334|Disable various extensions when using the shared login domain (T373737)]] 2246619 wikitext text/x-wiki czgg3ojyodoegps3mgnds2bh7dcc8k1 2246620 2246619 2024-11-21T22:10:25Z Stashbot 7414 brennen@deploy2002: tgr, brennen: Backport for [[gerrit:1092334|Disable various extensions when using the shared login domain (T373737)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246620 wikitext text/x-wiki 86005pqgusvoueeg79xyydgf8njuucn 2246621 2246620 2024-11-21T22:18:21Z Stashbot 7414 brennen@deploy2002: tgr, brennen: Continuing with sync 2246621 wikitext text/x-wiki hueiefwvw8t1k9vx3bo8zdh2fu5okzb 2246622 2246621 2024-11-21T22:22:59Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.reimage for host es2041.codfw.wmnet with OS bookworm 2246622 wikitext text/x-wiki 63eyy8v67tiso0319346ggp5zkvjhzc 2246623 2246622 2024-11-21T22:25:06Z Stashbot 7414 brennen@deploy2002: Finished scap sync-world: Backport for [[gerrit:1092334|Disable various extensions when using the shared login domain (T373737)]] (duration: 18m 16s) 2246623 wikitext text/x-wiki qfo1mk3almsdhy90q6rpw7mnx18igvw 2246624 2246623 2024-11-21T22:25:42Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1094000|Add tracking categories for {{#chart:}} usage (T369684)]] 2246624 wikitext text/x-wiki ntuc1fsqk6ci269taftv6x1vg4mslio 2246625 2246624 2024-11-21T22:32:08Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.ganeti.makevm for new host aux-k8s-etcd2003.codfw.wmnet 2246625 wikitext text/x-wiki pbcurywynjxl98btv5wsda3kkmajcq6 2246626 2246625 2024-11-21T22:32:11Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.netbox 2246626 wikitext text/x-wiki k2dsdh9ev73t7rml05p8vnywgzt9npf 2246628 2246626 2024-11-21T22:35:32Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2003.codfw.wmnet - herron@cumin1002" 2246628 wikitext text/x-wiki rggkbpz7grdos1u909spm0enh65guha 2246629 2246628 2024-11-21T22:35:37Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2003.codfw.wmnet - herron@cumin1002" 2246629 wikitext text/x-wiki hmrsxg5jow85zztwck69mbuxzsutvpi 2246630 2246629 2024-11-21T22:35:39Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246630 wikitext text/x-wiki ep6y74ey72wcg9qobv1su9w3c4gx4gz 2246631 2246630 2024-11-21T22:35:42Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.wipe-cache aux-k8s-etcd2003.codfw.wmnet on all recursors 2246631 wikitext text/x-wiki 393qjak8uv9vbawntdiqz8orxr0gd34 2246632 2246631 2024-11-21T22:35:45Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) aux-k8s-etcd2003.codfw.wmnet on all recursors 2246632 wikitext text/x-wiki m3mokwl03gsov4pqlndujdz066kybu7 2246633 2246632 2024-11-21T22:36:07Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-etcd2003.codfw.wmnet - herron@cumin1002" 2246633 wikitext text/x-wiki fgll7kdknp704f11aaswyeb2oyk10b8 2246634 2246633 2024-11-21T22:36:12Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-etcd2003.codfw.wmnet - herron@cumin1002" 2246634 wikitext text/x-wiki pcwykf8qpw5eka7gikvfd3kk70nwyn0 2246635 2246634 2024-11-21T22:38:08Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.reimage for host aux-k8s-etcd2003.codfw.wmnet with OS bookworm 2246635 wikitext text/x-wiki 6jv27pl3knzy0iltxswbouwt9m5j432 2246636 2246635 2024-11-21T22:40:54Z Stashbot 7414 brennen@deploy2002: bvibber, brennen: Backport for [[gerrit:1094000|Add tracking categories for {{#chart:}} usage (T369684)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246636 wikitext text/x-wiki 6nzf16hpk2vqipejkfh54gzawa7e3ry 2246637 2246636 2024-11-21T22:40:57Z Stashbot 7414 brennen@deploy2002: Sync cancelled. 2246637 wikitext text/x-wiki 6xkzcgcsh64rpdp4odyn314uzq5odgq 2246638 2246637 2024-11-21T22:42:43Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: resuming sync for [[gerrit:1094000|Add tracking categories for {{#chart:}} usage (T369684)]] after messing up a keypress 2246638 wikitext text/x-wiki rc68wo1dfpumisz0a66l27wf3yg0sjg 2246640 2246638 2024-11-21T22:52:38Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-etcd2003.codfw.wmnet with reason: host reimage 2246640 wikitext text/x-wiki tsp7q5h7yjb64n0lnlcddt7boa86spc 2246641 2246640 2024-11-21T22:54:48Z Stashbot 7414 brennen@deploy2002: Finished scap sync-world: resuming sync for [[gerrit:1094000|Add tracking categories for {{#chart:}} usage (T369684)]] after messing up a keypress (duration: 12m 35s) 2246641 wikitext text/x-wiki sw5qwde139xol3ft9iujb1ntthvp3km 2246642 2246641 2024-11-21T22:55:39Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-etcd2003.codfw.wmnet with reason: host reimage 2246642 wikitext text/x-wiki r5oez8d1u5vv1nex4cbflv936yklyub 2246643 2246642 2024-11-21T22:55:47Z Stashbot 7414 brennen@deploy2002: Started scap sync-world: Backport for [[gerrit:1094005|Add statsv to charts impressions (T379833)]] 2246643 wikitext text/x-wiki 84hewpgbpk3yovt9ncxn9quxtv893um 2246644 2246643 2024-11-21T23:00:04Z Stashbot 7414 brennen@deploy2002: bvibber, brennen: Backport for [[gerrit:1094005|Add statsv to charts impressions (T379833)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) 2246644 wikitext text/x-wiki rdh9k3tpyq9ebn50639aknugi3tzj6p 2246645 2246644 2024-11-21T23:01:05Z Stashbot 7414 brennen@deploy2002: bvibber, brennen: Continuing with sync 2246645 wikitext text/x-wiki ef5s9kosywxj9qffxlzv90o7r23r7ck 2246646 2246645 2024-11-21T23:06:44Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es2041.codfw.wmnet with OS bookworm 2246646 wikitext text/x-wiki 99gkasgbueo3mzj94yd56ufx7nfj5ar 2246647 2246646 2024-11-21T23:07:56Z Stashbot 7414 brennen@deploy2002: Finished scap sync-world: Backport for [[gerrit:1094005|Add statsv to charts impressions (T379833)]] (duration: 12m 08s) 2246647 wikitext text/x-wiki bapgkyznf4nuxf49yw55yur93xatf4m 2246648 2246647 2024-11-21T23:08:48Z Stashbot 7414 brennen: end of utc late backport & config window 2246648 wikitext text/x-wiki 32kfvavv60803imq9p5h3dx3sms53oi 2246649 2246648 2024-11-21T23:09:41Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-etcd2003.codfw.wmnet with OS bookworm 2246649 wikitext text/x-wiki 9ietvx7l671q5wz27k58f6ixecznpjh 2246650 2246649 2024-11-21T23:09:43Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-etcd2003.codfw.wmnet 2246650 wikitext text/x-wiki 9snuttbe5992csyq9zd508c11hpd7dt 2246651 2246650 2024-11-21T23:11:20Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.ganeti.makevm for new host aux-k8s-etcd2004.codfw.wmnet 2246651 wikitext text/x-wiki 0jefpx76azx6pw4ifogbhl8yz93h3bh 2246652 2246651 2024-11-21T23:11:32Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.netbox 2246652 wikitext text/x-wiki ki0297oq8pz7rofg4ladnmzkx93ma78 2246657 2246652 2024-11-21T23:24:52Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2004.codfw.wmnet - herron@cumin1002" 2246657 wikitext text/x-wiki iryh70udn87u46zbewgwyuymaz5gkn1 2246659 2246657 2024-11-21T23:28:54Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2004.codfw.wmnet - herron@cumin1002" 2246659 wikitext text/x-wiki censn5ocfqtg3jw7mnotby4cdfbcw7v 2246660 2246659 2024-11-21T23:28:57Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246660 wikitext text/x-wiki bmprvxaqf2mclmzg4y6jev3awqlcumi 2246661 2246660 2024-11-21T23:28:59Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.wipe-cache aux-k8s-etcd2004.codfw.wmnet on all recursors 2246661 wikitext text/x-wiki hl9cukb2nc9d8px33c1853inlpyik8v 2246662 2246661 2024-11-21T23:29:02Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) aux-k8s-etcd2004.codfw.wmnet on all recursors 2246662 wikitext text/x-wiki pg1ahuwv5m4codepna0dgpel836rgpy 2246663 2246662 2024-11-21T23:29:24Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-etcd2004.codfw.wmnet - herron@cumin1002" 2246663 wikitext text/x-wiki hmilx1ldpk3criqzn39e5zbfm8y1d7t 2246664 2246663 2024-11-21T23:29:29Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-etcd2004.codfw.wmnet - herron@cumin1002" 2246664 wikitext text/x-wiki 22qotjxvg3al6rg019i7ugar7fehfrs 2246665 2246664 2024-11-21T23:36:37Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.reimage for host aux-k8s-etcd2004.codfw.wmnet with OS bookworm 2246665 wikitext text/x-wiki r5168l3nae1xy9r7lusa1tsbbzz0hqu 2246666 2246665 2024-11-21T23:52:55Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-etcd2004.codfw.wmnet with reason: host reimage 2246666 wikitext text/x-wiki dsw83czqgl96twi0dysj26e2l6f0837 2246667 2246666 2024-11-21T23:56:25Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-etcd2004.codfw.wmnet with reason: host reimage 2246667 wikitext text/x-wiki l1fr0720zj007mrenb0ds7bp0uqctjq 2246668 2246667 2024-11-22T00:11:01Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-etcd2004.codfw.wmnet with OS bookworm 2246668 wikitext text/x-wiki 9oi7293xx35mgjw0hx3sl377010idnw 2246669 2246668 2024-11-22T00:11:10Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-etcd2004.codfw.wmnet 2246669 wikitext text/x-wiki 4ndxonsfbon6glkm4gvwyavxcjiizie 2246670 2246669 2024-11-22T00:11:26Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.ganeti.makevm for new host aux-k8s-etcd2005.codfw.wmnet 2246670 wikitext text/x-wiki am78pti44oiaj8xcd6plmp6nwm0oqv3 2246671 2246670 2024-11-22T00:11:28Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.netbox 2246671 wikitext text/x-wiki f2lszb0qawlioeazuu6ftjc40368k4m 2246672 2246671 2024-11-22T00:16:54Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2005.codfw.wmnet - herron@cumin1002" 2246672 wikitext text/x-wiki d144owpm9qtphivb4yxbffqtaloutbv 2246673 2246672 2024-11-22T00:20:08Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2005.codfw.wmnet - herron@cumin1002" 2246673 wikitext text/x-wiki kau0vbfe7jdazuw3lx4k7meoxt6xp64 2246674 2246673 2024-11-22T00:20:11Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246674 wikitext text/x-wiki dtdhmfpy8yppfhbynj2gxx7qr485qoz 2246675 2246674 2024-11-22T00:20:14Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.dns.wipe-cache aux-k8s-etcd2005.codfw.wmnet on all recursors 2246675 wikitext text/x-wiki lz4sf5g243g54y17jlnyks9vu3brwcg 2246676 2246675 2024-11-22T00:20:16Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) aux-k8s-etcd2005.codfw.wmnet on all recursors 2246676 wikitext text/x-wiki q9u9b2y8k1govbe2ozbrolk442ote8h 2246677 2246676 2024-11-22T00:20:37Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-etcd2005.codfw.wmnet - herron@cumin1002" 2246677 wikitext text/x-wiki dngntra86gsvzhpmiccfaonlnbalyix 2246678 2246677 2024-11-22T00:20:42Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM aux-k8s-etcd2005.codfw.wmnet - herron@cumin1002" 2246678 wikitext text/x-wiki tapb0sgzens3l1fj4eyz6ua7aua3m1d 2246679 2246678 2024-11-22T00:27:48Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.reimage for host aux-k8s-etcd2005.codfw.wmnet with OS bookworm 2246679 wikitext text/x-wiki ta529gbo1u5pa9e5xbkcfk8wiebn9ug 2246680 2246679 2024-11-22T00:42:57Z Stashbot 7414 herron@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-etcd2005.codfw.wmnet with reason: host reimage 2246680 wikitext text/x-wiki pydfgzrrrz3e42sykmul5i2iriszqqm 2246681 2246680 2024-11-22T00:46:33Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-etcd2005.codfw.wmnet with reason: host reimage 2246681 wikitext text/x-wiki oinzotbnl9nuu73hbn8a4d0qtzt5k0d 2246682 2246681 2024-11-22T01:00:03Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-etcd2005.codfw.wmnet with OS bookworm 2246682 wikitext text/x-wiki 510n1n6txcmero14ia9344xvcynnjxf 2246683 2246682 2024-11-22T01:00:17Z Stashbot 7414 herron@cumin1002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-etcd2005.codfw.wmnet 2246683 wikitext text/x-wiki q8cxv5lpfay21jvjzgwknlraa0sfb7k 2246684 2246683 2024-11-22T08:07:34Z Stashbot 7414 oblivian@cumin1002: START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Add sorting options to tree view - oblivian@cumin1002" 2246684 wikitext text/x-wiki 4u9bup5sx1ebiker979s49gsiiadp9n 2246685 2246684 2024-11-22T08:07:40Z Stashbot 7414 oblivian@cumin1002: START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Add sorting options to tree view - oblivian@cumin1002 2246685 wikitext text/x-wiki 55qgpbrcdnhs3kzk3dcax756urxdcvh 2246686 2246685 2024-11-22T08:08:13Z Stashbot 7414 oblivian@cumin1002: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Add sorting options to tree view - oblivian@cumin1002 2246686 wikitext text/x-wiki lpn8dkmj9n4h4pvhsmruyi64l0a4ycf 2246687 2246686 2024-11-22T08:08:16Z Stashbot 7414 oblivian@cumin1002: END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Add sorting options to tree view - oblivian@cumin1002" 2246687 wikitext text/x-wiki ivio9fivfeit9pltdfw1h1gryvrc3g4 2246691 2246687 2024-11-22T10:10:03Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.decommission for hosts ganeti1011.eqiad.wmnet 2246691 wikitext text/x-wiki epnu0vaskkfk2z1p1tg3nunu4zy7fpz 2246693 2246691 2024-11-22T10:16:22Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.dns.netbox 2246693 wikitext text/x-wiki fb9mxcufel7zukvxaezg2jmnp3mwayf 2246694 2246693 2024-11-22T10:21:25Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.reimage for host wikikube-worker2159.codfw.wmnet with OS bookworm 2246694 wikitext text/x-wiki qecdawh26ypsy4qcp3zw1u28l56z3cq 2246695 2246694 2024-11-22T10:22:15Z Stashbot 7414 vgutierrez: manually stopping haproxykafka on A:cp-ulsfo and A:cp-eqsin - T380570 2246695 wikitext text/x-wiki 8mllvr27ttexym7kczsu0tqyxczx5rn 2246696 2246695 2024-11-22T10:22:37Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti1011.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" 2246696 wikitext text/x-wiki 4hxv8jpl6hps5dkdx6x6tlw62nhuyzl 2246697 2246696 2024-11-22T10:23:28Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti1011.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" 2246697 wikitext text/x-wiki i1b5agbxsnsci1j77dgnok6pazmrbzu 2246698 2246697 2024-11-22T10:23:31Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246698 wikitext text/x-wiki j0a7uevflexggtscji9h95xmajbj7ez 2246699 2246698 2024-11-22T10:23:33Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts ganeti1011.eqiad.wmnet 2246699 wikitext text/x-wiki 13dinqmtwzbf1djumcpclhm5m4p8aml 2246700 2246699 2024-11-22T10:26:05Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.decommission for hosts ganeti1014.eqiad.wmnet 2246700 wikitext text/x-wiki 4whlrdevhdf1d0inl4o5ayo8fd7mwwu 2246701 2246700 2024-11-22T10:31:59Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.dns.netbox 2246701 wikitext text/x-wiki 7f8zloh96oo86s5rdgp20l9l37d9xh1 2246703 2246701 2024-11-22T10:37:01Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti1014.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" 2246703 wikitext text/x-wiki geu76cm8yyjoxy8e60fkc4gksbt3avz 2246704 2246703 2024-11-22T10:37:31Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti1014.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" 2246704 wikitext text/x-wiki n9civlozqbvv4c8agxr0t0xbfv2cx79 2246705 2246704 2024-11-22T10:37:33Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2246705 wikitext text/x-wiki f8gwx0hip6fey39kolpfigq510lo6vz 2246706 2246705 2024-11-22T10:37:36Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts ganeti1014.eqiad.wmnet 2246706 wikitext text/x-wiki l5rmg510nlq46r0e9o3gmxqj102o2cc 2246707 2246706 2024-11-22T10:40:24Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2159.codfw.wmnet with reason: host reimage 2246707 wikitext text/x-wiki b18vo5povuqdayb5gbagor2j96zpix9 2246708 2246707 2024-11-22T10:43:15Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2159.codfw.wmnet with reason: host reimage 2246708 wikitext text/x-wiki jaqd5n0mdeuzalez38r6d3589yhksdj 2246709 2246708 2024-11-22T11:02:09Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2159.codfw.wmnet with OS bookworm 2246709 wikitext text/x-wiki h7ntfgsfesla8y9f7ackqqylyuruhhz 2246710 2246709 2024-11-22T11:05:00Z Stashbot 7414 claime: homer 'lsw1-b7-codfw*' commit 'T377028' 2246710 wikitext text/x-wiki h8rzy6hddsmfn2xn3af21li3omt8wec 2246711 2246710 2024-11-22T11:07:49Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2140.codfw.wmnet 2246711 wikitext text/x-wiki mhbv1epah8014t96z26jfnn5miobjb0 2246712 2246711 2024-11-22T11:07:52Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2140.codfw.wmnet 2246712 wikitext text/x-wiki dn5za1yvb5co9ba5qyr7j6m9ftzfzq2 2246717 2246712 2024-11-22T11:18:28Z Stashbot 7414 claime: homer 'lsw1-b4-codfw*' commit 'T376966' 2246717 wikitext text/x-wiki 4sptylisxjgvs61ez46ph2rl4gmd8s2 2246718 2246717 2024-11-22T11:19:05Z Stashbot 7414 claime: homer 'lsw1-b7-codfw*' commit 'T376966' 2246718 wikitext text/x-wiki 8k7m00qd6d1dlrc07le5b79oc16xiwr 2246719 2246718 2024-11-22T11:19:50Z Stashbot 7414 claime: homer 'lsw1-c2-codfw*' commit 'T376966' 2246719 wikitext text/x-wiki reezyxjmgrb7bj83ans4qk9qblqxlny 2246720 2246719 2024-11-22T11:20:35Z Stashbot 7414 claime: homer 'lsw1-c4-codfw*' commit 'T376966' 2246720 wikitext text/x-wiki 1jzaegnjx5w15mmqgrtxg0f4fjmjvfd 2246723 2246720 2024-11-22T11:21:38Z Stashbot 7414 claime: homer 'lsw1-c7-codfw*' commit 'T376966' 2246723 wikitext text/x-wiki eyqgulc9wt7wiwh5prf0chu12lzgitv 2246724 2246723 2024-11-22T11:22:34Z Stashbot 7414 claime: homer 'lsw1-d1-codfw*' commit 'T376966' 2246724 wikitext text/x-wiki lw9d6j6pbjapj88m3u72oq505e5fmsz 2246726 2246724 2024-11-22T11:23:24Z Stashbot 7414 claime: homer 'lsw1-d4-codfw*' commit 'T376966' 2246726 wikitext text/x-wiki p4p31rnugsyq64e8cwcs6pauwq147x8 2246728 2246726 2024-11-22T11:24:07Z Stashbot 7414 claime: homer 'lsw1-d5-codfw*' commit 'T376966' 2246728 wikitext text/x-wiki i78bpi77noje15yffmqp8gitaxic96t 2246732 2246728 2024-11-22T11:24:44Z Stashbot 7414 claime: homer 'lsw1-d6-codfw*' commit 'T376966' 2246732 wikitext text/x-wiki ilxkdkgf7aq9u1bz17ptrw9b4ridcc3 2246733 2246732 2024-11-22T11:25:26Z Stashbot 7414 claime: homer 'lsw1-d7-codfw*' commit 'T376966' 2246733 wikitext text/x-wiki ti5k06rqd55c6p42p12nm20lo4lzr64 2246734 2246733 2024-11-22T11:26:22Z Stashbot 7414 cgoubert@cumin1002: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2156-2170].codfw.wmnet 2246734 wikitext text/x-wiki fy41hbkhkxqowvttuetw48snr9iy4c5 2246735 2246734 2024-11-22T11:26:29Z Stashbot 7414 cgoubert@cumin1002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2156-2170].codfw.wmnet 2246735 wikitext text/x-wiki dpdzek9mblcw6fwhv7dws856k0om4it History of job queue runners at WMF 0 16009 2246610 2073577 2024-11-21T21:36:05Z BryanDavis 1604 /* EventBus */ avoid redirect 2246610 wikitext text/x-wiki ptf67to6l9ts045h53jqdirm0dy9j0q Release Engineering/SAL 0 17290 2246575 2246348 2024-11-21T18:42:22Z Stashbot 7414 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1093981 T380524 2246575 wikitext text/x-wiki ptg2661pm8u0baqf26dtxuonpzpyg6t Ganeti 0 22777 2246517 2241570 2024-11-21T15:39:52Z Herron 10463 /* Change disk template for a VM (aka drop DBRD) */ fix typos and reword section to hopefully make terms like "disable drbd" easier to find 2246517 wikitext text/x-wiki 32ge6690lqy8hrb4gxc3lzvdgun6mfp WikimediaDebug 0 67018 2246737 2245501 2024-11-22T11:33:29Z Lucas Werkmeister (WMDE) 10037 /* Browser usage */ refresh instructions; selecting the backend is no longer necessary (scap backport deploys to all test servers, and most of the time the default of k8s-mwdebug should be used anyway) 2246737 wikitext text/x-wiki ol7rn5mctybv49spmzer544dcr7zegq Portal:Cloud VPS/Admin/Skill matrix 0 442952 2246574 2200731 2024-11-21T18:34:09Z BryanDavis 1604 /* See also */ new section 2246574 wikitext text/x-wiki p3iielg0h066n15o6jj4c9eayz3j15p Portal:Toolforge/Admin/ToolsDB 0 443711 2246498 2246178 2024-11-21T15:21:39Z FNegri-WMF 32595 /* Re-importing data after replication failures */ hide procedure into a "collapse" template 2246498 wikitext text/x-wiki bqxi5gku6uydsu2yje741z4rprt1k7v Nova Resource:Tools.wd-image-positions/SAL 498 443947 2246639 2245199 2024-11-21T22:44:26Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-13: deployed 3486d60faf (l10n updates: tcy) 2246639 wikitext text/x-wiki qyi7101e44db852ool8msw4qen6eewj Kubernetes/Service ports 0 444677 2246727 2234744 2024-11-22T11:23:25Z LToscano (WMF) 37705 Reserve port for Kartotherian 2246727 wikitext text/x-wiki i87xhyqfycab62gc5m1w2jw5odciwpj DNS/Netbox 0 445763 2246653 2195229 2024-11-21T23:18:21Z Ryan Kemper 17058 /* How to manually allocate a special purpose IP address in Netbox */ codfw address different now for some reason 2246653 wikitext text/x-wiki howvkvqtjic808takszb6hkfe5rgvfc Data Platform/Data Lake/Content 0 446823 2246564 2201787 2024-11-21T18:09:22Z XCollazo-WMF 37720 Add link to wmf_dumps.mediawiki_content_history_v1 2246564 wikitext text/x-wiki sussgnxrz4lqrbnwwrpe5bvh69hwqps 2246587 2246564 2024-11-21T19:17:42Z XCollazo-WMF 37720 Fix link 2246587 wikitext text/x-wiki 7xsmj6wp67dlelihw0995dqiyu3mamy Data Platform/Systems/Jupyter 0 447004 2246485 2241776 2024-11-21T14:50:06Z MPopov (WMF) 37710 /* Authenticating via Kerberos */ Clarify 2246485 wikitext text/x-wiki 5z85tn13e2dopv7ax9073wmd99la8e2 User:Ottomata/Organized Code 2 448673 2246721 2061050 2024-11-22T11:20:40Z Ottomata 88 Ottomata moved page [[User:Ottomata/CamelCase is bad]] to [[User:Ottomata/Organized Code]]: Will collect other preferences in this page 2061050 wikitext text/x-wiki b4qb7rqh2v4hxdyo1ssjyshadjnffz0 2246731 2246721 2024-11-22T11:24:31Z Ottomata 88 2246731 wikitext text/x-wiki k7lzboputy4xyhi7tsb0hz3xxzo5ugi 2246742 2246731 2024-11-22T11:46:57Z Ottomata 88 More preferences 2246742 wikitext text/x-wiki jnt5urtk5dtrw1oap4mov9x1qkr9v2a 2246745 2246742 2024-11-22T11:55:27Z Ottomata 88 2246745 wikitext text/x-wiki seq5b3zhbqmvpojwivhqu4m8olq7eam Kubernetes/Clusters/Add or remove nodes 0 448736 2246562 2177043 2024-11-21T18:08:26Z JMeybohm (WMF) 16709 /* Step 3: Add to conftool/LVS */ 2246562 wikitext text/x-wiki 602gkvs2wfthxv6lbdbeomc9u6qu7f9 Wikifunctions/Runbook 0 451448 2246689 2243988 2024-11-22T09:55:11Z Geno (WMF) 38227 /* Wikifunctions.org wiki */ Update loadPreDefinedObject guide 2246689 wikitext text/x-wiki pkot0vgnkxb4klt8c2s75bt7ruzj7pi 2246690 2246689 2024-11-22T09:59:38Z Geno (WMF) 38227 /* Add or edit pre-defined Objects in production */ 2246690 wikitext text/x-wiki 2wbzrtnpd00gvvagb6qludckij1udjw Quality of Service (Network) 0 451605 2246654 2207478 2024-11-21T23:21:23Z Cathal Mooney 24288 /* Interface Config */ 2246654 wikitext text/x-wiki 2mh2bp3vlacumhe1pa0qijbeb7qmg3a 2246655 2246654 2024-11-21T23:24:27Z Cathal Mooney 24288 /* Scheduler Maps */ 2246655 wikitext text/x-wiki tbt4th9nllroiy3iep4l3fab89wcqb2 2246656 2246655 2024-11-21T23:24:39Z Cathal Mooney 24288 /* Scheduler Maps */ 2246656 wikitext text/x-wiki hd80nk7clpremldtqffdnaqft7etr0p 2246658 2246656 2024-11-21T23:26:24Z Cathal Mooney 24288 /* Traffic Control Profile */ 2246658 wikitext text/x-wiki jyf19ajgc4qpc6isk0gcxf7ayybyipk Wikimedia Cloud Services team/Ownership 0 452153 2246573 2196278 2024-11-21T18:33:17Z BryanDavis 1604 /* See also */ new section 2246573 wikitext text/x-wiki ivhcqgqx1sg8bl4deqcugfxkw79rdur User:Ottomata/Notes 2 452453 2246730 2217012 2024-11-22T11:24:25Z Ottomata 88 Linked to User:Ottomata/Organized_Code 2246730 wikitext text/x-wiki bbj73gngmkz8edanpvlew2f2k2a068b Tool:Gitlab-account-approval/Log 116 453906 2246441 2245661 2024-11-21T13:45:08Z Gitlabaccountapprovalbot 37332 @sascha was approved. 2246441 wikitext text/x-wiki 1gkb8sp4sjrucvcluk4c2piidbdd5zf Catalyst/Decision log 0 455476 2246595 2214326 2024-11-21T20:08:15Z EBomani-WMF 37882 Added new decision regarding dependency management. 2246595 wikitext text/x-wiki dxrmk44e9a3hkkpv25wx5r5dyxi8q9m Portal:Cloud VPS/Admin/IPv6/initial deploy 0 455662 2246401 2245155 2024-11-21T12:53:53Z ABorrero (WMF) 11379 /* DNS */ clarify 2246401 wikitext text/x-wiki rrq3vj4z1asnmk6ehqdc8cypu3ias1j 2246404 2246401 2024-11-21T12:58:29Z ABorrero (WMF) 11379 /* addressing plan */ add IPv4 information 2246404 wikitext text/x-wiki qudahzs0urilcbs89vgat4068tm8ajn 2246702 2246404 2024-11-22T10:33:13Z Taavi 13997 /* other details */ 2246702 wikitext text/x-wiki 4bkdnd437eogqlsm207t1z0bb72k13k Data Platform/Systems/Airflow/Kubernetes 0 455675 2246439 2246164 2024-11-21T13:42:29Z Brouberol 37217 /* Migrate the scheduler and kerberos components to Kubernetes */ 2246439 wikitext text/x-wiki 16gzhnpbjfz2z9b5ayi1orytff91pr6 Metrics Platform/Contextual attributes/JavaScript 0 455782 2246692 2231836 2024-11-22T10:12:00Z Santiago Faci 35637 2246692 wikitext text/x-wiki gb9cun92uezpxbq9sozk0x81j68d2jh News/Cloud VPS VXLAN IPv6 migration 0 456133 2246409 2244662 2024-11-21T13:06:50Z ABorrero (WMF) 11379 introduce structure 2246409 wikitext text/x-wiki 9c584mlympvy707ya4hqbbbc3kwvc1p 2246420 2246409 2024-11-21T13:21:05Z ABorrero (WMF) 11379 /* What is changing? */ add content 2246420 wikitext text/x-wiki 6l0csdsnote1fmuh610aztgnp5f23kb 2246429 2246420 2024-11-21T13:26:38Z ABorrero (WMF) 11379 clarify network options 2246429 wikitext text/x-wiki m710zyl47pywy5k48myksang7wjl4zl 2246436 2246429 2024-11-21T13:32:57Z ABorrero (WMF) 11379 /* Timeline */ bootstrap timeline 2246436 wikitext text/x-wiki srgh14pz59a8b2zh0d619wrcc8wwb2y 2246442 2246436 2024-11-21T13:47:25Z ABorrero (WMF) 11379 /* What should I do? */ expand section 2246442 wikitext text/x-wiki 7hnzy5ljni7geuy3wj1r6k4wupis2h6 2246446 2246442 2024-11-21T13:58:10Z ABorrero (WMF) 11379 /* What are the primary effects of moving to the new network setup? */ expand section 2246446 wikitext text/x-wiki i1q2brjdpjcsfmihpfla8ru9koz7t4l 2246456 2246446 2024-11-21T14:12:16Z ABorrero (WMF) 11379 /* What are the primary effects of moving to the new network setup? */ expand section even more 2246456 wikitext text/x-wiki m8xrgjwzm1hmxey1wowny6vzard63dv 2246457 2246456 2024-11-21T14:12:37Z ABorrero (WMF) 11379 /* Firewalling and network policies on IPv6 */ use firewall instead of firewalling 2246457 wikitext text/x-wiki oxsmtrbhvbfjp01l13tcg37blxlia74 2246459 2246457 2024-11-21T14:17:07Z ABorrero (WMF) 11379 /* Exposing internet services from your virtual machines over IPv6 */ reword sentence 2246459 wikitext text/x-wiki h2ilpvamvicfjfsn7gyado04j8xo2w5 2246460 2246459 2024-11-21T14:17:35Z ABorrero (WMF) 11379 /* What is changing? */ typo 2246460 wikitext text/x-wiki 5bxyuz6ybz4dpe8qu6wpbfbuqet2efo 2246468 2246460 2024-11-21T14:25:24Z ABorrero (WMF) 11379 /* Solution to common problems */ expand section 2246468 wikitext text/x-wiki fzzyzomd30eput7uopbrvf8ra4j6z8r 2246713 2246468 2024-11-22T11:10:41Z ABorrero (WMF) 11379 reword sentence 2246713 wikitext text/x-wiki qu8qpuf11j3vp8opsbrp9zyiq6o5fea 2246714 2246713 2024-11-22T11:11:40Z ABorrero (WMF) 11379 /* What is changing? */ highlight network names 2246714 wikitext text/x-wiki k3asp9cdj6k0o5ko2h86iclr94t8vqw 2246715 2246714 2024-11-22T11:15:45Z ABorrero (WMF) 11379 /* What should I do? */ clarify some statements 2246715 wikitext text/x-wiki huz5xvq0b2gp5ia45l55q9wfxf75to9 2246716 2246715 2024-11-22T11:17:56Z ABorrero (WMF) 11379 /* Network connections using IPv6 */ refresh link 2246716 wikitext text/x-wiki n8qrafv5ks87v7ql3bdzomh06polz6x 2246725 2246716 2024-11-22T11:23:16Z ABorrero (WMF) 11379 /* I don't want to rebuild my virtual machine, because I will lose data or configuration */ clarify 2246725 wikitext text/x-wiki evzbmfo4xocrifh2pein1k3bqz1natb 2246729 2246725 2024-11-22T11:24:24Z ABorrero (WMF) 11379 /* I want to do nothing, will anything break? */ clarify 2246729 wikitext text/x-wiki ahyr52tq54aaeffey2akm03dkf058gi 2246736 2246729 2024-11-22T11:26:57Z ABorrero (WMF) 11379 /* I want to do nothing today, and wait until the next operating system upgrade before doing this migration */ clarify 2246736 wikitext text/x-wiki dytndsgs5nblowtsw6i090gd9gx58mc 2246738 2246736 2024-11-22T11:33:47Z ABorrero (WMF) 11379 /* Common questions and problems */ clarify a few more things 2246738 wikitext text/x-wiki 3pfatzf7dr2udleeqxvoml7n489hk8q 2246739 2246738 2024-11-22T11:42:14Z ABorrero (WMF) 11379 /* Exposing internet services from your virtual machines over IPv6 */ clarify a few more things 2246739 wikitext text/x-wiki ryxswvcrt2r6n6psql3npsfnx23ow7v 2246740 2246739 2024-11-22T11:42:47Z ABorrero (WMF) 11379 /* Are virtual machines attached to different network able to communicate with each other? */ add help link 2246740 wikitext text/x-wiki 1qaupltfh480lwcqer7873m4c1hlxlt 2246741 2246740 2024-11-22T11:44:19Z ABorrero (WMF) 11379 /* How are operating system upgrades related to this network migration? */ expand 2246741 wikitext text/x-wiki 5e8z2r15idcjssfoliii63ppmeccubd 2246743 2246741 2024-11-22T11:50:41Z ABorrero (WMF) 11379 /* Common questions and problems */ add floating ips section 2246743 wikitext text/x-wiki 1r75b7rj8bbmud6sknbb8g10et3ctp3 2246744 2246743 2024-11-22T11:54:16Z ABorrero (WMF) 11379 /* After the migration period */ expand a bit 2246744 wikitext text/x-wiki konj5bd41lqylxaus3to8t1bgmutklm MediaWiki JobQueue/Operations 0 456144 2246519 2246308 2024-11-21T15:50:26Z SFrench-WMF 37799 /* Resolution */ Use safer value substitution in kafka-consumer-groups example commands 2246519 wikitext text/x-wiki p7qxu6fv8mbd6ro3p9yjssm70x7zgyi User:Bking/Notes/Test Kubernetes Deploy 2 456148 2246544 2246256 2024-11-21T16:58:17Z Bking 29017 2246544 wikitext text/x-wiki off5w14i2gwrxfr11yeurmkzekhbfqz Nova Resource:Tofuinfratest-1071b4ca-6240-4eaa-a4fe-ec467d09c4f0 498 456149 2246373 2024-11-21T12:00:16Z Labslogbot 55 Auto update of instance info. 2246373 wikitext text/x-wiki o386gnhp337y4pzazb1fe14h7dzu3iu Data Platform/Data Lake/Content/Mediawiki content history v1 0 456150 2246584 2024-11-21T19:09:11Z XCollazo-WMF 37720 First draft of wmf_dumps.mediawiki_content_history_v1 documentation. 2246584 wikitext text/x-wiki g70hwjhoncgtkppp1x047nem3x4q5gl 2246585 2246584 2024-11-21T19:16:29Z XCollazo-WMF 37720 XCollazo-WMF moved page [[Mediawiki content history v1]] to [[Data Platform/Data Lake/Content/Mediawiki content history v1]]: New page that should be under Data Platform/Data Lake/Content 2246584 wikitext text/x-wiki g70hwjhoncgtkppp1x047nem3x4q5gl 2246609 2246585 2024-11-21T21:31:52Z XCollazo-WMF 37720 Start FAQ section. 2246609 wikitext text/x-wiki 9s510c5rktsttgv2ia6pjr3skkpslig Mediawiki content history v1 0 456151 2246586 2024-11-21T19:16:29Z XCollazo-WMF 37720 XCollazo-WMF moved page [[Mediawiki content history v1]] to [[Data Platform/Data Lake/Content/Mediawiki content history v1]]: New page that should be under Data Platform/Data Lake/Content 2246586 wikitext text/x-wiki 4jbcr5h1nl1xy83i3lq7i2mr5q0woz2 2246588 2246586 2024-11-21T19:23:25Z XCollazo-WMF 37720 Add delete request. 2246588 wikitext text/x-wiki 73bflpmroaro2a7xv2urr4lg3x6og0e Nova Resource:Tools.bullseye/SAL 498 456152 2246600 2024-11-21T20:43:17Z Stashbot 7414 lucaswerkmeister: add toolforge-standards-committee as maintainer for processing of T380537 2246600 wikitext text/x-wiki omv8lsg1piixcvnbmp56y2l1bepxf2g User talk:JLy-WMF 3 456153 2246688 2024-11-22T09:43:44Z StrikerBot 8475 Welcome to Toolforge! 2246688 wikitext text/x-wiki rul76nm4kaogpsbl49t0ha786fm0u4h User:Ottomata/CamelCase is bad 2 456154 2246722 2024-11-22T11:20:40Z Ottomata 88 Ottomata moved page [[User:Ottomata/CamelCase is bad]] to [[User:Ottomata/Organized Code]]: Will collect other preferences in this page 2246722 wikitext text/x-wiki 5sgowjjoa39v6lpqfyv27wjc03mz4to