Page MenuHomeMiraheze

Migrate cloud1 and cloud2 virtual machines to new servers
Closed, ResolvedPublic

Description

  • cp6.miraheze.org - replacement installed, must be failed over together with mw* and mon1*
  • cp7.miraheze.org - replacement installed, must be failed over together with mw* and mon1*
  • gluster1.miraheze.org
  • gluster2.miraheze.org
  • graylog1.miraheze.org
  • jobrunner1.miraheze.org - replacement installed, rdb and letsencrypt must be migrated over, failover depends on gluster and db fw rules
  • jobrunner2.miraheze.org - replacement installed, failover depends on gluster and db fw rules
  • ldap1.miraheze.org
  • mail1.miraheze.org
  • mon1.miraheze.org
  • mw4.miraheze.org
  • mw5.miraheze.org
  • mw6.miraheze.org
  • mw7.miraheze.org
  • ns2.miraheze.org
  • rdb1.miraheze.org
  • rdb2.miraheze.org
  • phab1.miraheze.org
  • puppet2.miraheze.org
  • services1.miraheze.org
  • services2.miraheze.org
  • test2.miraheze.org

Event Timeline

Southparkfan created this task.
Southparkfan renamed this task from Migrate clooud1 and cloud2 virtual machines to new servers to Migrate cloud1 and cloud2 virtual machines to new servers.Jan 30 2021, 00:38

Per-server caveats noted at https://etherpad.wikimedia.org/p/Migration_to_new_infrastructure. Copy-pasted here since etherpad's data may be truncated at any time by Wikimedia.

This is Miraheze's migration plan for the new infrastructure per T6787.

Definition of immutable
	* True: doesn't contain data that must be migrated
	* False: contains data that must be migrated (e.g. mariadb/graylog/gluster)

Prerequisites
	1. Purchasing the new servers (cloud4/cloud5) and IPs, action: SPF
	2. Installing proxmox on new servers, action: paladox

== Migration process ==
cloud4 and cloud5 will be installed. Fresh migration: no 'live migration', but spinning up new instances.

	* cp9
		* Planned replacement: new OVH VPS cp12, to be bought
		* Immutable: true
		* Process: spin up new cache proxy, change DNS config, change cache proxy IPs in nginx.conf & LS.php
		* Action: SPF
	* gluster1
		* Planned replacement: gluster3 @ cloud4
		* Plane space upgrade: 1tb
		* Immutable: false
		* Process: Going to rsync all date to the new volume (in order to stop using stripe (sharding))
		* Action: paladox
	* gluster2
		* Planned replacement: gluster4 @ cloud5
		* Plane space upgrade: 1tb
		* Immutable: false
		* Process: Going to rsync all date to the new volume (in order to stop using stripe (sharding))
		* Action: paladox
	* graylog1
		* Planned replacement: graylog2 @ cloud4
		* Plane space upgrade: 750gb
		* Immutable: false
		* Process: ????
		* Action: SPF
	* ldap1
		* Planned replacement: ldap2 @ cloud4
		* Immutable: false
		* Process: Migrating /etc/ldap and /var/lib/ldap.
		* Action: paladox
	* rdb1
		* Planned replacement: rdb3 @ cloud4
		* Immutable: true
		* Process: announce maintenance, since unavailability/migration redis causes session loss
		* Action: paladox
	* rdb2
		* Planned replacement: rdb4 @ cloud5
		* Immutable: true
		* Process: announce maintenance, since unavailability/migration redis causes session loss
		* Action: paladox
	* puppet2
		* Planned replacement: puppet3 @ cloud4
		* Immutable: false
		* Process: point puppet agents to new puppetmaster. Migrate private repo /root/private,  /home/puppet-ssl and /etc/puppetlabs/puppet/private.
		* Action: paladox
	* services1
		* Planned replacement: services3 @ cloud4
		* Immutable: true
		* Process: No data to be migrated. Depool from nginx and from DNS. Update DNS config and repool.
		* Action: paladox
	* services2
		* Planned replacement: services4 @ cloud5
		* Immutable: true
		* Process: No data to be migrated. Depool from nginx and from DNS. Update DNS config and repool.
		* Action: paladox
	* mon1
		* Planned replacement: mon2 @ cloud5
		* Plane space upgrade: 100gb
		* Immutable: true
		* Process: No data to be migrated
		* Action: paladox
	* phab1
		* Planned replacement: phab2 @ cloud5
		* Immutable: false
		* Process: Migrate repositories and images
		* Action: paladox
	* cp6
		* Planned replacement: cp10 @ cloud4
		* Immutable: true
		* Process: spin up new cache proxy, change DNS config, change cache proxy IPs in nginx.conf & LS.php
		* Action: SPF
	* cp7
		* Planned replacement: cp11 @ cloud5
		* Immutable: true
		* Process: spin up new cache proxy, change DNS config, change cache proxy IPs in nginx.conf & LS.php
		* Action: SPF
	* test2
		* Planned replacement: test3 @ cloud5
		* Immutable: true
		* Process: No data to be migrated
		* Action: paladox
	* ns2
		* Planned replacement: ns2 @ cloud4
		* Immutable: true
		* Process: No data to be migrated
		* Action: paladox
	* mw[45]
		* Planned replacement: mw[89] @ cloud4
		* Immutable: true
		* Process: Depool from varnish, update DNS config.
		* Action: paladox
	* mw[67]
		* Planned replacement: mw(10|11) @ cloud5
		* Immutable: true
		* Process: Depool from varnish, update DNS config.
		* Action: paladox
	* jobrunner1
		* Planned replacement: jobrunner3 @ cloud4
		* Immutable: false
		* Process: Migrate rdb and also copy /etc/letsencrypt.
		* Action: paladox
	* jobrunner2
		* Planned replacement: jobrunner4 @ cloud5
		* Immutable: true
		* Process: No data to migrate.
		* Action: paladox
	* mail1
		* Planned replacement: mail2 @ cloud5
		* Immutable: false
		* Process: Migrate /var/mail and /home/mail.
		* Action: paladox
Paladox updated the task description. (Show Details)
Paladox claimed this task.
Paladox updated the task description. (Show Details)