Controller Migration: migrating aborted

juju
1

Hello guy, I would like to kindly ask you about help.

We upgraded our controller and model to the latest: 2.7.4 from previous 2.7.1. I tried the migration and it was aborted again. It could still be a bug, but I suspect its also something to do with our setup.

$ juju status
Model    Controller           Cloud/Region   Version  SLA          Timestamp  Notes
default  k8s-eu-west-1-18.04  aws/eu-west-1  2.7.4    unsupported  22:39:50Z  migrating: aborted, removing model from target controller: validating, some agents reported failure

Upgrade:
$ juju controllers --refresh
Controller Model User Access Cloud/Region Models Nodes HA Version
k8s-eu-west-1* default admin superuser aws/eu-west-1 2 13 none 2.7.1
k8s-eu-west-1-18.04 default admin superuser aws/eu-west-1 2 1 none 2.7.4

# switch to NEW controller
$ juju switch k8s-eu-west-1-18.04

# show available models:
$ juju models
$ juju upgrade-model -m k8s-eu-west-1-18.04:controller
$ juju controllers --refresh
$ juju upgrade-model 

# be CAREFUL!!!!!
$ juju destroy-model default

# switch to OLD controller
$ juju switch k8s-eu-west-1

# is done on background:
$ juju migrate --verbose --show-log default k8s-eu-west-1-18.04

# check background migration progress (best in 2nd terminal)
$ watch --color -n 1 juju status --color

$ juju controllers  --refresh
Controller            Model    User   Access     Cloud/Region   Models  Nodes    HA  Version
k8s-eu-west-1         default  admin  superuser  aws/eu-west-1       1      1  none  2.7.1   
k8s-eu-west-1-18.04*  default  admin  superuser  aws/eu-west-1       2     13  none  2.7.4  

# check migrated nodes on new controller:
$ juju status

Model    Controller           Cloud/Region   Version  SLA          Timestamp  Notes
default  k8s-eu-west-1-18.04  aws/eu-west-1  2.7.4    unsupported  15:33:47Z  migrating: aborted, removing model from target controller: validating, some agents reported failure

App                    Version   Status  Scale  Charm                  Store       Rev  OS      Notes
aws-integrator         1.16.266  active      1  aws-integrator         jujucharms   28  ubuntu  
containerd                       active      6  containerd             jujucharms   54  ubuntu  
easyrsa                3.0.1     active      1  easyrsa                jujucharms  296  ubuntu  
etcd                   3.2.10    active      3  etcd                   jujucharms  488  ubuntu  
flannel                0.11.0    active      6  flannel                jujucharms  468  ubuntu  
kubeapi-load-balancer  1.14.0    active      1  kubeapi-load-balancer  jujucharms  704  ubuntu  exposed
kubernetes-master      1.13.12   active      2  kubernetes-master      jujucharms  792  ubuntu  
kubernetes-worker      1.13.12   active      4  kubernetes-worker      jujucharms  634  ubuntu  exposed
... ...
... ...
2

Hi @vlad1234567890, welcome to the forum!

That error “validating, some agents reported failure” means that, after the model was imported into the target controller, the machine and unit agents in the model tried to connect to the target controller to ensure that it was reachable. It sounds like some of them failed, which aborted the migration.

Can you check in the debug-log for the controller model on the source controller? There should be more detail on specifically which agents couldn’t talk to the new controller.