Metrics Migration Tool - Cassandra

John Sanda jsanda at redhat.com
Wed Jan 9 19:32:24 UTC 2013


On Jan 9, 2013, at 1:37 PM, Charles Crouch <ccrouch at redhat.com> wrote:

> 
> 
> ----- Original Message -----
>> After some lengthy discussion with Stefan, I think the migration tool
>> needs to be run while the server is offline or possibly in
>> maintenance mode. The best time to run the tool would be prior to
>> running the RHQ installer. A problem with doing the data migration
>> while the server is running is that we could wind up with skews in
>> the aggregate data. The easiest and fastest way to ensure data is
>> consistent for both pre- and post-upgrade is to run the data
>> migration while the server is down.
> 
> Whether this approach is feasible or not could very well depend on the speed of the migration
> -How long does our normal upgrade take today? I'm not aware of folks saying that was too long
> -If it takes hours/days to move data during upgrade then that may simple not be an option. Could a portion of the data be moved while the server is live?

If we do the data migration while the RHQ server is up, we potentially have to deal with the following:

* the migration is going to take longer than if we do it while the server is down
* there is a good possibility of data skew with aggregate data
* we may have to disable baseline alerting until the migration is finished

If we do the data migration while the server is down, then:

* the migration will run faster than it would if run while the server is up
* there is possibility of data skew
* the upgrade process, i.e, the amount of time the server is down might be longer than if we do migration while the server is up

At this point, all we can do is speculate about how long the migration will actually take until we do some load testing. If we find that the migration is taking longer than we would like, another option could be to explore using the bulk import/export utilities provided by each of the databases.

- John


More information about the rhq-devel mailing list