How to migrate your Object Store to the Fuga Cloud Object Store

Estimated time to read: 7 minutes

It’s possible to move your Object Store from a different platform to the Fuga Object Store. Since almost all of the Object Stores are S3 compatible, you are free to migrate to any compatible platform. This tutorial will explain how to create a Fuga Object Store container and how to migrate from different platforms.

Requirements

Linux/macOS/BSD system

Creating a Fuga Object Store container

Before you can move your S3 compatible Object Store from a different platform to the Fuga Object Store, you first need a Fuga Object Store container.

Open your Fuga Dashboard and open the ‘Object Store’ section.
Click on ‘Containers’ and followed by clicking the + Container button.
Give your new container a fitting name and click on + Create.

We now have a container that is ready to be used in the upcoming steps.

Fuga Object Store keys

To connect to your Fuga Object Store access and secret tokens are required. If you already have these you can skip this chapter.

To list and create API keys for the Object Store we need the Fuga OpenStack CLI. If you haven’t installed it yet check out our tutorial.
After following the tutorial for your operating system it’s time to list the credentials. We need the credentials to access our Object Store container in later steps.
To list all the credentials, enter the command:
```
openstack ec2 credentials list
```
If the list of credentials is empty, a new pair of credentials can be generated with:
```
openstack ec2 credentials create
```
Either copy the Access and Secret key to the clipboard or save them temporarily

Installing and setting up rclone

Rclone is used to sync files between S3 compatible buckets. With rclone you can sync different object store buckets to the Fuga Object Store. In this chapter, we will be setting up rclone for Fuga.

Start the rclone installation by executing the following command in your Terminal:
```
curl https://rclone.org/install.sh | sudo bash
```
To start configuring rclone use following command:
```
rclone config
```
1. Enter n to create a new remote.
2. When asked for a name enter a fitting name, for example, fuga.
3. Enter S3 to select S3 compliant storage since the Fuga Object Store is S3 compliant with Ceph.
4. Enter 3 to select Ceph as S3 provider.
5. Enter 1 to select Enter AWS credentials in the next step.
6. Enter your Fuga access_key that you obtained from the previous chapter and press enter.
7. Enter your Fuga secret_key that you obtained from the previous chapter and press enter.
8. Enter 2 to select Use this only if v4 signatures don't work, eg pre Jewel/v10 CEPH. "other-v2-signature"
9. When asked for an endpoint you can find a list in my.fuga dashboard.
10. When asked for location_constraint, just press enter to keep it empty.
11. When asked for acl, enter 1, for full ownership of the created buckets. If you want to restrict access, you can choose a different option.
12. In the final step a summary will be shown and should look like this:
```
[fuga]
type = s3
provider = Ceph
env_auth = false
access_key_id = YOUR_FUGA_ACCESS_KEY
secret_access_key = YOUR_FUGA_SECRET_KEY
region = other-v2-signature
endpoint = https://<api_endpoint>
location_constraint =
acl = private
```
13. If all the information in the summary is correct, press y to confirm. If you want to edit the new remote you can press e.

Adding new remotes to sync with

Migrating your object store to the Fuga Object Store is easy! This chapter will explain how to add other object stores to rclone from different platforms.

Migrate from Backblaze to Fuga Object Store

Log in to your Backblaze account and go to the Buckets page.
Click on Show Account ID and Application Key to view your personal Backblaze keys.
Click on Create application key to create a new application key for rclone to use. Keep this popup open because we need these keys in the upcoming steps.
Enter the following command to configure rclone:
```
rclone config
```
1. Enter n to create a new remote.
2. When asked for a name enter a fitting name, for example, backblaze.
3. Enter 4 to select B2 Backblaze.
4. Enter your Account ID from step 3.
5. Enter your Application Key from step 3.
6. When asked for an endpoint, just press enter to keep it empty.
7. In the final step a summary will be shown and should look something like this:
```
[backblaze]
type = b2
account = YOUR_ACCOUNT_ID
key = YOUR_APPLICATION_KEY
endpoint =
```
8. If all the information in the summary is correct, press y to confirm. If you want to edit the new remote you can press e.
See the next chapter Syncing an object store to the Fuga Object Store for the continuation of this tutorial.

Migrate from IBM COS to Fuga Object Store

Log in to your IBM Cloud dashboard.
Open your bucket and go to Service credentials
Click on New Credentials + to add new credentials.
From the Role dropdown select Manager.
Keep the Select Service ID as default.
In the Add Inline Configuration Parameters (Optional): input add the following text: {"HMAC":true}
Click on Add to generate the new credentials.
Click on View credentials to show the credentials in JSON format. Keep this page open because we need this in the upcoming steps.
Enter the following command to configure rclone:
```
rclone config
```
1. Enter n to create a new remote.
2. When asked for a name enter a fitting name, for example, wasabi.
3. Enter 3 to select S3 compliant storage.
4. Enter 5 to select Wasabi as S3 provider.
5. Enter 1 to select Enter AWS credentials in the next step.
6. Enter your IBM COS access_key that you obtained from step 8 and press enter.
7. Enter your IBM COS secret_key that you obtained from step 8 and press enter.
8. Enter 1 to select Use this if unsure. Will use v4 signatures and an empty region.
9. Enter the number for your IBM COS region and press enter. You can find this in your bucket list on IBM COS.
10. Enter the number for your IBM COS Location constraint and press enter. You can find this in your bucket list on IBM COS.
11. When asked for acl, enter 1, for full ownership of the created buckets. If you want to restrict access, you can choose a different option.
12. In the final step a summary will be shown and should look like this:
```
[ibm]
type = s3
provider = IBMCOS
env_auth = false
access_key_id = YOUR_IBM_COS_ACCESS_KEY
secret_access_key = YOUR_IBM_COS_SECRET_KEY
region =
endpoint = s3.eu-geo.objectstorage.softlayer.net
location_constraint = eu-standard
acl = private
```
See the next chapter Syncing an object store to the Fuga Object Store for the continuation of this tutorial.

Migrate from Wasabi to Fuga Object Store

Log in to your Wasabi account and open the left menu.
Click on Access keys.
If you don’t have an access key yet, click on + CREATE NEW ACCESS KEYS.
A popup will show with your new access key. Click on Show at the bottom of the popup to see your secret key, keep this popup open.
Enter the following command to configure rclone:
```
rclone config
```
1. Enter n to create a new remote.
2. When asked for a name enter a fitting name, for example, wasabi.
3. Enter 3 to select S3 compliant storage.
4. Enter 7 to select Wasabi as S3 provider.
5. Enter 1 to select Enter AWS credentials in the next step.
6. Enter your Wasabi access_key that you obtained from step 4 and press enter.
7. Enter your Wasabi secret_key that you obtained from step 4 and press enter.
8. Enter 1 to select Use this if unsure. Will use v4 signatures and an empty region.
9. Enter 1 to select the default Wasabi URL.
10. When asked for location_constraint, just press enter to keep it empty.
11. When asked for acl, enter 1, for full ownership of the created buckets. If you want to restrict access, you can choose a different option.
12. In the final step a summary will be shown and should look like this:
```
[wasabi]
type = s3
provider = Wasabi
env_auth = false
access_key_id = YOUR_WASABI_ACCESS_KEY
secret_access_key = YOUR_WASABI_SECRET_KEY
region =
endpoint = s3.wasabisys.com
location_constraint =
acl = private
```
See the next chapter Syncing an object store to the Fuga Object Store for the continuation of this tutorial.

Syncing an object store to the Fuga Object Store

When you have rclone configured, it is time to migrate your object store to the Fuga Object Store. We can do this with the rclone sync command. The syntax for this command is rclone sync SRC:BUCKET TARGET:BUCKET.

A way to use the rclone sync command is:

rclone sync aws:my_old_bucket fuga:my_new_container

When rclone is done syncing, you can check your Fuga Object Store container on your dashboard. All your files should be there, you are free to remove your old Object Store or keep it as a backup.