LucidLink Filespace

LucidLink Filespaces is a distributed global file system for object storage that performs like a local disk and provides seamless access to data stored in distant locations. LucidLink's cloud-native distributed file system allows many users to access it concurrently via a folder placed on the local client. The LucidLink cloud NAS provides access to large datasets through direct streaming, eliminating the need for downloading and synchronizing.

Using Storj with LucidLink provides resilient cloud object storage with blazing performance and zero-trust security. This integration ensures:

  1. Fast performance that simulates disk storage: LucidLink enables unparalleled performance with object storage where only the data bits required at the current time are streamed to and from the client and storage.

  2. Combined security features: LucidLink provides a “Zero-Knowledge” security model that encrypts all the data starting in the local cache on the client, in-flight, and in the object storage itself—and only the customer has the encryption key. Storj encrypts your data as well.

  3. Access: Allows multiple globally distributed users simultaneous access to data.

Integration

This integration uses S3 credentials passed from Storj to LucidLink. You will need to set up a Storj account, create a Storj bucket for LucidLink, and generate S3 credentials for LucidLink. Then, you will need to create a Filespace on LucidLink using and initialize it with credentials created in Storj.

Software Requirements

LucidLink integrates with any S3-compatible cloud storage platform, including Storj.

To integrate LucidLink with Storj, you will need:

LucidLink is available for Windows, MacOS, and Linux. Download LucidLink here: https://www.lucidlink.com/download

Or sign up for a free trial of LucidLink here: https://www.lucidlink.com/trial


Create a Storj Account

To begin, you will need to create a Storj account. If you already an account, go to https://storj.io/login.

Navigate to https://storj.io/signup to sign up. Enter your full name, email address, and a password, as shown below:

Create a Bucket

Once you have your Storj account you can create a bucket for your data to be stored in.

1. Navigate to “Buckets” on the left side menu.

2. Click “New Bucket” on the top right.

3. Assign the bucket an easily identifiable name, such as "my-bucket".

4. Click Create bucket

Generate S3 credentials

Storj has an Amazon S3 compatible API and you'll need generate S3 credentials to use it. S3 credentials consist of an access key, secret key, and endpoint.

Create S3 credentials in the Storj web console:

1. Navigate to Access on the left side menu.

2. Click Create S3 Credentials under the S3 Credentials block.

3. When the Create Access screen comes up, set specifications according to the following guidelines:

  • Type: S3 Credentials

  • Name: The name of the credentials (e.g. my-access)

4. Click Continue to provide permissions

  • Permissions: All

  • Buckets: Feel free to specify the bucket you created above (e.g. my-bucket), or leave as “All”

  • End date: provide an expiration date for these credentials (optional)

5. Click Continue to provide Access encryption Information

  • Use the current passphrase: this is default option

  • Advanced: you may provide a different encryption phrase either your own or generate a new one.

    • Enter a new passphrase: use this option, if you would like to provide your own new encryption phrase

    • Generate 12-word passphrase: use this option, if you would like to generate a new encryption phrase

In order to see the data uploaded to your bucket in the web console, you must unlock the bucket with the same encryption passphrase as the credentials.

6. Click Create Access to finish creation of your S3 credentials

7. Click Confirm the Confirm details pop-up message

8. Your S3 credentials are created. Write them down and store them, or click the Download all button. You will need these credentials for the following steps.


To complete the integration, you will need the S3 credentials created in the previous steps, a LucidLink Filespace for Storj, and the LucidApp on your local machine.

To sign in to your LucidLink account, visit https://www.lucidlink.com/webportal/login or visit https://www.lucidlink.com/ and click "Sign in". Otherwise, create an account.

Signing in takes you to the LucidLink web portal, where you will create your domain and Filespace.

Create a Domain

When you initially log in to LucidLink, you will be prompted to name your domain. Your domain is where you will create Filespaces. In this case, we have named our domain "storjdemo".

1. From the webportal, click on the "Create New Filespace" card.

2. Choose the "Custom Filespace" plan to add your own cloud storage.

3. Choose the "Custom Filespace" option to use your own cloud storage.

4. Choose a Filespace name. In this case, we will use "storj".

5. On the "Choose Your Provider" screen, scroll down to "Other Cloud" and select that option.

6. Enter the endpoint URL that you saved from your S3 credentials in the "Endpoint URL" field. In this case, our endpoint is https://gateway.storjshare.io.

7. If desired, set your region under the "Region name" field. This is not required.

8. If desired, check "Configure advanced settings" at the bottom of the page before clicking "Continue".

9. On the Advanced Settings page, enter the bucket name that you created in Storj. In this instance, the bucket is "lucidlink-bucket".

10. It is recommended to set the block size to at least 2MB for optimal data stream quality.

12. Review and confirm the details of your Filespace before clicking "Create" at the bottom of the page.

13. LucidLink will redirect you to your dashboard while it sets up your Filespace. Once the Filespace is set up, you will have to initialize it. Follow the steps below to initialize your Filespace.

Initialize your Filespace

Initializing your Filespace must be completed through the LucidLink client, which you can download from the Lucidlink website. You will be prompted for your S3 credentials and required to set a root password during initialization.

1. Click "Initialize" on your new Filespace.

2. Read through the pop-up window detailing the instructions for initializing your Filespace.

  1. At the top is a link to download the LucidLink client. If you have not already downloaded it, click on the link, or visit https://www.lucidlink.com/download.

  2. If you have already downloaded the LucidLink client (LucidApp), click "Launch the desktop client" at the bottom of the window.

3. Once the LucidApp has launched, add your saved access key and **secret key **created in Storj into the "Access Key" and "Secret Key" fields, respectively. Click "Next".

4. Create a root password. Make sure to save this password because it cannot be recovered. Check the "Remember password" box at the bottom of the screen if you wish to store your password. Then click "Initialize".

Initializing a Filespace From the Command Line

Initializing the Filespace from the command line allows you more options in configuring the initialization. The command takes the following general format:

lucid init-s3 --fs <filespace.domain> --password <rootpassword> --https --endpoint storage.googleapis.com --region <region> --access-key <accesskey> --secret-key <secretkey> --bucket-name <bucket> --provider <provider>
lucid init-s3 --fs <filespace.domain> --password <rootpassword> --https --endpoint storage.googleapis.com --region <region> --access-key <accesskey> --secret-key <secretkey> --bucket-name <bucket> --provider <provider>

With our credentails in this example, we would have the following command:

lucid init-s3 --fs <storj.storjdemo> --password <MtrU76#pxxY98> --https --endpoint us1.storj.io/ --region <US east> --access-key <jx626ak4gis37hyvfi42znkz5mrq> --secret-key <j2gyivv7jor6gasbgqkhsalx4jky2qj36zlamm76mxiggl6esaj2u> --bucket-name <lucidlink-bucket> --provider Storj
lucid init-s3 --fs <storj.storjdemo> --password <MtrU76#pxxY98> --https --endpoint us1.storj.io/ --region <US east> --access-key <jx626ak4gis37hyvfi42znkz5mrq> --secret-key <j2gyivv7jor6gasbgqkhsalx4jky2qj36zlamm76mxiggl6esaj2u> --bucket-name <lucidlink-bucket> --provider Storj

For more information on using the command line with LucidLink, see the following guide: https://support.lucidlink.com/hc/en-us/articles/5778797132557

Success!

Previous
Livepeer