Using rclone copyurl –files-from: A Comprehensive Guide

Managing files across different cloud storage services can be a daunting task. However, with rclone, a powerful command-line tool, you can easily copy files from one service to another. One of the most useful commands in rclone is `copyurl`, which allows you to copy files from a URL directly to your local machine or another cloud storage service. In this article, we will delve into the `copyurl –files-from` option, providing you with a detailed guide on how to use it effectively.

Understanding the copyurl Command

The `copyurl` command in rclone is designed to copy files from a URL to a specified destination. It is particularly useful when you need to download files from a website or a cloud storage service without installing any additional software. The basic syntax of the `copyurl` command is as follows:

rclone copyurl [source] [destination]

In this syntax, `[source]` refers to the URL of the file you want to copy, and `[destination]` is the location where you want to save the file. For example, to copy a file from a URL to your local machine, you would use the following command:

rclone copyurl https://example.com/file.txt ./

This command will download the file `file.txt` from `https://example.com` and save it in the current directory.

Introducing the –files-from Option

The `–files-from` option in the `copyurl` command allows you to specify a list of files to be copied. This option is particularly useful when you want to copy multiple files from a URL or when you want to filter the files based on certain criteria. The basic syntax of the `copyurl –files-from` command is as follows:

rclone copyurl [source] [destination] --files-from [file-list]

In this syntax, `[file-list]` is a file that contains a list of URLs of the files you want to copy. Each URL should be on a separate line. For example, to copy multiple files from a URL to your local machine using the `–files-from` option, you would use the following command:

rclone copyurl https://example.com/files/ --files-from filelist.txt

In this example, `filelist.txt` contains a list of URLs of the files you want to copy. The command will download all the files listed in `filelist.txt` from `https://example.com/files/` and save them in the current directory.

Creating a File List

Creating a file list is a straightforward process. You can use any text editor to create a file and list the URLs of the files you want to copy. Here’s an example of what a file list might look like:

https://example.com/file1.txthttps://example.com/file2.txthttps://example.com/file3.txt

Make sure to save the file with a `.txt` extension, as rclone expects the file list to be in plain text format.

Filtering Files with –files-from

The `–files-from` option can also be used to filter files based on certain criteria. For example, you can use regular expressions to match file names or extensions. Here’s an example of how to use the `–files-from` option with a regular expression to copy only files with a `.txt` extension:

rclone copyurl https://example.com/files/ --files-from filelist.txt --filter 'glob .txt'

In this example, the `–filter` option is used to match files with a `.txt` extension. The `glob` keyword is used to specify the pattern to match.

Conclusion

The `copyurl –files-from` option in rclone is a powerful tool for copying files from a URL to your local machine or another cloud storage service. By using a file list, you can easily copy multiple files or filter files based on specific criteria. Whether you’re downloading files from a website or managing files across different cloud storage services, the `copyurl –files-from` option is a valuable addition to your rclone toolkit.