Streamlining the setup process.

- dependency version pinning
- automatic `secret_key` generation
- automatic config file generation
- installing `once` script
- setup instructions in README.md
- adding an architecture diagram
This commit is contained in:
2020-06-11 15:50:51 +02:00
parent 2927412b3c
commit fa971ca9be
9 changed files with 459 additions and 155 deletions

View File

@@ -1,45 +1,81 @@
# once: a one-time file sharing personal service
It happens that I want to share a file with someone which is sensitive enough
that I don't want to upload on a public free service.
I would like to have something like transfer.sh, running
as a personal service, with the following features:
*once* is a personal cloud service that enables you to upload a local file of any size and get a link in return.
- it must be serverless (I'm not willing to pay except for the actual file storage, and only for the time strictly required)
- it must return a link that I can share to anyone
- file must be deleted as soon as it get *successfully downloaded*
- it must expose a simple HTTP API, so *curl* should suffice to share a file
- it must be protected with some form of authentication
This link will allow *one single* dowload operation, deleting the file once it has been successfully transferred.
With CDK I could create the following resources:
*once* is designed to run on AWS using only *serverless* components.
- An S3 bucket to host the uploaded files
- A Lambda function to implement the 'get-upload-ticket'
- A Dynamodb table to store the information about the entries
- Another Lambda function to implement a "smart" download handler, to delete the file after the very first successful transfer.
![Architecture diagram](once_architecture.png)
I will use API Gateway to expose the lambda functions as an HTTP API.
It can be easily provisioned to a private AWS account and it has been designed to have a negligible footprint on the bill.
HERE BE DIAGRAM!
## Deploying on AWS
## TODO
*once* is implemented using the [AWS CloudDevelopment Kit](https://docs.aws.amazon.com/cdk/) framework, and can be easily deployed as a self-contained CloudFormation stack to any AWS account.
[+] Publish it to a custom domain name: DONE
[+] Set logs retention policy
[+] Deploy custom domain as a nested stack
[+] Mask link preview depending on the user agent
[+] Add a robust authentication method
Make sure you have installed the latest CDK version for your platform, following the steps described in the [official getting started guide](https://docs.aws.amazon.com/cdk/latest/guide/getting_started.html).
- Add progressbar to client
- Package application as a click app
Install the required dependencies (you can use a virtualenv for this), with the following command:
pip install -r requirements.txt
The deployment can be then initiated, from the project root directory, with the following command:
$ cdk deploy
The output will include the base URL to use the service API.
...
✅ once
Outputs:
once.baseurl = https://xxxxxxxxxx.execute-api.eu-west-1.amazonaws.com/
Update your configuration file (by default it can be found at `~/.once`) adding the URL
under the `base_url` option, like in the following example config file:
[once]
secret_key = RBeXidk41E1lmB5x839sVjo.....
base_url = https://rrjvo2i9s5.execute-api.eu-west-1.amazonaws.com/
### Using a custom domain (optional)
If you want to expose the once API on a custom domain name hosted on
[Route 53](https://aws.amazon.com/route53/), you can just set the following environment variables before the deployment:
- `CUSTOM_DOMAIN` the domain name you want to expose the once API (e.g. _once.mydomain.com_)
- `HOSTED_ZONE_NAME` the Route 53 hosted zone name (e.g. _mydomain.com_)
- `HOSTED_ZONE_ID` the Route 53 hosted zone ID (e.g. _Z0113243DF12WNGOIXX_)
then the deployment command would look like the following example:
- Write a proper README with instructions
- Record a demo
- write tests with pytest
$ DOMAIN_NAME=once.mydomain.com \
HOSTED_ZONE_NAME=mydomain.com \
HOSTED_ZONE_ID=Z0113243DF12WNGOIXX \
cdk deploy
- publish the source code
- write a blog post
- add a link to the blog post in the README
If you need more details about creating a public hosted zone on AWS, consult the [official documentation](https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/CreatingHostedZone.html).
## Uploading a file
To make the `once` command available you can install it using pip, with the following command:
$ pip install .
Once the service and the client have been correctly installed and configured, you can upload a local file running the `once` command.
once <file_toshare>
The URL can be shared to download the file, only once.
## Uninstalling
If you want to completely remove *once* from your AWS account, you will need to run the following command:
cdk destroy
then remember to delete your config file:
rm ~/.once