feat(storage-provider): upload a file and download CARv2

[cernicc]

Description

The change implements upload and download functionality. Currently, the axum server starts on a different port, but in the future, I imagine we would like to listen on the same address as the general rpc service. There are still many things to be solved before the functionality can be called finished. But as the POC it works.

How do you try it out?

Check #120 for a guide on how to try it out.

Checklist

• Are there important points that reviewers should know?
• Make sure that you described what this change does.
• If there are follow-ups, have you created issues for them?
• Have you tested this solution?
• Did you document new (or modified) APIs?

[th7nder]

v1 looks great ;D

[jmg-duarte]

I was trying this out and this can't be merged like this.

I thought it was a good idea to have both servers run from a single command but I disagree now. And it's very clear, they're separate concerns...

cargo run -- run doesn't work out of the box, it needs to connect to a substrate server.

The upload server should be a separate command. The change isn't too big and it makes things simpler when handling signals and threads.

The graceful shutdown and timeout still apply, just separate the upload server into another command.

[cernicc]

Hmm. I wonder how the storage client will exchange the content with the storage provider. Maybe down the line we won't even need the separate server.

[jmg-duarte]

Hmm. I wonder how the storage client will exchange the content with the storage provider. Maybe down the line we won't even need the separate server.

Filecoin does it over Graphsync and the SP is not necessarily on the same machine.

[jmg-duarte]

Some notes on the docker. I'm not entirely convinced that cargo-chef is really needed since we're going to ship the container to be used, not built from scratch. But if it improves local builds, that works for me

[jmg-duarte]

One last question. It's important because if it fails and it simply stays put, the user will be left clueless.

[jmg-duarte]

Great job! I learned a bunch about async too