[FR] Replace currently existing metrics and tracing with OTel

[sblack79]

Is your feature request related to a problem? Please describe.
For my company we had to productionize an internal version of CarbonAPI based on this repo, in the process of doing so we replaced the underlying msaf1980 metric suite with OpenTelemetry and added tracing to the http handlers.

Describe the solution you'd like
This is basically me asking if people would be interested in a PR to mimic what was done on our end, I know metrics can be quite opinionated and this would be a big change so I didn't want to create a pull request to begin the conversation.

Additional context
We use the prometheus OTel exporter for our metrics but this could be changed fairly easily.